Data Engineer

About the Organization

Now is a great time to join Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We’re looking for thoughtful, skilled professionals who thrive as trusted partners building technology-agnostic solutions and want to apply their talents supporting customers with difficult and important mission sets.

About the Role

Redhorse Corporation is seeking a highly skilled Data Engineer to support the Defense Intelligence Agency (DIA) in advancing Combatant Command mission integration. This critical role directly impacts national security by designing and implementing robust data solutions that enable data-driven decision-making within the Department of Defense (DoD). You will be at the forefront of AI/ML and data-driven initiatives, assessing and enhancing technology integration across Combatant Commands. This position offers significant opportunity to shape the future of DoD data management and analytics. Frequent travel is required.

Key Responsibilities

• Support the configuration and ingestion of structured, unstructured, and semi-structured data repositories into capabilities meeting mission partner requirements, supporting a data analytics and DevOps pipeline for rapid delivery of functionality.
• Maintain all operational aspects of data transfers, accounting for the security posture of the underlying infrastructure and supported systems and applications; monitor environmental health using various tracking capabilities.
• Automate configuration management, leverage appropriate tools, and stay current on ETL technologies and services.
• Work under general guidance, demonstrating initiative to develop solutions independently; review architecture and identify areas for automation, optimization, right-sizing, and cost reduction to improve environmental health.
• Apply comprehension of data engineering technologies and services, leveraging database expertise and various data structuring and retrieval approaches; comprehend cloud architectural constructs and support programmatic Cloud environment establishment and maintenance using vendor consoles.
• Engage with multiple functional groups to understand client challenges, prototype new ideas and technologies, create solutions to drive innovation, and design, implement, schedule, test, and deploy full features and components of solutions.
• Identify and implement scalable and efficient coding solutions.

Required Experience/Clearance

• Bachelor’s degree plus 5+ years of experience, or a Master’s degree plus 3+ years of experience.
• Experience with big data systems, including Apache Spark and Databricks.
• Experience with ETL processes.
• Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0.
• Experience engineering data pipelines across multiple security domains/classified networks.
• Experience with multiple coding languages, including Python.
• Active Top Secret (TS) security clearance with Sensitive Compartmented Information (SCI) eligibility and CI polygraph.

Desired Experience

• Experience with GitLab and Jira.
• Experience with containerization technologies (Docker, Kubernetes).
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Familiarity with Agile methodologies.
• Master's degree in Computer Science, Data Science, or a related field.