Data Engineer

SailPoint is seeking a Senior Data Engineer to join their Data Platform team. This role involves designing and implementing robust ELT processes, developing scalable data pipelines for stream and batch processing using JVM-based languages, and leveraging AWS services. The engineer will collaborate with cross-functional teams, maintain workflow orchestration with tools like Apache Airflow, and stay updated on emerging data engineering technologies. This is an opportunity to build a data platform from scratch within a supportive organization.

Must Have

• Spearhead design and implementation of ELT processes
• Extract and load data from RDBMS, NoSQL, data-warehouses
• Develop and maintain scalable data pipelines (stream/batch)
• Leverage JVM based languages and frameworks
• Utilize AWS service-stack for data solutions
• Develop and maintain workflow orchestration using Apache Airflow
• BS in computer science or related field
• 5+ years in data engineering
• System-design experience orchestrating ELT processes
• Experience with Flink or Spark
• Experience with Docker and Kubernetes
• Proficiency in AWS service stack
• Familiarity with Airflow
• Experience with DBT, Kafka, Jenkins, Snowflake
• Experience with Kustomize, Helm, Terraform

Good to Have

• Experience with AWS
• Experience with CICD
• Experience instrumenting code for production performance metrics
• Experience in working with a Data Catalog tool (Ex: Atlan / Alation)

We are looking for well-rounded engineers who are passionate about building and delivering reliable, scalable data pipelines.

This is a unique opportunity to build something from scratch but have the backing of an organization that has the muscle to take it to market quickly, with a very satisfied customer base.

Responsibilities:

• Spearhead the design and implementation of ELT processes, especially focused on extracting data from and loading data into various endpoints, including RDBMS, NoSQL databases and data-warehouses.
• Develop and maintain scalable data pipelines for both stream and batch processing leveraging JVM based languages and frameworks.
• Collaborate with cross-functional teams to understand diverse data sources and environment contexts, ensuring seamless integration into our data ecosystem.
• Utilize AWS service-stack wherever possible to implement lean design solutions for data storage, data integration and data streaming problems.
• Develop and maintain workflow orchestration using tools like Apache Airflow.
• Stay abreast of emerging technologies in the data engineering space, proactively incorporating them into our ETL processes.
• Thrive in an environment with ambiguity, demonstrating adaptability and problem-solving skills.

Qualifications:

• BS in computer science or a related field.
• 5+ years of experience in data engineering or related field.
• Demonstrated system-design experience orchestrating ELT processes targeting data
• Hands-on experience with at least one streaming or batch processing framework, such as Flink or Spark.
• Hands-on experience with containerization platforms such as Docker and container orchestration tools like Kubernetes.
• Proficiency in AWS service stack.
• Familiarity with workflow orchestration tools such as Airflow.
• Experience with DBT, Kafka, Jenkins and Snowflake.
• Experience leveraging tools such as Kustomize, Helm and Terraform for implementing infrastructure as code.
• Strong interest in staying ahead of new technologies in the data engineering space.
• Comfortable working in ambiguous team-situations, showcasing adaptability and drive in solving novel problems in the data-engineering space.

Preferred

• Experience with AWS
• Experience with CICD
• Experience instrumenting code for gathering production performance metrics
• Experience in working with a Data Catalog tool ( Ex: Atlan / Alation )

SailPoint is an equal opportunity employer and we welcome all qualified candidates to apply to join our team. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other category protected by applicable law.

Alternative methods of applying for employment are available to individuals unable to submit an application through this site because of a disability. Contact applicationassistance@sailpoint.com or mail to 11120 Four Points Dr, Suite 100, Austin, TX 78726, to discuss reasonable accommodations. NOTE: Any unsolicited resumes sent by candidates or agencies to this email will not be considered for current openings at SailPoint.