Data Engineer

1 Month ago • All levels

Job Summary

Job Description

The Senior Data Engineer will design, build, and maintain data pipelines and infrastructure to support AI/ML initiatives and automate key processes. This role involves integrating data from multiple sources, including Oracle and SQL Server databases, and collaborating with data scientists and AI/ML engineers to ensure efficient access to high-quality data. Responsibilities include optimizing data workflows, applying ETL/ELT processes, and developing solutions to optimize storage and compute costs while ensuring data security and compliance. The engineer will use tools such as Apache Airflow, Talend, or Azure Data Factory and programming skills in Python, Scala, or Java.

Must have:

Experience in automating manual processes
Data engineering experience with databases and cloud platforms
Expertise in building and maintaining data pipelines
Strong programming skills in Python, Scala, or Java
Proficiency in SQL for data analysis

Good to have:

Knowledge of security best practices
Familiarity with big data technologies
Exposure to Databricks

15 skills required

15 skills required for this role

Add these skills to join the top 1% applicants for this job

azure

sql

gitlab

scalability

oracle

saas-business-models

java

jenkins

scala

ci-cd

kubernetes

spark

containers

aws

python

Job Details

Flexera saves customers billions of dollars in wasted technology spend. A pioneer in Hybrid ITAM and FinOps, Flexera provides award-winning, data-oriented SaaS solutions for technology value optimization (TVO), enabling IT, finance, procurement and cloud teams to gain deep insights into cost optimization, compliance and risks for each business service. Flexera One solutions are built on a set of definitive customer, supplier and industry data, powered by our Technology Intelligence Platform, that enables organizations to visualize their Enterprise Technology Blueprint™ in hybrid environments—from on-premises to SaaS to containers to cloud.

We’re transforming the software industry.  We’re Flexera.  With more than 50,000 customers across the world, we’re achieving that goal. But we know we can’t do any of that without our team. Ready to help us re-imagine the industry during a time of substantial growth and ambitious plans?  Come and see why we’re consistently recognized by Gartner, Forrester and IDC as a category leader in the marketplace. Learn more at flexera.com

Job Summary: We are seeking a skilled and motivated Senior Data Engineer to join our Automation, AI/ML team. In this role, you will work on designing, building, and maintaining data pipelines and infrastructure to support AI/ML initiatives, while contributing to the automation of key processes. This position requires expertise in data engineering, cloud technologies, and database systems, with a strong emphasis on scalability, performance, and innovation.

Key Responsibilities:

Identify and automate manual processes to improve efficiency and reduce operational overhead.
Design, develop, and optimize scalable data pipelines to integrate data from multiple sources, including Oracle and SQL Server databases.
Collaborate with data scientists and AI/ML engineers to ensure efficient access to high-quality data for training and inference models.
Implement automation solutions for data ingestion, processing, and integration using modern tools and frameworks.
Monitor, troubleshoot, and enhance data workflows to ensure performance, reliability, and scalability.
Apply advanced data transformation techniques, including ETL/ELT processes, to prepare data for AI/ML use cases.
Develop solutions to optimize storage and compute costs while ensuring data security and compliance.

Required Skills and Qualifications:

Experience in identifying, streamlining, and automating repetitive or manual processes.
Proven experience as a Data Engineer, working with large-scale database systems (e.g., Oracle, SQL Server) and cloud platforms (AWS, Azure, Google Cloud).
Expertise in building and maintaining data pipelines using tools like Apache Airflow, Talend, or Azure Data Factory.
Strong programming skills in Python, Scala, or Java for data processing and automation tasks.
Experience with data warehousing technologies such as Snowflake, Redshift, or Azure Synapse.
Proficiency in SQL for data extraction, transformation, and analysis.
Familiarity with tools such as Databricks, MLflow, or H2O.ai for integrating data engineering with AI/ML workflows.
Experience with DevOps practices and tools, such as Jenkins, GitLab CI/CD, Docker, and Kubernetes.
Knowledge of AI/ML concepts and their integration into data workflows.
Strong problem-solving skills and attention to detail.

Preferred Qualifications:

Knowledge of security best practices, including data encryption and access control.
Familiarity with big data technologies like Hadoop, Spark, or Kafka.
Exposure to Databricks for data engineering and advanced analytics workflows.

Flexera is proud to be an equal opportunity employer.  Qualified applicants will be considered for open roles regardless of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by local/national laws, policies and/or regulations. 

Flexera understands the value that results from employing a diverse, equitable, and inclusive workforce. We recognize that equity necessitates acknowledging past exclusion and that inclusion requires intentional effort. Our DEI (Diversity, Equity, and Inclusion) council is the driving force behind our commitment to championing policies and practices that foster a welcoming environment for all.

We encourage candidates requiring accommodations to please let us know by emailing careers@flexera.com.