Data Engineer (Data Modernization)
Job Summary
Job Description
Seeking a skilled Data Engineer to support a Data Modernization Assessment for a client. This role involves evaluating and optimizing data architecture, pipelines, and observability infrastructure. The ideal candidate will have hands-on experience building scalable data systems, a deep understanding of cloud environments, and collaborate effectively with technical and business teams. Responsibilities include analyzing end-to-end data infrastructure, optimizing data pipelines, evaluating architecture decisions, building proofs-of-concept for enhanced observability, assessing data governance and metadata management, and enhancing analytics tooling. The role also involves assessing data readiness for AI-driven analytics and BI, partnering with cross-functional teams, and contributing to strategic recommendations.
Must have:
- 4-6 years of experience as a Data Engineer
- Expertise in ETL/ELT pipelines (Spark, Databricks, Airflow, dbt)
- Proficiency in cloud data platforms (AWS, Azure, GCP)
- Experience with observability/monitoring tools (Datadog, Prometheus)
- Understanding of data governance and metadata management
- Familiarity with analytics/visualization tools (Power BI, Tableau, Looker)
- Strong problem-solving and communication skills
Good to have:
- Exposure to agentic AI systems or LLM-powered analytics
- Experience in regulated client environments/digital transformation
- Familiarity with Git, CI/CD, and infrastructure-as-code
Perks:
- Competitive salary
- Strong healthcare insurance
- Benefits package
- Extensive learning and development resources
12 skills required
Job Details
Overview
We are seeking a skilled Data Engineer to support a comprehensive Data Modernization Assessment for our client. This role will play a critical part in evaluating and optimizing the data architecture, pipelines, and observability infrastructure. The ideal candidate brings hands-on experience building scalable data systems, a deep understanding of cloud-based ecosystems, and a collaborative approach to working with technical and business teams.
Job Responsibilities
- Support the review and analysis of the client’s end-to-end data infrastructure, with a focus on scalability, maintainability, and performance.
- Evaluate and optimize existing data pipelines and orchestration workflows, ensuring reliability and efficiency.
- Collaborate with architects and the Technical Product Manager to assess architecture decisions, contributing technical insights and implementation feasibility.
- Build proof-of-concept improvements to support enhanced observability and monitoring, including data lineage, logging, and alerting.
- Assist in evaluating the data governance and metadata management frameworks, identifying pain points in data quality and accessibility.
- Contribute to mapping and enhancing the analytics tooling landscape, ensuring proper integration across reporting and dashboard platforms.
- Work alongside AI/BI specialists to assess the organization’s data readiness for AI-driven analytics and agentic BI use cases.
- Partner with cross-functional teams including data scientists, platform engineers, and business stakeholders to ensure technical alignment and data usability.
- Participate in the development of strategic recommendations and implementation roadmaps, supporting technical documentation and delivery planning.
Basic Qualifications
- 4–6 years of hands-on experience as a Data Engineer or equivalent role within enterprise-scale data environments.
- Strong expertise in building and optimizing ETL/ELT pipelines using tools such as Apache Spark, Databricks, Airflow, dbt, or equivalent.
- Proficiency in working with cloud data platforms (e.g., AWS, Azure, GCP), including data lake and warehouse solutions.
- Experience with observability and monitoring tools such as Datadog, Prometheus, or OpenTelemetry.
- Solid understanding of data governance concepts, metadata cataloging, and quality frameworks.
- Familiarity with analytics and visualization tools such as Power BI, Tableau, or Looker.
- Strong problem-solving, documentation, and communication skills; able to explain technical topics to non-technical audiences.
Preferred Qualifications
- Exposure to agentic AI systems, LLM-powered analytics, or modern BI automation platforms.
- Experience working in regulated or enterprise client environments, particularly during digital transformation or modernization initiatives.
- Familiarity with version control (e.g., Git), CI/CD for data systems, and infrastructure-as-code practices.
We are proud to offer a competitive salary alongside a strong healthcare insurance and benefits package. The role is preferably hybrid, with 2 days per week spent in the office, and flexibility for client engagement needs. We pride ourselves on the growth of our employees, offering extensive learning and development resources.
ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.
Similar Jobs
CME Group
Chicago, Illinois, United States (On-Site)
• 1 Month ago
Razer
Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
• 6 Days ago
Apple
Cupertino, California, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
bytedance
San Jose, California, United States (On-Site)
• 3 Months ago
Rippling
San Francisco, California, United States (On-Site)
• 3 Weeks ago
Synechron
Chennai, Tamil Nadu, India (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Toronto, Ontario, Canada
Get notifed when new similar jobs are uploaded
Data Analysis Jobs
PwC
Shanghai, Shanghai, China (On-Site)
• 9 Months ago
Scorewarrior
Limassol, Limassol, Cyprus (On-Site)
• 2 Months ago
Ruselle Investments
Mumbai, Maharashtra, India (On-Site)
• 4 Days ago
Definitive Healthcare
Bengaluru, Karnataka, India (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
About The Company
Here at ShyftLabs, we build data products to help enterprises deliver real impact through tailored data analytics, science, and AI solutions. From consulting to operations, we guide our customers through their data journey and ensure they are data and AI-empowered.
Get notified when new jobs are added by ShyftLabs
