Data Engineer (Data Modernization)

1 Day ago • 4-6 Years • Data Analysis

Job Summary

Job Description

Seeking a skilled Data Engineer to support a Data Modernization Assessment for a client. This role involves evaluating and optimizing data architecture, pipelines, and observability infrastructure. The ideal candidate will have hands-on experience building scalable data systems, a deep understanding of cloud environments, and collaborate effectively with technical and business teams. Responsibilities include analyzing end-to-end data infrastructure, optimizing data pipelines, evaluating architecture decisions, building proofs-of-concept for enhanced observability, assessing data governance and metadata management, and enhancing analytics tooling. The role also involves assessing data readiness for AI-driven analytics and BI, partnering with cross-functional teams, and contributing to strategic recommendations.
Must have:
  • 4-6 years of experience as a Data Engineer
  • Expertise in ETL/ELT pipelines (Spark, Databricks, Airflow, dbt)
  • Proficiency in cloud data platforms (AWS, Azure, GCP)
  • Experience with observability/monitoring tools (Datadog, Prometheus)
  • Understanding of data governance and metadata management
  • Familiarity with analytics/visualization tools (Power BI, Tableau, Looker)
  • Strong problem-solving and communication skills
Good to have:
  • Exposure to agentic AI systems or LLM-powered analytics
  • Experience in regulated client environments/digital transformation
  • Familiarity with Git, CI/CD, and infrastructure-as-code
Perks:
  • Competitive salary
  • Strong healthcare insurance
  • Benefits package
  • Extensive learning and development resources

Job Details

Overview 
We are seeking a skilled Data Engineer to support a comprehensive Data Modernization Assessment for our client. This role will play a critical part in evaluating and optimizing the data architecture, pipelines, and observability infrastructure. The ideal candidate brings hands-on experience building scalable data systems, a deep understanding of cloud-based ecosystems, and a collaborative approach to working with technical and business teams.

Job Responsibilities

    • Support the review and analysis of the client’s end-to-end data infrastructure, with a focus on scalability, maintainability, and performance.
    • Evaluate and optimize existing data pipelines and orchestration workflows, ensuring reliability and efficiency.
    • Collaborate with architects and the Technical Product Manager to assess architecture decisions, contributing technical insights and implementation feasibility.
    • Build proof-of-concept improvements to support enhanced observability and monitoring, including data lineage, logging, and alerting.
    • Assist in evaluating the data governance and metadata management frameworks, identifying pain points in data quality and accessibility.
    • Contribute to mapping and enhancing the analytics tooling landscape, ensuring proper integration across reporting and dashboard platforms.
    • Work alongside AI/BI specialists to assess the organization’s data readiness for AI-driven analytics and agentic BI use cases.
    • Partner with cross-functional teams including data scientists, platform engineers, and business stakeholders to ensure technical alignment and data usability.
    • Participate in the development of strategic recommendations and implementation roadmaps, supporting technical documentation and delivery planning.

Basic Qualifications

    • 4–6 years of hands-on experience as a Data Engineer or equivalent role within enterprise-scale data environments.
    • Strong expertise in building and optimizing ETL/ELT pipelines using tools such as Apache Spark, Databricks, Airflow, dbt, or equivalent.
    • Proficiency in working with cloud data platforms (e.g., AWS, Azure, GCP), including data lake and warehouse solutions.
    • Experience with observability and monitoring tools such as Datadog, Prometheus, or OpenTelemetry.
    • Solid understanding of data governance concepts, metadata cataloging, and quality frameworks.
    • Familiarity with analytics and visualization tools such as Power BI, Tableau, or Looker.
    • Strong problem-solving, documentation, and communication skills; able to explain technical topics to non-technical audiences.

Preferred Qualifications

    • Exposure to agentic AI systems, LLM-powered analytics, or modern BI automation platforms.
    • Experience working in regulated or enterprise client environments, particularly during digital transformation or modernization initiatives.
    • Familiarity with version control (e.g., Git), CI/CD for data systems, and infrastructure-as-code practices.
We are proud to offer a competitive salary alongside a strong healthcare insurance and benefits package. The role is preferably hybrid, with 2 days per week spent in the office, and flexibility for client engagement needs. We pride ourselves on the growth of our employees, offering extensive learning and development resources. 

ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Toronto, Ontario, Canada

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Here at ShyftLabs, we build data products to help enterprises deliver real impact through tailored data analytics, science, and AI solutions. From consulting to operations, we guide our customers through their data journey and ensure they are data and AI-empowered.

Toronto, Ontario, Canada (Hybrid)

Noida, Uttar Pradesh, India (Hybrid)

Noida, Uttar Pradesh, India (On-Site)

Noida, Uttar Pradesh, India (Hybrid)

Noida, Uttar Pradesh, India (On-Site)

Noida, Uttar Pradesh, India (Hybrid)

Noida, Uttar Pradesh, India (Hybrid)

Toronto, Ontario, Canada (Hybrid)

Noida, Uttar Pradesh, India (Hybrid)

Atlanta, Georgia, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by ShyftLabs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug