Data Engineer (Data Modernization)
3 Months ago • 4-6 Years
Data Analysis
Job Description
Seeking a skilled Data Engineer to support a Data Modernization Assessment for a client. This role involves evaluating and optimizing data architecture, pipelines, and observability infrastructure. The ideal candidate will have hands-on experience building scalable data systems, a deep understanding of cloud environments, and collaborate effectively with technical and business teams. Responsibilities include analyzing end-to-end data infrastructure, optimizing data pipelines, evaluating architecture decisions, building proofs-of-concept for enhanced observability, assessing data governance and metadata management, and enhancing analytics tooling. The role also involves assessing data readiness for AI-driven analytics and BI, partnering with cross-functional teams, and contributing to strategic recommendations.
Good To Have:
- Exposure to agentic AI systems or LLM-powered analytics
- Experience in regulated client environments/digital transformation
- Familiarity with Git, CI/CD, and infrastructure-as-code
Must Have:
- 4-6 years of experience as a Data Engineer
- Expertise in ETL/ELT pipelines (Spark, Databricks, Airflow, dbt)
- Proficiency in cloud data platforms (AWS, Azure, GCP)
- Experience with observability/monitoring tools (Datadog, Prometheus)
- Understanding of data governance and metadata management
- Familiarity with analytics/visualization tools (Power BI, Tableau, Looker)
- Strong problem-solving and communication skills
Perks:
- Competitive salary
- Strong healthcare insurance
- Benefits package
- Extensive learning and development resources
Overview
We are seeking a skilled Data Engineer to support a comprehensive Data Modernization Assessment for our client. This role will play a critical part in evaluating and optimizing the data architecture, pipelines, and observability infrastructure. The ideal candidate brings hands-on experience building scalable data systems, a deep understanding of cloud-based ecosystems, and a collaborative approach to working with technical and business teams.
Job Responsibilities
- Support the review and analysis of the client’s end-to-end data infrastructure, with a focus on scalability, maintainability, and performance.
- Evaluate and optimize existing data pipelines and orchestration workflows, ensuring reliability and efficiency.
- Collaborate with architects and the Technical Product Manager to assess architecture decisions, contributing technical insights and implementation feasibility.
- Build proof-of-concept improvements to support enhanced observability and monitoring, including data lineage, logging, and alerting.
- Assist in evaluating the data governance and metadata management frameworks, identifying pain points in data quality and accessibility.
- Contribute to mapping and enhancing the analytics tooling landscape, ensuring proper integration across reporting and dashboard platforms.
- Work alongside AI/BI specialists to assess the organization’s data readiness for AI-driven analytics and agentic BI use cases.
- Partner with cross-functional teams including data scientists, platform engineers, and business stakeholders to ensure technical alignment and data usability.
- Participate in the development of strategic recommendations and implementation roadmaps, supporting technical documentation and delivery planning.
Basic Qualifications
- 4–6 years of hands-on experience as a Data Engineer or equivalent role within enterprise-scale data environments.
- Strong expertise in building and optimizing ETL/ELT pipelines using tools such as Apache Spark, Databricks, Airflow, dbt, or equivalent.
- Proficiency in working with cloud data platforms (e.g., AWS, Azure, GCP), including data lake and warehouse solutions.
- Experience with observability and monitoring tools such as Datadog, Prometheus, or OpenTelemetry.
- Solid understanding of data governance concepts, metadata cataloging, and quality frameworks.
- Familiarity with analytics and visualization tools such as Power BI, Tableau, or Looker.
- Strong problem-solving, documentation, and communication skills; able to explain technical topics to non-technical audiences.
Preferred Qualifications
- Exposure to agentic AI systems, LLM-powered analytics, or modern BI automation platforms.
- Experience working in regulated or enterprise client environments, particularly during digital transformation or modernization initiatives.
- Familiarity with version control (e.g., Git), CI/CD for data systems, and infrastructure-as-code practices.
We are proud to offer a competitive salary alongside a strong healthcare insurance and benefits package. The role is preferably hybrid, with 2 days per week spent in the office, and flexibility for client engagement needs. We pride ourselves on the growth of our employees, offering extensive learning and development resources.
ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.
Set alerts for more jobs like Data Engineer (Data Modernization)
Set alerts for new jobs by ShyftLabs
Set alerts for new Data Analysis jobs in Canada
Set alerts for new jobs in Canada
Set alerts for Data Analysis (Remote) jobs
