Senior Associate, Azure Data Engineering

8 Minutes ago • 5-7 Years • $82,300 PA - $137,000 PA
Data Analysis

Job Description

As a Senior Associate, Azure Data Engineering at PwC, you will design, build, and maintain enterprise data platforms on Microsoft Azure. This role involves developing scalable, reliable, and efficient data pipelines to ingest, transform, and serve data to various stakeholders. You will focus on robust and scalable technology infrastructure solutions, leveraging network architecture, server management, and cloud computing expertise. A deep understanding of modern data architecture, automation, and hands-on expertise with the Azure data stack is essential.
Good To Have:
  • Proficiency with Infrastructure as Code (Terraform is a plus).
  • Amazon Web Services (AWS) experience.
  • Google Cloud Platform experience.
  • Cloud Architectures knowledge.
  • Cloud Migration experience.
  • DevOps Practices.
Must Have:
  • Architect, design, and develop robust, end-to-end data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Lead the design and implementation of advanced data models within Azure Data Lake, championing Medallion Architecture and PySpark/Delta Lake transformations.
  • Develop ETL/ELT processes for data ingestion from various sources (SQL, Oracle, APIs, streaming).
  • Automate data workflows and implement CI/CD practices for data pipelines using Azure DevOps or GitHub Actions.
  • Monitor, troubleshoot, and optimize data solutions for performance, scalability, and cost-effectiveness, including Spark job tuning and query optimization.
  • Collaborate with data analysts, data scientists, and business stakeholders to deliver high-quality data solutions.
  • Mentor junior data engineers, establishing coding standards and best practices.
  • Ensure data quality, integrity, and governance through best practices and documentation.
  • Microsoft Azure Data Engineer Associate (DP-203) certification or ability to obtain within 2 months.
  • 5-7 years of hands-on data engineering experience with complex production projects.
  • Expert-level proficiency in SQL, Python, and PySpark.
  • Bachelor's degree in Computer Science, Engineering, Information Technology, or related field.
Perks:
  • Competitive compensation package
  • Inclusive benefits
  • Flexibility programs

Add these skills to join the top 1% applicants for this job

problem-solving
oracle
cad-computer-aided-design
github
game-texts
aws
azure
azure-devops
terraform
spark
google-cloud-platform
amazon-web-services
microsoft-azure
ci-cd
python
github-actions
sql

Senior Associate, Azure Data Engineering

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Technology Strategy

Management Level

Senior Associate

Job Description & Summary

At PwC, our people in infrastructure focus on designing and implementing robust, secure IT systems that support business operations. They enable the smooth functioning of networks, servers, and data centres to optimise performance and minimise downtime.

In infrastructure engineering at PwC, you will focus on designing and implementing robust and scalable technology infrastructure solutions for clients. Your work will involve network architecture, server management, and cloud computing experience.

As an Azure Data Engineer, you will play a crucial role in designing, building, and maintaining our enterprise data platform on the Microsoft Azure cloud. Your primary responsibility will be developing scalable, reliable, and efficient data pipelines to ingest, transform, and serve data to business analysts, data scientists, and operational systems. This role demands a deep understanding of modern data architecture, a passion for automation, and hands-on expertise with the Azure data stack.

Meaningful work you’ll be a part of

As a Senior Associate, Azure Data Engineering, you’ll work as part of a team of problem solvers, helping to solve business issues, deliver high quality client service and operational efficiency. Responsibilities include but are not limited to:

  • Architect, design, and own the development of robust, end-to-end data pipelines for our production environment, utilizing Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Lead the design and implementation of advanced data models within our Azure Data Lake. Champion the Medallion Architecture (Bronze/Silver/Gold) and build complex business logic into scalable, efficient transformations using PySpark and Delta Lake.
  • Develop ETL/ELT processes to ingest data from a wide variety of sources, including relational databases (SQL, Oracle), APIs, and streaming data feeds.
  • Implement data models, transformations, and cleansing routines to prepare data for analytics.
  • Automate data workflows and implement CI/CD practices for data pipelines using Azure DevOps or GitHub Actions to ensure quality and rapid deployment.
  • Monitor, troubleshoot, and optimize data solutions for performance, scalability, and cost-effectiveness.
  • Proactively identify and resolve performance bottlenecks in data pipelines. This includes hands-on Spark job tuning, query optimization, data partitioning strategies, and implementing cost-control measures across our Azure data services.
  • Work closely with data analysts, data scientists, and business stakeholders to understand their data requirements and deliver high-quality data solutions.
  • Mentor junior data engineers through code reviews, paired programming, and technical guidance. Establish and document coding standards, best practices, and reusable frameworks to elevate the entire team's technical capabilities.
  • Partner directly with data scientists, analysts, and business leaders to translate complex business requirements into robust, scalable, and reliable technical solutions.
  • Ensure data quality, integrity, and governance by implementing best practices, data validation checks, and robust documentation.

Experiences and skills you’ll use to solve

  • Microsoft Azure Data Engineer Associate (DP-203) certification is required, or the ability to obtain it within the first 2 months.
  • 5-7 years of dedicated, hands-on experience in a data engineering role, with a proven track record of delivering complex projects to production.
  • Deep, hands-on expertise and production experience with core Azure data services: Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS Gen2).
  • Expert-level proficiency in SQL and Python. You must have extensive, production-level experience with PySpark for large-scale, distributed data processing.
  • Proven experience designing and implementing end-to-end data solutions on Azure, demonstrating a strong grasp of modern ELT patterns, data warehousing (star schema), and data lake architectures (e.g., Medallion).
  • Demonstrated ability to troubleshoot and solve complex, ambiguous data problems in a production environment, including performance tuning and root cause analysis.
  • Bachelor's degree in computer science, Engineering, Information Technology, or related field.
  • Significant hands-on experience with Azure Synapse Analytics (Dedicated and Serverless SQL Pools).
  • Experience building and managing CI/CD pipelines for data engineering projects using Azure DevOps.
  • Proficiency with Infrastructure as Code (Bicep preferred, Terraform is a plus).
  • Strong understanding of Azure security best practices (Managed Identities, Azure Key Vault, Private Endpoints).
  • PwC Canada is committed to cultivating an inclusive, hybrid work environment. Exact expectations for your team can be discussed with your interviewer.

PwC BC Region Pay Range Information

The salary range* for this position is $82,300.00 - 109,700.00 - 137,000.00$ CAD Annual, plus individuals may be eligible for an annual bonus payment. Actual compensation within the range will be dependent upon your skills, experience, qualifications and geographic location.

*Please note that the salary range for this position is reflected for our British Columbia region. Given our national recruiting approach, we recruit (and may hire) in other regions and therefore the salary range may differ depending on the work location. PwC is committed to competitive compensation and sharing salary ranges in accordance with applicable pay transparency legislation as they arise.

Why you’ll love PwC

We’re inspiring and empowering our people to change the world. Powered by the latest technology, you’ll be a part of diverse teams helping public and private clients build trust and deliver sustained outcomes. This meaningful work, and our continuous development environment, will take your career to the next level. We reward your impact, and support your wellbeing, through a competitive compensation package, inclusive benefits and flexibility programs that will help you thrive in work and life. Learn more about our Application Process and Total Rewards Package at: https://jobs-ca.pwc.com/ca/en/life-at-pwc

PwC Canada acknowledges that we work and live across Turtle Island, on the land that is now known as Canada, which are the lands of the ancestral, treaty and unceded territories of the First Nations, Métis and Inuit Peoples. We recognize the systemic racism, colonialism and oppression that Indigenous Peoples have experienced and still go through, and we commit to allyship and solidarity.

Education

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications

Required Skills

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Amazon Web Services (AWS), Analytical Thinking, Architectural Engineering, Business Continuity, Cloud Architectures, Cloud Compliance, Cloud Infrastructure, Cloud Migration, Cloud Virtualization, Communication, Continuous Deployment, Continuous Integration/Continuous Delivery (CI/CD), Creativity, Data Infrastructure, DevOps Practices, Disaster Recovery, Embracing Change, Emotional Regulation, Empathy, Google Cloud Platform, Hardware Troubleshooting, Hybrid Cloud {+ 32 more}

Desired Languages

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date

Set alerts for more jobs like Senior Associate, Azure Data Engineering
Set alerts for new jobs by PwC
Set alerts for new Data Analysis jobs in Canada
Set alerts for new jobs in Canada
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙