Data Engineer – Senior Associate - P&T Labs

2 Months ago • 6-9 Years • Data Analyst

About the job

Job Description

Data Engineer role at PwC, requires 6-9 years experience with Azure Data Lake, Spark & Databricks. Must have expertise in big data technologies, batch & streaming data processing, SQL, and object-oriented programming. Experience with Azure DevOps & Agile methodologies is essential.
Must have:
  • Azure Data Lake
  • Spark & Databricks
  • Big data technologies
  • Data processing
Good to have:
  • Azure DevOps
  • Agile methodologies
  • Testing strategy
  • Problem solving
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Line of Service

Internal Firm Services

Industry/Sector

Not Applicable

Specialism

IFS - Internal Firm Services - Other

Management Level

Senior Associate

Job Description & Summary

A career in Products and Technology is an opportunity to bring PwC's strategy to life by driving products and technology into everything we deliver. Our clients expect us to bring the right people and the right technology to solve their biggest problems; Products and Technology is here to help PwC meet that challenge and accelerate the growth of our business. We have skilled technologists, data scientists, product managers and business strategists who are using technology to accelerate change.

Our team collaborates with product strategy and product managers to govern readiness standards in achieving principles (compliance, privacy, security) by design for what PwC’s technology assets require to be successful in the market. They provide guidance for product development across the lifecycle (ideation / strategy through commercialization / monetization). Additionally, they facilitate market readiness for technology assets overall, as changes occur to assets or market conditions throughout the asset’s life cycle.

Data Engineer (Azure Data Lake, Spark & Databricks)

Required Knowledge and Skills:

6-9 years of experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.

High Proficiency in at least two of Scala, Python, Spark applied to large scale data sets

Expertise with big data technologies (Spark, Data Lake, Delta Lake, Hive)

Knowledge of batch and streaming data processing techniques

Understanding of the Data Lifecycle Management process to collect, access, use, store, transfer, delete data.

Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.

Hands-on object-oriented programming experience using Scala, Python, R, or Java

Proficient with Azure DevOps, managing backlogs and creating/maintaining pipelines

Experience working in an Agile environment and applying it in Azure DevOps

At Effectual, Data engineers are responsible for designing, building, and maintaining datasets that can be leveraged in data projects.

Obsession for service observability, instrumentation, monitoring, and alerting

Knowledge or experience in architectural best practices in building data lakes

Responsibilities

You will be responsible for designing and building optimized data pipelines using emerging technologies, in a cloud environment, for the purpose of driving analytic insights.

Create the conceptual, logical and physical data models.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like API, Blob Storage, and no SQL Database

Design, develop, test, deploy, maintain, and improve data integration pipeline for data streaming.

Develop pipeline objects using Apache Spark / Pyspark / Python

Design and develop data pipeline architectures using Databricks, Spark and cloud Services.

Load and performance test data pipelines built using the above-mentioned technologies.

Good to have

Passionate about testing strategy, problem solving, learning new skills, sharing expertise and knowledge.

Always Be Learning

Product / Engineering Mindset

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

View All Jobs

Get notified when new jobs are added by PWC

Similar Jobs

Positive Grid Taiwan - Senior Android Developer

Positive Grid Taiwan, Taiwan (On-Site)

Next Level Business Services - Web SDLC

Next Level Business Services, United States (On-Site)

Playground Games - Build Engineer (All Levels) - Contract

Playground Games, United Kingdom (Hybrid)

Publicis Groupe - Data Analyst – Web and Social (Telcommunication)

Publicis Groupe, Malaysia (On-Site)

Luxoft - Business Analyst - Market Risk

Luxoft, India (On-Site)

ByteDance - Data Engineer - Global Payment - Singapore

ByteDance, Singapore (On-Site)

ClickPost - Senior Data Scientist

ClickPost, India (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Magna International - Senior Cloud Engineer

Magna International, India (On-Site)

GoTo Group - Senior Software Engineer (Android)

GoTo Group, India (On-Site)

Bazaar Voice - Staff Software Engineer - Backend

Bazaar Voice, India (Hybrid)

OKX - Java developer (Blockchain Asset)

OKX, Singapore (On-Site)

Rockstar Games - Software Engineer, C#/Java (All Levels)

Rockstar Games, United Kingdom (On-Site)

ARHS - IT Java Architect

ARHS, Luxembourg (On-Site)

Google - Research Intern, PhD, Summer 2025

Google, Canada (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

RnD Techies  Inc  - Creative Head

RnD Techies Inc , India (On-Site)

Schbang - Sr. Media Planner

Schbang, India (On-Site)

Gamezop - Content Writer - Astrozop

Gamezop, India (Remote)

Morphogenesis - Interior Design- Bangalore

Morphogenesis, India (On-Site)

Krafton  - Associate - Corporate Development

Krafton , India (On-Site)

Graveiens EduServices - 2D Animators

Graveiens EduServices, India (Remote)

ICIMS - Sr. Software Engineer

ICIMS, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Xsolla - Researcher/Analyst

Xsolla, Azerbaijan (Remote)

Jam City - Product Manager

Jam City, Argentina (On-Site)

The Walt Disney Company - Senior Software Engineer - Data Capture Team

The Walt Disney Company, United States (On-Site)

Next Level Business Services - BI Tech Project Manager - Full Time

Next Level Business Services, United States (On-Site)

ION - UK Holdings - India - 860

ION, India (On-Site)

CloudHire - GCP Data Engineer

CloudHire, India (On-Site)

Make - Senior Data Analyst

Make, Czechia (Hybrid)

Get notifed when new similar jobs are uploaded