IN_Senior Associate _Azure DE + Databricks Developer _Data &Analytics _Advisory _PAN India

7 Months ago • 5-10 Years • Data Analyst

Job Summary

Job Description

This role requires a Senior Associate with 5-10 years of experience in Azure Data Engineering and Databricks development. Must-have skills include PySpark, Azure Data Lake Services, Databricks, and Unity Catalog. The role focuses on Data Lake and Lakehouse implementation, data processing, management, integration, and storage.
Must have:
  • PySpark & Python
  • Azure Data Lake
  • Databricks Platform
  • Unity Catalog
Good to have:
  • Delta Live Tables
  • Azure Fabric
  • SAP & Dynamics
  • Databricks Engineer
Perks:
  • Vibrant Community
  • Inclusive Benefits

Job Details

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.

*Why PWC
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.
At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "



Responsibilities:

1. Data Lake and Lakehouse Implementation:
o Design, implement, and manage Data Lake and Lakehouse architectures. (Must have)
o Develop and maintain scalable data pipelines and workflows. (Must have)
o Utilize Azure Data Lake Services (ADLS) for data storage and management. (Must have)
o Knowledge on Medalion Architecture, Delta Format. (Must have)
2. Data Processing and Transformation:
o Use PySpark for data processing and transformations. (Must have)
o Implement Delta Live Tables for real-time data processing and analytics. (Good to have)
o Ensure data quality and consistency across all stages of the data lifecycle. (Must have)
3. Data Management and Governance:
o Employ Unity Catalog for data governance and metadata management. (Good to have)
o Ensure robust data security and compliance with industry standards. (Must have)
4. Data Integration:
o Extract, transform, and load (ETL) data from multiple sources (Must have) including SAP (Good to have), Dynamics 365 (Good to have), and other systems.
o Utilize Azure Data Factory (ADF) and Synapse Analytics for data integration and orchestration. (Must have)
o Performance Optimization of the Jobs. (Must have)
5. Data Storage and Access:
o Implement and manage Azure Data Lake Storage (ADLS) for large-scale data storage. (Must have)
o Optimize data storage and retrieval processes for performance and cost-efficiency. (Must have)
6. Collaboration and Communication:
o Work closely with data scientists, analysts, and other stakeholders to understand data requirements. (Must have)
o Provide technical guidance and mentorship to junior team members. (Good to have)
7. Continuous Improvement:

o Stay updated with the latest industry trends and technologies in data engineering and cloud computing. (Good to have)
o Continuously improve data processes and infrastructure for efficiency and scalability. (Must have)


Required Skills and Qualifications:
· Technical Skills:
o Proficient in PySpark and Python for data processing and analysis.
o Strong experience with Azure Data Lake Services (ADLS) and Data Lake architecture.
o Hands-on experience with Databricks for data engineering and analytics.
o Knowledge of Unity Catalog for data governance.
o Expertise in Delta Live Tables for real-time data processing.
o Familiarity with Azure Fabric for data integration and orchestration.
o Proficient in Azure Data Factory (ADF) and Synapse Analytics for ETL and data warehousing.
o Experience in pulling data from multiple sources like SAP, Dynamics 365, and others.


· Soft Skills:
o Excellent problem-solving and analytical skills.
o Strong communication and collaboration abilities.
o Ability to work independently and as part of a team.
o Attention to detail and commitment to data accuracy and quality.
Certifications required:
· Certification in Azure Data Engineering or relevant Azure certifications.
o DP203 (Must have)
· Certification in Databricks.
o Databricks certified Data Engineer Associate (Must have)
o Databricks certified Data Engineer Professional (Good Have)

Mandatory skill sets: Azure DE, Pyspark, Databricks


Preferred skill sets: Azure DE, Pyspark, Databricks


Years of experience required: 5-10 Years


Educational Qualification: BE, B.Tech, MCA, M.Tech

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Master of Engineering, Bachelor of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Databricks Platform, Microsoft Azure

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

Similar Jobs

Google - Staff Data Scientist, Applied Research, Search Platforms

Google

Cambridge, Massachusetts, United States (On-Site)
2 Weeks ago
Ubisoft - Machine Learning Programmer (Character & Animation)

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago
Wargaming - Tech/Render QA Engineer

Wargaming

Belgrade, Serbia (Hybrid)
1 Week ago
Rockstar Games - Senior Cinematic Artist

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
1 Week ago
Reality Games - Mid-Level Manual QA Tester

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Google - Data Scientist, Business and Marketing, Ads Marketing Analytics

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Days ago
Playtika - Data Architect

Playtika

Israel (On-Site)
2 Weeks ago
Google - Senior Data Scientist, gTech Ads GCS Partner Engineering

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
ByteDance - Data Engineer, Cloud and System

ByteDance

Seattle, Washington, United States (On-Site)
2 Weeks ago
Aristocrat Gaming - Data Analyst

Aristocrat Gaming

Barcelona, Catalonia, Spain (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ubisoft - Junior Programmer

Ubisoft

Chengdu, Sichuan, China (On-Site)
3 Weeks ago
Oculus VR - Senior Level Designer - Sanzaru Game Studio

Oculus VR

San Mateo, California, United States (Remote)
1 Month ago
Kolibri Games - Senior Unity Developer (Tech-Art)

Kolibri Games

Berlin, Berlin, Germany (Hybrid)
2 Months ago
lifechruh - API & Services Architect

lifechruh

Edmond, Oklahoma, United States (On-Site)
2 Months ago
Reality Games - Technical Artist for Mobile Game

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
4 Months ago
Limit Break - Unity UI Engineer

Limit Break

(Remote)
3 Weeks ago
Epic Games - Senior Engine Programmer, Framework

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Meta - Software Engineering Manager, Product

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago
Meta - Software Engineer (Technical Leadership)

Meta

Redmond, Washington, United States (On-Site)
5 Months ago
Sports Interactive - Senior Software Engineer (Graphics)

Sports Interactive

England, United Kingdom (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Kolkata, West Bengal, India

DNEG - Animation TD

DNEG

Karnataka, India (On-Site)
1 Month ago
Qualcomm - Technical Animator, Staff

Qualcomm

Hyderabad, Telangana, India (On-Site)
5 Months ago
DNEG - FX TD (DNEG Animation)

DNEG

Mumbai, Maharashtra, India (On-Site)
8 Months ago
Gametion Technologies   - Senior 2D Artist

Gametion Technologies

Navi Mumbai, Maharashtra, India (On-Site)
6 Months ago
NVIDIA - Senior System Software Engineer - PCIe

NVIDIA

Hyderabad, Telangana, India (On-Site)
1 Week ago
PlaySimple - Associate Game Designer

PlaySimple

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Xentrix Studios - Visual FX – Artist

Xentrix Studios

India (On-Site)
5 Months ago
Assystems - Draughts Person / Designer - Solar (Mechanical)

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Brillio - Azure Kubernetes Architect - R01530963

Brillio

Bengaluru, Karnataka, India (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Tencent - WeChat Tech Intern (Data Scientist - Safety Strategies)

Tencent

Singapore (On-Site)
7 Months ago
PlayStation Global - Manager, Analytics Engineering

PlayStation Global

London, England, United Kingdom (On-Site)
5 Months ago
WebFX - Technical Digital Marketer (MARTECH Implementation)

WebFX

Philippines (Remote)
4 Months ago
Tonies - Working Student Product Data Management

Tonies

Düsseldorf, North Rhine-Westphalia, Germany (Remote)
1 Month ago
Google - Data Engineer, Global YouTube Marketing

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Tesla - Senior Trading Analyst, Autobidder

Tesla

North Holland, Netherlands (On-Site)
2 Months ago
ByteDance - Data Analyst - AI Innovation Business

ByteDance

Singapore (On-Site)
6 Months ago
SciPlay - VIP Analyst

SciPlay

Austin, Texas, United States (Hybrid)
1 Month ago
Deutsche Bank - BM Analyst

Deutsche Bank

Mumbai, Maharashtra, India (On-Site)
7 Months ago
The Walt Disney Company - Senior Manager, Data Analytics, DTC ANZ

The Walt Disney Company

Richmond, Victoria, Australia (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

Nicosia, Nicosia, Cyprus (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Mumbai, Maharashtra, India (On-Site)

Warsaw, Masovian Voivodeship, Poland (Hybrid)

Kolkata, West Bengal, India (On-Site)

Kolkata, West Bengal, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by PWC

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug