IN-Senior Associate _Azure DE & Databricks Developer_Data & Analytics _Advisory _PAN India

6 Months ago • 5-10 Years • Data Analyst

Job Summary

Job Description

This role requires expertise in Azure Data Lake Services, Databricks, PySpark, and Delta Live Tables for designing and implementing data lake/lakehouse architectures, data pipelines, and data governance.
Must have:
  • Azure Data Lake
  • Databricks Developer
  • PySpark & Python
  • Data Lakehouse
Good to have:
  • Delta Live Tables
  • Unity Catalog
  • Azure Data Factory
  • Azure Fabric

Job Details

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Responsibilities:
    Key Responsibilities:
1. Data Lake and Lakehouse Implementation:
o Design, implement, and manage Data Lake and Lakehouse architectures. (Must have)
o Develop and maintain scalable data pipelines and workflows. (Must have)
o Utilize Azure Data Lake Services (ADLS) for data storage and management. (Must have)
o Knowledge on Medalion Architecture, Delta Format. (Must have)
2. Data Processing and Transformation:
o Use PySpark for data processing and transformations. (Must have)
o Implement Delta Live Tables for real-time data processing and analytics. (Good to have)
o Ensure data quality and consistency across all stages of the data lifecycle. (Must have)
3. Data Management and Governance:
o Employ Unity Catalog for data governance and metadata management. (Good to have)
o Ensure robust data security and compliance with industry standards. (Must have)
4. Data Integration:
o Extract, transform, and load (ETL) data from multiple sources (Must have) including SAP (Good to have), Dynamics 365 (Good to have), and other systems.
o Utilize Azure Data Factory (ADF) and Synapse Analytics for data integration and orchestration. (Must have)
o Performance Optimization of the Jobs. (Must have)
5. Data Storage and Access:
o Implement and manage Azure Data Lake Storage (ADLS) for large-scale data storage. (Must have)
o Optimize data storage and retrieval processes for performance and cost-efficiency. (Must have)
6. Collaboration and Communication:
o Work closely with data scientists, analysts, and other stakeholders to understand data requirements. (Must have)
o Provide technical guidance and mentorship to junior team members. (Good to have)
7. Continuous Improvement:
o Stay updated with the latest industry trends and technologies in data engineering and cloud computing. (Good to have)
o Continuously improve data processes and infrastructure for efficiency and scalability. (Must have)
Required Skills and Qualifications:
· Technical Skills:
o Proficient in PySpark and Python for data processing and analysis.
o Strong experience with Azure Data Lake Services (ADLS) and Data Lake architecture.
o Hands-on experience with Databricks for data engineering and analytics.
o Knowledge of Unity Catalog for data governance.
o Expertise in Delta Live Tables for real-time data processing.
o Familiarity with Azure Fabric for data integration and orchestration.
o Proficient in Azure Data Factory (ADF) and Synapse Analytics for ETL and data warehousing.
o Experience in pulling data from multiple sources like SAP, Dynamics 365, and others.
· Soft Skills:
o Excellent problem-solving and analytical skills.
o Strong communication and collaboration abilities.
o Ability to work independently and as part of a team.
o Attention to detail and commitment to data accuracy and quality.
Certifications required:
· Certification in Azure Data Engineering or relevant Azure certifications.
o DP203 (Must have)
· Certification in Databricks.
o Databricks certified Data Engineer Associate (Must have)
o Databricks certified Data Engineer Professional (Good Have)


Mandatory skill sets:    Azure DE, Pyspark, Databricks


Preferred skill sets:    Azure DE, Pyspark, Databricks


Years of experience required:    5-10 Years


Educational Qualification    BE, B.Tech, MCA, M.Tech

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Bachelor of Engineering, Master of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Microsoft Azure

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

Similar Jobs

Discord - Senior Developer Advocate, Web Games

Discord

San Francisco, California, United States (Remote)
6 Months ago
Ubisoft - Technical Artist (MOSAIC)

Ubisoft

Singapore (On-Site)
1 Week ago
Lila Games - Senior Environment Concept Artist

Lila Games

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Meta - Data Engineer, Product Analytics

Meta

San Francisco, California, United States (On-Site)
5 Months ago
Meta - ASIC Engineer, Design Verification

Meta

Austin, Texas, United States (Remote)
5 Months ago
Luxoft - Data Engineer (financial/investment domain)

Luxoft

Singapore, Singapore (On-Site)
5 Months ago
FRVR - Data Analyst

FRVR

Lisbon, Lisbon, Portugal (On-Site)
3 Months ago
Voodoo - Senior Data Engineer (Ad networks - Core)

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
WebFX - Technical Digital Marketer (MARTECH Implementation)

WebFX

Philippines (Remote)
4 Months ago
Meta - Marketing Science Partner (Financial Services)

Meta

Los Angeles, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

SEGA - Cinematic Artist

SEGA

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
Life church - Senior Data Product Manager

Life church

Edmond, Oklahoma, United States (On-Site)
6 Months ago
Life church - Product Marketing Strategist

Life church

Edmond, Oklahoma, United States (On-Site)
6 Months ago
Amanotes - Game Product Lead

Amanotes

Ho Chi Minh City, Vietnam (On-Site)
1 Day ago
SymphonyAI - Data Scientist

SymphonyAI

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Trackman - Product Owner - Tracking (Baseball/Softball)

Trackman

Hørsholm, Denmark (On-Site)
1 Month ago
Ubisoft - Senior Rigger

Ubisoft

Montreal, Quebec, Canada (Hybrid)
3 Weeks ago
CD PROJEKT RED - Senior Gameplay Designer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Aesir Interactive - UE Engine Programmer (Regular/Senior)(f/m/d)

Aesir Interactive

Munich, Bavaria, Germany (On-Site)
6 Months ago
Meta - Network Production Engineer, Network Infrastructure

Meta

Menlo Park, California, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Kolkata, West Bengal, India

Xentrix Studios - Rigging – Artist

Xentrix Studios

India (On-Site)
5 Months ago
Hashlist - Senior Software Engineer (Localization & Mapping)

Hashlist

Pune, Maharashtra, India (Hybrid)
5 Months ago
Hitachi - D365 SCM Functional Consultant

Hitachi

Pune, Maharashtra, India (Remote)
6 Months ago
Tide - Head of Procurement - Technology, SaaS & Services

Tide

Hyderabad, Telangana, India (Hybrid)
1 Day ago
Dream Sports - Lead ML Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Week ago
QS Quacquarelli Symonds - Client Partnership Manager

QS Quacquarelli Symonds

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Omnissa - Senior Member of Technical Staff (Android)

Omnissa

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Google - Data Scientist, Research, App Safety Engineering

Google

Bengaluru, Karnataka, India (On-Site)
2 Days ago
Pattern® - Senior UX Designer

Pattern®

Pune, Maharashtra, India (Hybrid)
7 Months ago
GoTo Group - Lead Software Engineer - Engineering Platform

GoTo Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

FitXR - Senior Data Engineer

FitXR

Spain (Remote)
3 Weeks ago
Nagarro - Associate Distinguished Engineer - Enterprise Data Architect

Nagarro

Allentown, Pennsylvania, United States (Remote)
6 Months ago
Voodoo - Senior Data Analyst - Blitz

Voodoo

Paris, Île-de-France, France (On-Site)
3 Weeks ago
Gameplay Galaxy - Data Engineer

Gameplay Galaxy

(Remote)
2 Days ago
Google - Data and Analytics Consultant, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago
Nightfall AI - Endpoint Engineer

Nightfall AI

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Microsoft - Principal Software Engineer - Kusto

Microsoft

(On-Site)
2 Weeks ago
Definitive Healthcare - Senior Data Scientist

Definitive Healthcare

Bengaluru, Karnataka, India (On-Site)
5 Months ago
CharacterAI - Staff Data Engineer, Analytics

CharacterAI

New York, New York, United States (On-Site)
1 Week ago
ION - Data Operations

ION

Noida, Uttar Pradesh, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

Nicosia, Nicosia, Cyprus (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Mumbai, Maharashtra, India (On-Site)

Warsaw, Masovian Voivodeship, Poland (Hybrid)

Kolkata, West Bengal, India (On-Site)

Kolkata, West Bengal, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by PWC

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug