IN-Senior Associate_Data Engineer_One Cloud _Advisory_ Kolkata

3 Months ago • 4-7 Years • Data Analyst

Job Summary

Job Description

This Senior Associate Data Engineer role at PwC involves designing, developing, and deploying scalable data pipelines using Python and PySpark. Responsibilities include optimizing data processing workflows with libraries like pandas and numpy, building and deploying Big Data applications using SparkSQL and Spark Streaming, and working with data lakes and data marts on the cloud. Experience with SQL, Redshift, EMR, S3, CloudWatch, Lambda, Glue, and RDS is essential. The role requires hands-on experience writing complex SQL queries and managing large data imports/exports. PwC offers a vibrant, purpose-led work environment focused on innovation and client impact.
Must have:
  • 5+ years experience in Python, Spark, SQL
  • Redshift, EMR, S3, CloudWatch, Lambda, Glue, RDS experience
  • Design, develop & deploy scalable data pipelines
  • Optimize data processing workflows using Python libraries
  • Build & deploy Big Data applications using SparkSQL, Spark Streaming
Good to have:
  • Hadoop, Hive, and other big data technologies knowledge

Job Details

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Operations

Management Level

Senior Associate

Job Description & Summary

A career in our New Technologies practice, within Application and Emerging Technology services, will provide you with a unique opportunity to help our clients identify and prioritise emerging technologies that can help solve their business problems. We help clients design approaches to integrate new technologies, skills, and processes so they can drive business results and innovation.

Our team helps organisations to embrace emerging technologies to remain competitive and improve their business by solving complex questions. Our team focuses on identifying and prioritising emerging technologies, breaking into new markets, and preparing clients to get the most out of their emerging technology investments.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Responsibilities:


Design, develop and deploy scalable data pipelines using python. 
Optimize data processing workflows using python libraries (pandas, numpy, etc.)
Build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python;
Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities. 
Experience in data lake and data mart design on cloud
Design, develop and deploy scalable PySpark applications for data processing and analytics.


Mandatory skill sets:

5+ years experience in Python,  Spark, Sql, Redshift, Emr, s3 , cloud watch, Lambda, glue, RDS


Preferred skill sets:

Good to have knowledge on Hadoop, Hive and big data technologies


Years of experience required:

4 to 7 years


Education qualification:

Bachelor degree/MBA

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Master of Business Administration, Bachelor of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Python (Programming Language), Structured Query Language (SQL)

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

Similar Jobs

Paytm - DevOps- Principal Engineer

Paytm

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PwC - Senior Associate_Hadoop Developer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Zuora - Sr Software Developer Engineer in Test

Zuora

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
Sinch - Manager, Data Engineering

Sinch

Malmö, Skåne County, Sweden (On-Site)
3 Months ago
King - Senior Staff Software Engineer (Data)  - Activision Blizzard Media

King

San Francisco, California, United States (On-Site)
6 Months ago
Paytm - Growth Management - Assistant Manager - First Games

Paytm

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Zazz - Data Engineer

Zazz

(Remote)
1 Month ago
Netflix - Data Engineering Manager

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Weeks ago
ByteDance - Product Manager, LLM Data Acquisition and Production

ByteDance

Singapore (On-Site)
3 Months ago
Fairmatic - Senior Data Scientist

Fairmatic

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

HiLabs - Lead or Senior Data Scientist

HiLabs

Pune, Maharashtra, India (On-Site)
4 Months ago
PwC - IN-Manager_ Advanced Analytics & ML _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
3 Months ago
Everyday Health Group - Revenue Manager - Financial Planning & Analysis

Everyday Health Group

New York, New York, United States (Remote)
2 Weeks ago
Paypal - Staff Software Engineer

Paypal

San Jose, California, United States (Hybrid)
3 Months ago
Egnyte - PLSQL/Celigo Integration Developer

Egnyte

India (Remote)
3 Months ago
LogicMonitor - Staff Penetration Testing Engineer

LogicMonitor

Pune, Maharashtra, India (Hybrid)
3 Months ago
The Walt Disney Company - Manager, Data Science - Commerce

The Walt Disney Company

New York, New York, United States (On-Site)
1 Week ago
Netflix - Senior Partner Engagement Manager

Netflix

Mexico City, Mexico City, Mexico (On-Site)
1 Week ago
Nielsen Holdings - SENIOR SOFTWARE DEVELOPER

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
The Walt Disney Company - Senior Data Engineer, Content Data Solutions

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Kolkata, West Bengal, India

Kidvento Education and Research - Technical Project Manager

Kidvento Education and Research

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Glean - Finance System Manager

Glean

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Stonewall Collision & Auto Painting - Lead Data Scientist

Stonewall Collision & Auto Painting

Hyderabad, Telangana, India (On-Site)
4 Months ago
bosh group india - Process Expert | SAP FICO

bosh group india

Karnataka, India (On-Site)
2 Months ago
Poppulo - Software Development Engineer II

Poppulo

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
PwC - IN-Manager – D365 Scm -Ms Dynamics– Advisory  - Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Scientific Games  - Senior Technical Support Engineer

Scientific Games

Bengaluru, Karnataka, India (On-Site)
1376 Years ago
BrightEdge - Staff Engineer

BrightEdge

Hyderabad, Telangana, India (Remote)
3 Months ago
Zuora - Sr Software Engineer

Zuora

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Morning Star - Director, Total Rewards

Morning Star

Mumbai, Maharashtra, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - IN_Senior Associate_Data Privacy _ITRA_ Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Easygo - Senior Data Engineer

Easygo

Melbourne, Victoria, Australia (On-Site)
1 Week ago
Microsoft - Technical Program Manager 2

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
Glean - Data Science Lead, Product

Glean

Palo Alto, California, United States (On-Site)
2 Months ago
prizepicks - Staff Data Analyst - Acquisition Marketing

prizepicks

Atlanta, Georgia, United States (Remote)
1 Month ago
PwC - IN-Senior Associate_Power BI_Data & Analytics_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Sphere Entertainment Co - Analyst Data Governance

Sphere Entertainment Co

Las Vegas, Nevada, United States (On-Site)
2 Months ago
CloudHire - Data Labeler

CloudHire

Pune, Maharashtra, India (Remote)
3 Months ago
Ubisoft - Data Analyst Assistant Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
1 Week ago
The Walt Disney Company - Analyst, Growth and Retention Analytics

The Walt Disney Company

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

Gqeberha, Eastern Cape, South Africa (On-Site)

Athens, Greece (Remote)

Qormi, Malta (On-Site)

Kolkata, West Bengal, India (On-Site)

Copenhagen, Denmark (On-Site)

Bucharest, Bucharest, Romania (On-Site)

Kolkata, West Bengal, India (On-Site)

Kolkata, West Bengal, India (On-Site)

View All Jobs

Get notified when new jobs are added by PWC

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug