IN-Senior Associate_Data Engineer_One Cloud _Advisory_ Kolkata

1 Month ago • 4-7 Years • Data Analyst

About the job

Summary

This Senior Associate Data Engineer role at PwC involves designing, developing, and deploying scalable data pipelines using Python and PySpark. Responsibilities include optimizing data processing workflows with libraries like pandas and numpy, building and deploying Big Data applications using SparkSQL and Spark Streaming, and working with data lakes and data marts on the cloud. Experience with SQL, Redshift, EMR, S3, CloudWatch, Lambda, Glue, and RDS is essential. The role requires hands-on experience writing complex SQL queries and managing large data imports/exports. PwC offers a vibrant, purpose-led work environment focused on innovation and client impact.
Must have:
  • 5+ years experience in Python, Spark, SQL
  • Redshift, EMR, S3, CloudWatch, Lambda, Glue, RDS experience
  • Design, develop & deploy scalable data pipelines
  • Optimize data processing workflows using Python libraries
  • Build & deploy Big Data applications using SparkSQL, Spark Streaming
Good to have:
  • Hadoop, Hive, and other big data technologies knowledge
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Operations

Management Level

Senior Associate

Job Description & Summary

A career in our New Technologies practice, within Application and Emerging Technology services, will provide you with a unique opportunity to help our clients identify and prioritise emerging technologies that can help solve their business problems. We help clients design approaches to integrate new technologies, skills, and processes so they can drive business results and innovation.

Our team helps organisations to embrace emerging technologies to remain competitive and improve their business by solving complex questions. Our team focuses on identifying and prioritising emerging technologies, breaking into new markets, and preparing clients to get the most out of their emerging technology investments.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Responsibilities:


Design, develop and deploy scalable data pipelines using python. 
Optimize data processing workflows using python libraries (pandas, numpy, etc.)
Build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python;
Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities. 
Experience in data lake and data mart design on cloud
Design, develop and deploy scalable PySpark applications for data processing and analytics.


Mandatory skill sets:

5+ years experience in Python,  Spark, Sql, Redshift, Emr, s3 , cloud watch, Lambda, glue, RDS


Preferred skill sets:

Good to have knowledge on Hadoop, Hive and big data technologies


Years of experience required:

4 to 7 years


Education qualification:

Bachelor degree/MBA

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Master of Business Administration, Bachelor of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Python (Programming Language), Structured Query Language (SQL)

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

View Full Job Description

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug