IN-Manager_Big Data Engineer_Data and Analytics_Advisory_Bengaluru

6 Months ago • 8-11 Years • Data Analyst

Job Summary

Job Description

This Big Data Engineer role in Bengaluru requires 8-11 years of experience in Big Data, Hadoop, Scala, and Spark. You'll design, implement, and maintain data pipelines, work with large datasets, and collaborate with cross-functional teams.
Must have:
  • Big Data
  • Hadoop (HDFS)
  • Scala
  • Spark
Good to have:
  • Azure Cloud
  • Data Streaming
  • Docker
  • Kubernetes
Perks:
  • Vibrant Community
  • Inclusive Benefits

Job Details

Line of Service

Advisory

Industry/Sector

FS X-Sector

Specialism

Data, Analytics & AI

Management Level

Manager

Job Description & Summary

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. "

Responsibilities:

Broad Role / Responsibilities We are seeking a highly skilled and motivated Data Engineer Developer with 8 to 11 years of experience to join our dynamic team. The ideal candidate must have strong hands-on expertise in technologies such as Spark, Scala, Hadoop, SQL, and demonstrated exposure to Azure cloud services. The Data Engineer Developer will play a crucial role in designing, implementing, and maintaining robust data pipelines, ensuring the efficient flow and processing of large datasets. · Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using Spark and Scala. Implement ETL processes for ingesting, transforming, and loading data from various sources. · Big Data Technologies: Work with Hadoop ecosystem components such as HDFS, Hive, and HBase for efficient storage and retrieval of large-scale datasets. Optimize and tune Spark jobs to ensure optimal performance and resource utilization. · SQL Expertise: Utilize strong SQL skills to query, analyse, and manipulate data stored in relational databases and data warehouses. · Security - Implement security and data protection measures, at all levels – DB, API services. Apply Data masking and row-level and column-level security. Keep abreast of latest security issues and incorporate necessary patches and updates. · Testing and Debugging - Write and maintain test code to validate functionality. Debug applications and troubleshoot issues as they arise. · Collaboration and Communication - Collaborate with cross-functional teams including Database engineers, data integration engineers, reporting teams and product development. Communicate complex data findings in a clear and actionable manner to non-technical stakeholders. · Continual Learning- Keep up to date with emerging tools, techniques, and technologies in data technologies. Engage in self-improvement and continuous learning opportunities to maintain expertise in the data science domain. · End to end understanding of project and infrastructure involving multiple technologies (Big Data Analytics) · Proactively identify problem areas & concerns related to data in the project; exploration of ways to tackle the issues and come-up with optimal solutions. · Creation of FRS/SRS/Design documents and other technical documents. · Prepare “lessons learned” documentation for projects / engagements. Develop best practices and tools for project execution and management. Nice to Have: · Exposure to Azure Cloud. · Experience of working in Travel and logistics domain is preferred. · Familiarity with data streaming technologies (e.g., Apache Kafka). · Exposure to containerization and orchestration tools (e.g., Docker, Kubernetes). · Knowledge of machine learning concepts and frameworks. Broad Experience & Expertise Requirements 8 to 11 years of hands-on experience in handling large data volumes, Data Engineering using Big Data, Hadoop (HDFS, Hive, Hbase), Scala, Spark (Spark Core, Spark SQL, Spark Streaming), Python, PySpark, SQL, ETL, Databricks, Data modelling, Azure Cloud, Data Pipelines, CI/CD, Docker, Containers, GIT, etc.. Knowledge & experience in handling structured, semi-structured and unstructured data sets. Specific Past Work Experience Requirements · 8 Years of relevant experience in the above technologies. · 8-11 years of Consulting experience in Technology Domain, handling data projects.

Mandatory skill sets:

Big Data, Hadoop (HDFS, Hive, Hbase), Scala, Spark

Preferred skill sets:

Big Data, Hadoop (HDFS, Hive, Hbase), Scala, Spark

Years of experience required:

8-11 years

Education qualification: BE/BTECH, ME/MTECH, MBA, MCA

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required:

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Spark SQL

Optional Skills

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date

Similar Jobs

Reality Games - Machine Learning Engineer - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
Fanatee - Game Influencer

Fanatee

United States (Remote)
2 Months ago
Dream Sports - Senior Manager - Business Analytics

Dream Sports

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Egnyte - Senior Build Engineer - Python - Jenkins

Egnyte

India (Remote)
3 Months ago
Inworld AI - Staff C++ Developer

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
4 Weeks ago
Ubisoft - Regional Project Intelligence Director (Nordics & Romania)

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
1 Week ago
Google - Wearable Telemetry Tech Lead

Google

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
10 Months ago
Nagarro - Staff Engineer

Nagarro

Sri Lanka (Remote)
6 Months ago
Ubisoft - Regional Project Intelligence Director (Nordics & Romania)

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

FISHLABS GmbH - Voxel Artist

FISHLABS GmbH

Hamburg, Hamburg, Germany (Hybrid)
3 Months ago
DraftKings - Senior Software Engineer – Streaming & Real-Time Systems

DraftKings

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
ION - Internship - Data Science

ION

Pisa, Tuscany, Italy (On-Site)
6 Months ago
Zazz - Data Engineer

Zazz

(Remote)
3 Months ago
DWS Group - Data Scientist

DWS Group

Mumbai, Maharashtra, India (Hybrid)
5 Months ago
Riot Games - Senior Line Producer - Esports Content Services

Riot Games

Dublin, County Dublin, Ireland (On-Site)
1 Week ago
OKX - Data Engineer

OKX

Singapore, Singapore (On-Site)
6 Months ago
HiLabs - Data Engineer

HiLabs

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Everyday Health Group - Principal Software Engineer - Android

Everyday Health Group

Massachusetts, United States (Remote)
3 Months ago
Dream Sports - Senior ML Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Skillz - Manager - GM's Office

Skillz

Bengaluru, Karnataka, India (On-Site)
3 Months ago
bosh group india - PreSales/ Solution Architect- Enterprise

bosh group india

Karnataka, India (On-Site)
4 Months ago
Paytm - Team Lead - Sales - Goa

Paytm

Goa, India (On-Site)
6 Months ago
Starkflow - Quant Analyst

Starkflow

Maharashtra, India (On-Site)
1 Week ago
Hitachi - Microsoft Dynamics 365 CE Developer (Offshore Delivery - Sustained Engineering)

Hitachi

Bengaluru, Karnataka, India (Remote)
6 Months ago
PwC - IN-Manager|Oracle fusion Finance| Oracle|Advisory|Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
Mindtickle - Learning Consultant

Mindtickle

Pune, Maharashtra, India (Hybrid)
6 Months ago
Warner Bros Games - Staff Software Engineer - Java Fullstack - MSC Deals Team

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Ajmera Infotech - Sr. Backend Engineer - Node Expert

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Playkot - Data Engineer

Playkot

Belgrade, Serbia (Remote)
3 Months ago
Google - Senior Data Scientist, Product, Search Strategic Analysis

Google

New York, New York, United States (On-Site)
6 Days ago
Nexters - Marketing Analyst

Nexters

Almaty, Almaty Region, Kazakhstan (Remote)
1 Week ago
Google - Analytical Program Lead, Devices and Services

Google

Chicago, Illinois, United States (On-Site)
1 Week ago
N-iX - Middle/Senior Data Engineer (Azure)

N-iX

Ukraine (Remote)
1 Week ago
Balbix - Senior/Staff Data Engineer

Balbix

Gurugram, Haryana, India (On-Site)
6 Months ago
PwC - Senior Associate_Azure Data Engineer-- Data and Analytics_Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
Google - Engineering Analyst Manager, Trust and Safety, Search Intelligence

Google

Mountain View, California, United States (On-Site)
1 Week ago
NVIDIA - Technical Marketing Manager - Data Analytics Specialist

NVIDIA

Santa Clara, California, United States (On-Site)
3 Weeks ago
RoofStack - Data Product Manager

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

At PwC, our purpose is to build trust in society and solve important problems. We’re a network of firms in 152 countries with over 327,000 people who are committed to delivering quality in assurance, advisory and tax services. Find out more and tell us what matters to you by visiting us at www.pwc.com. PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity.


Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.

Nicosia, Nicosia, Cyprus (On-Site)

Gurugram, Haryana, India (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

Jakarta, Jakarta, Indonesia (Hybrid)

Mumbai, Maharashtra, India (On-Site)

Warsaw, Masovian Voivodeship, Poland (Hybrid)

Kolkata, West Bengal, India (On-Site)

Kolkata, West Bengal, India (On-Site)

View All Jobs

Get notified when new jobs are added by PWC

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug