Lead Data Pipeline Engineer

2 Months ago • All levels • Data Analyst • ₹2,00,000 LPA - ₹45,00,000 LPA

About the job

Job Description

This role involves designing, developing, and supporting data pipelines utilizing GCP Big Query, PySpark, Python, and Composer/Airflow. You will be responsible for building and maintaining an Enterprise Data Warehouse and Data Mart, ensuring seamless data flow and analytics. This position requires expertise in GCP Cloud, Big Query, Data Dimension Modeling, and Advanced SQL. Proficiency in PySpark, Python, and Airflow is essential. Experience with Tableau and familiarity with source systems like SAP ERP, Salesforce, Workday, Callidus, Anaplan, and Gainsight Customer Success Platform are considered advantages.
Must have:
  • GCP Cloud background
  • GCP Big Query
  • PySpark
  • Python
  • Airflow
  • Data Dimension Modeling
  • Advanced SQL
  • Data pipeline design and development
Good to have:
  • Tableau
  • SAP ERP
  • Salesforce
  • Workday
  • Callidus
  • Anaplan
  • Gainsight Customer Success Platform

About the job

Skills:
Google Cloud Platform (GCP), Big Data, sql,

Primary Skills - GCP Cloud background, GCP Big Query, Data Dimension Modeling and Advanced SQL

Details of the application, domain, as appropriate: Enterprise Data Warehouse, Data Mart pipeline engineering

Key responsibilities: Design, Develop and Support data pipeline using GCP Big Query, PySpark, Python, Composer/Airflow

Required Skills - GCP Cloud background, GCP Big Query, PySpark, Python, Airflow

Good to have Skills - Tableau and Familiar with source systems like SAP ERP, Salesforce, Workday, Callidus, Anaplan, Gainsight Customer Success Platform


Desired Skills and Experience

Google Cloud Platform (GCP), Big Data, sql

View Full Job Description
₹200.0K - ₹4500.0K/yr (Outscal est.)
₹2350.0K/yr avg.
Bengaluru, Karnataka, India

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by WebMobril Staffing Solutions

Similar Jobs

Rackspace Technology - R-19462 Data Engineer III - VN

Rackspace Technology, Vietnam (Remote)

Sivaltech - Senior ASIC RTL DESIGN ER.

Sivaltech, India (On-Site)

Nielsen Holdings - STAFF SOFTWARE ENGINEER

Nielsen Holdings, India (Hybrid)

Rovio Entertainment Corporation - Senior Performance Marketing Manager

Rovio Entertainment Corporation, Sweden (Hybrid)

Dentsu - Data & Analytics Consultant

Dentsu, Netherlands (On-Site)

Next Level Business Services - SAP Master Data Standards Consultant

Next Level Business Services, United States (On-Site)

Zuru - Data Analyst Intern

Zuru, United States (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CloudHire - Senior Web Developer

CloudHire, India (Remote)

Avalanche Studios Group - Game Designer (Combat)

Avalanche Studios Group, Sweden (On-Site)

Microsoft - Principal Software Engineer

Microsoft, Canada (On-Site)

Wargaming - DevOps Engineer (AI Platform & Production)

Wargaming, United Kingdom (Hybrid)

OpenGov - Software Engineer I

OpenGov, India (On-Site)

SciPlay - Manager, Data Engineer

SciPlay, India (On-Site)

Microsoft - Research Intern - Optical Technologies

Microsoft, United States (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

UPL - Analyst-PTP

UPL, India (On-Site)

Nagarro - Associate Staff Engineer

Nagarro, India (On-Site)

PwC - RDC - SAP FICO - RTR Support

PwC, India (On-Site)

EEE India - C++

EEE India, India (On-Site)

Kroll - Senior UI Developer

Kroll, India (Hybrid)

Divya Staffing Solution - Data Scientist

Divya Staffing Solution, India (On-Site)

Anthology  Inc  - Manager, Software Engineering

Anthology Inc , India (Hybrid)

DNEG - Animation TD (DNEG Animation)

DNEG, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Ubisoft - Data Scientist [Game Intelligence]

Ubisoft, Sweden (Hybrid)

Next Level Business Services - Collibra Lead

Next Level Business Services, United States (On-Site)

Gainwell Technologies - Data Scientist

Gainwell Technologies, India (Hybrid)

Paytm - Business Analyst - Deputy Manager

Paytm, India (On-Site)

The Walt Disney Company - Analyst, Data Activation

The Walt Disney Company, United States (Remote)

Warner Bros Discovery - Customer Data Manager - Digital/ VOD

Warner Bros Discovery, Poland (Hybrid)

Tencent - Data Scientist

Tencent, Singapore (On-Site)

Get notifed when new similar jobs are uploaded