Lead Data Pipeline Engineer

1 Day ago • All levels

About the job

SummaryBy Outscal

About the job:
This is a Lead Data Pipeline Engineer role focused on designing, developing, and supporting data pipelines utilizing GCP Big Query, PySpark, Python, and Composer/Airflow. The role involves working within an Enterprise Data Warehouse and Data Mart environment to create and maintain efficient data pipelines for business intelligence and analytics. The ideal candidate will have strong experience with Google Cloud Platform, BigQuery, data dimension modeling, and advanced SQL skills. Experience with Tableau and familiarity with various source systems such as SAP ERP, Salesforce, Workday, Callidus, Anaplan, and Gainsight Customer Success Platform is considered advantageous.
Must have:
  • GCP Cloud background
  • GCP Big Query
  • PySpark
  • Python
  • Airflow
  • Data Dimension Modeling
  • Advanced SQL
Good to have:
  • Tableau
  • SAP ERP
  • Salesforce
  • Workday
  • Callidus
  • Anaplan
  • Gainsight Customer Success Platform

About the job

Skills:
Google Cloud Platform (GCP), Big Data, sql,

Primary Skills - GCP Cloud background, GCP Big Query, Data Dimension Modeling and Advanced SQL

Details of the application, domain, as appropriate: Enterprise Data Warehouse, Data Mart pipeline engineering

Key responsibilities: Design, Develop and Support data pipeline using GCP Big Query, PySpark, Python, Composer/Airflow

Required Skills - GCP Cloud background, GCP Big Query, PySpark, Python, Airflow

Good to have Skills - Tableau and Familiar with source systems like SAP ERP, Salesforce, Workday, Callidus, Anaplan, Gainsight Customer Success Platform


Desired Skills and Experience

Google Cloud Platform (GCP), Big Data, sql

View Full Job Description
₹200.0K - ₹4500.0K/yr (Outscal est.)
₹2350.0K/yr avg.
Bengaluru, Karnataka, India

Similar Jobs

Magnopus - Pipeline Engineer

California, United States (Hybrid)

bp - Sr. Pipeline Engineer - TSI

Maharashtra, India (On-Site)

bp - Senior Riser and Pipeline Engineer - TSI

Maharashtra, India (On-Site)

Oil and Gas Job Search Ltd - Senior Riser and Pipeline Engineer - TSI

Maharashtra, India (Hybrid)

Oil and Gas Job Search Ltd - Sr. Pipeline Engineer - TSI

Maharashtra, India (Hybrid)

Oil and Gas Job Search Ltd - Pipeline Engineer - TSI

Maharashtra, India (Hybrid)

skydance - Senior Pipeline Engineer

Community Of Madrid, Spain (Hybrid)

Similar Skill Jobs

Tencent - IT Engineer II

Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

King - Engineering Manager, Data Enablement

Stockholm County, Sweden (On-Site)

Activision - Associate Data Analyst, Live Ops

California, United States (On-Site)

Aristocrat Gaming - Unity Developer

Quebec, Canada (Hybrid)

DraftKings - Trader, Player Props

Plovdiv Province, Bulgaria (On-Site)

DraftKings - Analyst I, Customer Experience

Massachusetts, United States (On-Site)

DraftKings - Senior Analyst, VIP Acquisition

Massachusetts, United States (On-Site)

DraftKings - Senior Analyst, Customer Experience

Massachusetts, United States (On-Site)

umusic - Technical Product Manager

Pennsylvania, United States (On-Site)

Jobs in Bengaluru, Karnataka, India

Aristocrat Gaming - Sr Technical Lead (Java)

Uttar Pradesh, India (Hybrid)

Scopely - Intern - Software Engineer (Unity)

Karnataka, India (Hybrid)

DNEG - Environment Modeller (DNEG Animation)

Tamil Nadu, India (On-Site)

DNEG - Environment Modeller (DNEG Animation)

Karnataka, India (On-Site)

DNEG - Environment Modeller (DNEG Animation)

Maharashtra, India (On-Site)

Gallagher - Video & Motion Designer

Maharashtra, India (On-Site)

Qualcomm - Technical Animator, Staff

Telangana, India (On-Site)

TechnipFMC - Engineer I - Well Control

Telangana, India (On-Site)

Software Engineering Jobs

Tencent - IT Engineer II

Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

King - Engineering Manager, Data Enablement

Stockholm County, Sweden (On-Site)

Activision - Tools Designer

Masovian Voivodeship, Poland (On-Site)

Aristocrat Gaming - Sr Technical Lead (Java)

Uttar Pradesh, India (Hybrid)

Aristocrat Gaming - Service Support Representative

Nevada, United States (On-Site)

Aristocrat Gaming - IT Financial Management Coordinator

Nevada, United States (Hybrid)

DraftKings - Trader, Player Props

Plovdiv Province, Bulgaria (On-Site)

Scientific Games  - Packaging Utility Level 2 (Union)

Quebec, Canada (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug