Lead Data Pipeline Engineer

1 Day ago • All levels

About the job

Summary_{By Outscal}

About the job:

This is a Lead Data Pipeline Engineer role focused on designing, developing, and supporting data pipelines utilizing GCP Big Query, PySpark, Python, and Composer/Airflow. The role involves working within an Enterprise Data Warehouse and Data Mart environment to create and maintain efficient data pipelines for business intelligence and analytics. The ideal candidate will have strong experience with Google Cloud Platform, BigQuery, data dimension modeling, and advanced SQL skills. Experience with Tableau and familiarity with various source systems such as SAP ERP, Salesforce, Workday, Callidus, Anaplan, and Gainsight Customer Success Platform is considered advantageous.

Must have:

GCP Cloud background
GCP Big Query
PySpark
Python
Airflow
Data Dimension Modeling
Advanced SQL

Good to have:

Tableau
SAP ERP
Salesforce
Workday
Callidus
Anaplan
Gainsight Customer Success Platform

About the job

Skills:
Google Cloud Platform (GCP), Big Data, sql,

Primary Skills - GCP Cloud background, GCP Big Query, Data Dimension Modeling and Advanced SQL

Details of the application, domain, as appropriate: Enterprise Data Warehouse, Data Mart pipeline engineering

Key responsibilities: Design, Develop and Support data pipeline using GCP Big Query, PySpark, Python, Composer/Airflow

Required Skills - GCP Cloud background, GCP Big Query, PySpark, Python, Airflow

Good to have Skills - Tableau and Familiar with source systems like SAP ERP, Salesforce, Workday, Callidus, Anaplan, Gainsight Customer Success Platform