Mgr Data Engineer Lead - India

undefined ago • 8 Years + • Data Analysis

Job Summary

Job Description

We're seeking a Data Engineering Manager to lead a team responsible for building and maintaining robust data pipelines and infrastructure. This role is crucial for ensuring high-quality, reliable, and timely data to support our quantitative analysis, modeling, and research. The manager will oversee the design and development of scalable data pipelines, manage infrastructure, ensure data quality, and collaborate with analysts and scientists to define the data engineering roadmap.
Must have:
  • Guide and grow a high-performing data engineering team, fostering excellence, collaboration, and continuous learning.
  • Oversee the design, development, and maintenance of scalable data pipelines for ingesting, transforming, and loading large datasets.
  • Manage and optimize data infrastructure (data lakes, warehouses, streaming platforms) for quantitative workloads, ensuring performance and cost-efficiency.
  • Implement robust data quality, governance, and metadata management frameworks.
  • Partner closely with quantitative analysts and data scientists to translate their data requirements into technical solutions.
  • Define and execute the data engineering roadmap, evaluating and recommending new technologies to enhance data capabilities.
  • Monitor, troubleshoot, and optimize data processes, ensuring data security, privacy, and compliance.

Job Details

Role Purpose: We're seeking a Data Engineering Manager to lead a team responsible for building and maintaining robust data pipelines and infrastructure. This role is crucial for ensuring high-quality, reliable, and timely data to support our quantitative analysis, modeling, and research.

Responsibilities:

  • Lead & Mentor: Guide and grow a high-performing data engineering team, fostering excellence, collaboration, and continuous learning.
  • Architect & Build: Oversee the design, development, and maintenance of scalable data pipelines for ingesting, transforming, and loading large datasets.
  • Infrastructure Management: Manage and optimize data infrastructure (data lakes, warehouses, streaming platforms) for quantitative workloads, ensuring performance and cost-efficiency.
  • Data Quality & Governance: Implement robust data quality, governance, and metadata management frameworks.
  • Collaborate: Partner closely with quantitative analysts and data scientists to translate their data requirements into technical solutions.
  • Strategy & Innovation: Define and execute the data engineering roadmap, evaluating and recommending new technologies to enhance data capabilities.
  • Ensure Reliability: Monitor, troubleshoot, and optimize data processes, ensuring data security, privacy, and compliance.

Qualifications:

  • Experience: 8+ years in data engineering, with 3+ years in a leadership/management role.
  • Technical Expertise (Must-Have):
  • Strong proficiency in Python (preferred)/Java/ C++
  • Advance-level SQL skills.
  • Hands-on experience with Apache Spark (PySpark preferred) and other big data technologies (Hadoop, Flink, Kafka).
  • Solid experience with at least one major cloud platform's data services (AWS, Azure, or GCP).
  • In-depth knowledge of data warehousing/lakehouse platforms (e.g., Snowflake, Databricks, Redshift, BigQuery).
  • Experience with data orchestration tools like Apache Airflow, Prefect, or DBT.
  • Leadership & Soft Skills:
  • Exceptional leadership, team-building, and mentoring abilities.
  • Excellent communication skills, able to articulate complex technical concepts.
  • Strong analytical, problem-solving, and strategic thinking.

CME Group: Where Futures are Made

CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.

At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.

Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Bengaluru, Karnataka, India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

As the world’s leading derivatives marketplace, CME Group is where the world comes to manage risk. We enable clients to trade futures, options, cash and OTC markets, optimize portfolios, and analyze data – empowering market participants worldwide to efficiently manage risk and capture opportunities. CME Group exchanges offer the widest range of global benchmark products across all major asset classes based on interest rates, equity indexes foreign exchange energy agricultural products and metals. We meet uncertainty and volatility with confidence and clarity, across the trading lifecycle and around the world.

Bengaluru, Karnataka, India (On-Site)

Belfast, Northern Ireland, United Kingdom (Hybrid)

Belfast, Northern Ireland, United Kingdom (On-Site)

Chicago, Illinois, United States (On-Site)

Belfast, Northern Ireland, United Kingdom (On-Site)

Chicago, Illinois, United States (On-Site)

Chicago, Illinois, United States (Hybrid)

Belfast, Northern Ireland, United Kingdom (Hybrid)

Bengaluru, Karnataka, India (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by CME Group

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug