Role Purpose: We're seeking a Data Engineering Manager to lead a team responsible for building and maintaining robust data pipelines and infrastructure. This role is crucial for ensuring high-quality, reliable, and timely data to support our quantitative analysis, modeling, and research.
Responsibilities:
- Lead & Mentor: Guide and grow a high-performing data engineering team, fostering excellence, collaboration, and continuous learning.
- Architect & Build: Oversee the design, development, and maintenance of scalable data pipelines for ingesting, transforming, and loading large datasets.
- Infrastructure Management: Manage and optimize data infrastructure (data lakes, warehouses, streaming platforms) for quantitative workloads, ensuring performance and cost-efficiency.
- Data Quality & Governance: Implement robust data quality, governance, and metadata management frameworks.
- Collaborate: Partner closely with quantitative analysts and data scientists to translate their data requirements into technical solutions.
- Strategy & Innovation: Define and execute the data engineering roadmap, evaluating and recommending new technologies to enhance data capabilities.
- Ensure Reliability: Monitor, troubleshoot, and optimize data processes, ensuring data security, privacy, and compliance.
Qualifications:
- Experience: 8+ years in data engineering, with 3+ years in a leadership/management role.
- Technical Expertise (Must-Have):
- Strong proficiency in Python (preferred)/Java/ C++
- Advance-level SQL skills.
- Hands-on experience with Apache Spark (PySpark preferred) and other big data technologies (Hadoop, Flink, Kafka).
- Solid experience with at least one major cloud platform's data services (AWS, Azure, or GCP).
- In-depth knowledge of data warehousing/lakehouse platforms (e.g., Snowflake, Databricks, Redshift, BigQuery).
- Experience with data orchestration tools like Apache Airflow, Prefect, or DBT.
- Leadership & Soft Skills:
- Exceptional leadership, team-building, and mentoring abilities.
- Excellent communication skills, able to articulate complex technical concepts.
- Strong analytical, problem-solving, and strategic thinking.
CME Group: Where Futures are Made
CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.
At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.
Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here