Director, Engineering, ML Compiler

1 Month ago • 15 Years + • Artificial Intelligence • $294,000 PA - $414,000 PA

Job Summary

Job Description

Google seeks an experienced leader to build and direct its ML Compiler team. This role shapes Google's hardware strategy by orchestrating development of cutting-edge machine learning compilers. The Director will work at the intersection of research, product development, hardware engineering, and core machine learning teams. Responsibilities include defining the long-term strategic vision, establishing technical direction, recruiting and mentoring a team, forging partnerships with other teams, optimizing system performance, and advocating for innovation. The role requires deep expertise in compilers and machine learning to support Google's TPU and GPU strategies and ensure optimal compiler solutions.
Must have:
  • Master's degree in CS/related field or equivalent experience
  • 15 years compiler development experience (ML optimization)
  • 10 years leading technical teams
  • Experience with ML accelerators (TPUs or GPUs)
  • Define long-term strategic vision for ML compiler technology
Good to have:
  • Experience in computer architecture, high-performance computing
  • Building compilers for custom hardware architectures
  • In-depth knowledge of ML frameworks (Jax, PyTorch, TensorFlow)
  • Outstanding communication skills
  • Contributions to open-source compiler projects
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

Minimum qualifications:

  • Master's degree in Computer Science, Computer Engineering, a related field, or equivalent practical experience.
  • 15 years of industry experience in compiler development, including machine learning optimization.
  • 10 years of experience leading and growing technical teams.
  • Experience with ML accelerators like TPUs or GPUs.

Preferred qualifications:

  • Experience in computer architecture, high-performance computing.
  • Experience building compilers for custom hardware architectures.
  • In-depth knowledge of machine learning frameworks (e.g., Jax, PyTorch, TensorFlow).
  • Outstanding communication skills tailored to both technical and non-technical audiences.
  • Contributions to open-source compiler projects.

About the job

Google is a leading ML/AI company. Google’s Core ML team aims to build state-of-the-art AI platforms, services, and tools behind Google’s AI research and AI-powered products. We are owners of the Google AI framework (e.g., TensorFlow, JAX), AI performance and efficiency, AI training and inference platforms, AI compilers (e.g. XLA), AI software/hardware co-design (e.g. TPU), and AI developer experience (e.g., Model Hub, Eval Hub). We are the driver to launch Large Models (like Gemini) from research to production and enable all Google products to adopt LMs to improve end-user experiences. The CoreML team is responsible for planning and optimizing ML capacity for all Google products and driving performance and efficiency work to maximize ROI for our AI investments. We look across Google’s AI efforts to build central solutions, break down technical barriers, and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.

We are seeking an exceptional and experienced leader to build and direct our ML Compiler team. This pivotal role presents the unique opportunity to shape Google's hardware strategy by orchestrating the development of cutting-edge machine learning compilers. You'll work at the intersection of research, product development, hardware engineering, and core machine learning teams to seamlessly execute the ML Compiler roadmap.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $294,000-$414,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about .

Responsibilities

  • Define the long-term strategic vision for our ML compiler technology and roadmap. Establish technical direction, goals, and development priorities.
  • Recruit, mentor, and develop a highly skilled team of compiler engineers focused on machine learning optimization. Create a collaborative and high-achieving work environment.
  • Forge strong partnerships with research, product, hardware, and core ML teams. Drive alignment and effective collaboration to ensure optimal compiler solutions for Google's custom TPU and GPU strategies.
  • Apply your deep expertise in compilers and machine learning to optimize system performance, reduce software overheads, and seamlessly support new hardware. Advocate innovation and the application of new technologies.
  • Cultivate a deep understanding of customer needs, driving a relentless focus on enabling their success through compiler capabilities.

Similar Jobs

ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech Understanding) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ByteDance - Research Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Google - Staff Software Engineer, Machine Learning Infrastructure

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Google - Machine Learning Engineer, Design Verification, Silicon

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (PHD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Google - Conversational AI Consultant

Google

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Month ago
Google - Software Engineer, Unified Autoscaling Services

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Airlab Inc  - Junior Programmer Artificial Intelligence

Airlab Inc

Quebec, Canada (On-Site)
1 Month ago
Talentica Software - Data Scientist

Talentica Software

India (Remote)
7 Months ago
Google - Technical Program Manager, Cloud AI and Industry Solutions

Google

Sunnyvale, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Research Scientist in Foundation Model (Music) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Meta - Software Engineer, Machine Learning

Meta

Menlo Park, California, United States (On-Site)
6 Months ago
Seedify - AI Product Manager

Seedify

Japan (Remote)
4 Months ago
Meta - Software Engineer, Systems ML - Frameworks/Compilers/Kernels

Meta

Bellevue, Washington, United States (Remote)
1 Month ago
Arrise Solutions (India)   - Lead ML Engineer

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
8 Months ago
Ciklum - Senior Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
7 Months ago
EXUSIA - AWS and Python Full Stack Leads / Senior Developers

EXUSIA

Hyderabad, Telangana, India (Remote)
1 Month ago
ByteDance - Engineering Manager Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sunnyvale, California, United States

Meta - Production Engineering

Meta

Cambridge, Massachusetts, United States (Hybrid)
6 Months ago
DraftKings - Lead Analyst, Anti-Money Laundering

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
ByteDance - Backend Software Engineer - Security Engineering

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Microsoft - Technical Program Manager, Data Insights & Governance

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Nielsen Holdings - SAC Planning Developer

Nielsen Holdings

United States (Remote)
1 Month ago
ByteDance - Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
ByteDance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
31st Union - QA Manager

31st Union

San Mateo, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML GenAI

Google

New York, New York, United States (On-Site)
1 Month ago
Epic Games - Art Director (Rocket League)

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Software Engineer III, AI/ML, Google Ads

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Canva - Head of AI Research

Canva

Sydney, New South Wales, Australia (Remote)
4 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
3 Months ago
Meta - AI Research Scientist, Language - Generative AI

Meta

Bellevue, Washington, United States (On-Site)
6 Months ago
Microsoft - Member of Technical Staff, AI Reinforcement Systems

Microsoft

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Netflix - Machine Learning Scientist (L5) - Payments DSE

Netflix

United States (Remote)
2 Months ago
Kenvue - GenAI ML Engineer, Data Science

Kenvue

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
AI Fund - Founder-in-Residence

AI Fund

United States (Remote)
7 Months ago
Microsoft - Senior Applied Scientist - Advanced Autonomy and Applied Robotics

Microsoft

Redmond, Washington, United States (On-Site)
4 Weeks ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Vision Generative AI)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone.

London, England, United Kingdom (On-Site)

Fremont, California, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Reston, Virginia, United States (On-Site)

Sunnyvale, California, United States (On-Site)

New Taipei, New Taipei City, Taiwan (On-Site)

Dublin, County Dublin, Ireland (On-Site)

San Jose, California, United States (On-Site)

Mexico City, Mexico City, Mexico (On-Site)

View All Jobs

Get notified when new jobs are added by Google

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug