AIML - Senior Engineering Program Manager, ML Compute Infrastructure

2 Months ago • 5 Years + • $163,300 PA - $290,100 PA

Research Development

Job Description

Apple's AIML team is seeking a senior engineering program manager for its ML Training platform, responsible for providing efficient and scalable compute and processing for machine learning lifecycle. The role involves overseeing capacity expansions, compute buildouts, and accelerator hardware strategy, evaluating new accelerators, delivering optimal price/performance compute solutions, and ensuring capacity readiness for Apple-scale AI. The candidate will also identify new technologies for adoption and be the central PM voice for interactions with public cloud providers and internal Apple Cloud. Key responsibilities include establishing cross-functional partnerships, collaborating with engineering teams, leading technical evaluations of emerging accelerator technologies, and owning cross-functional execution of capacity integration efforts.

Good To Have:

Hands-on experience with accelerator benchmarking, evaluation frameworks, or infrastructure cost modeling
Experience managing data center expansion programs or deploying high-density compute for ML
Strong competence in price/performance parity analysis for hardware procurement
Advanced technical degree and/or deep infrastructure consulting background
Prior experience scaling ML infrastructure in hybrid or on-prem environments

Must Have:

5+ years in Product/Program Management, Systems Engineering, or Infrastructure Architecture
Ability to define vision and lead cross-functional execution in highly technical domains
MS/PhD in EE, CS, Systems Engineering, or equivalent work experience
Experience leading vendor engagements and partnerships
Strong understanding of large-scale compute architecture and capacity planning for ML workloads
Familiarity with AI/ML frameworks, infrastructure orchestration, and HPC environments

Perks:

Discretionary employee stock programs
Discretionary restricted stock unit awards
Discounted Apple stock purchase
Comprehensive medical and dental coverage
Retirement benefits
Discounted products and free services
Reimbursement for certain educational expenses

Add these skills to join the top 1% applicants for this job

cross-functional

html

networking

aws

pytorch

tensorflow

machine-learning

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something. The AIML team at Apple is building groundbreaking technology... and we are looking for people like you! The Machine Learning Platform & Technology (MLPT) team in the AIML organization is seeking a senior engineering program manager for its ML Training platform. This platform provides services to all internal Apple developers focused on providing efficient and scalable compute and processing for machine learning lifecycle from model experimentation to deployment for the features across the entire Apple consumer ecosystem. We’re looking for someone with a record of building large-scale infrastructure for cloud platforms and a strong knowledge of ML workflow. This includes overseeing capacity expansions, compute buildouts, and accelerator hardware strategy. You will be responsible for driving efforts that evaluate new accelerators, deliver optimal price/performance compute solutions, and ensure capacity readiness for Apple-scale AI. You will also have the opportunity to be the leader with vision, identifying new technologies for adoption and be the central PM voice for interactions with public cloud providers, such as AWS and GCP, as well as internal Apple Cloud.

- As a key EPM of the AI/ML team, you will be responsible for establishing cross-functional partnerships with ML partner understanding their use cases and improve the ease of use of the compute services.

- You will collaborate with the Apple’s AIML engineering teams to define a partnership strategy across the ML ecosystem including 3rd party public cloud, Apple’s internal cloud, silicon vendors, and OSS providers

- You will lead technical evaluations of emerging accelerator technologies (GPUs, TPUs, and custom silicon), balancing power, performance, cost, and compatibility to ensure infrastructure decisions are forward-looking and cost-efficient

- Own cross-functional execution of capacity integration efforts — aligning hardware procurement, rack deployment, networking, and software readiness to ensure seamless delivery at scale

- Translate ML platform and model training requirements into concrete infrastructure programs, ensuring technical risks are anticipated and mitigated early

5+ years of meaningful work experience in Product/Program Management, Systems Engineering, or Infrastructure Architecture
Demonstrated ability to define vision and lead cross-functional execution in highly technical domains
MS/PhD in EE, CS, Systems Engineering, or equivalent work experience
Experience leading vendor engagements and partnerships across cloud, silicon, and hardware infrastructure providers
Strong understanding of large-scale compute architecture and capacity planning for ML workloads
Familiarity with AI/ML frameworks (e.g., TensorFlow, PyTorch), infrastructure orchestration, and high-performance computing environments

Hands-on experience with accelerator benchmarking, evaluation frameworks, or infrastructure cost modeling
Experience managing data center expansion programs or deploying high-density compute for ML
Strong competence in price/performance parity analysis for hardware procurement decisions
Advanced technical degree and/or deep infrastructure consulting background
Prior experience scaling ML infrastructure in hybrid or on-prem environments

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $163,300 and $290,100, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.

Set alerts for more jobs like AIML - Senior Engineering Program Manager, ML Compute Infrastructure

Set alerts for new jobs by Apple

Set alerts for new Research Development jobs in United States

Set alerts for new jobs in United States

Set alerts for Research Development (Remote) jobs