AIML - Senior Engineering Program Manager, ML Compute Infrastructure
Job Summary
Job Description
Apple's AIML team is seeking a senior engineering program manager for its ML Training platform, responsible for providing efficient and scalable compute and processing for machine learning lifecycle. The role involves overseeing capacity expansions, compute buildouts, and accelerator hardware strategy, evaluating new accelerators, delivering optimal price/performance compute solutions, and ensuring capacity readiness for Apple-scale AI. The candidate will also identify new technologies for adoption and be the central PM voice for interactions with public cloud providers and internal Apple Cloud. Key responsibilities include establishing cross-functional partnerships, collaborating with engineering teams, leading technical evaluations of emerging accelerator technologies, and owning cross-functional execution of capacity integration efforts.
Must have:
- 5+ years in Product/Program Management, Systems Engineering, or Infrastructure Architecture
- Ability to define vision and lead cross-functional execution in highly technical domains
- MS/PhD in EE, CS, Systems Engineering, or equivalent work experience
- Experience leading vendor engagements and partnerships
- Strong understanding of large-scale compute architecture and capacity planning for ML workloads
- Familiarity with AI/ML frameworks, infrastructure orchestration, and HPC environments
Good to have:
- Hands-on experience with accelerator benchmarking, evaluation frameworks, or infrastructure cost modeling
- Experience managing data center expansion programs or deploying high-density compute for ML
- Strong competence in price/performance parity analysis for hardware procurement
- Advanced technical degree and/or deep infrastructure consulting background
- Prior experience scaling ML infrastructure in hybrid or on-prem environments
Perks:
- Discretionary employee stock programs
- Discretionary restricted stock unit awards
- Discounted Apple stock purchase
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses
7 skills required
Job Details
Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something.
The AIML team at Apple is building groundbreaking technology... and we are looking for people like you! The Machine Learning Platform & Technology (MLPT) team in the AIML organization is seeking a senior engineering program manager for its ML Training platform. This platform provides services to all internal Apple developers focused on providing efficient and scalable compute and processing for machine learning lifecycle from model experimentation to deployment for the features across the entire Apple consumer ecosystem. We’re looking for someone with a record of building large-scale infrastructure for cloud platforms and a strong knowledge of ML workflow. This includes overseeing capacity expansions, compute buildouts, and accelerator hardware strategy. You will be responsible for driving efforts that evaluate new accelerators, deliver optimal price/performance compute solutions, and ensure capacity readiness for Apple-scale AI. You will also have the opportunity to be the leader with vision, identifying new technologies for adoption and be the central PM voice for interactions with public cloud providers, such as AWS and GCP, as well as internal Apple Cloud.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
- As a key EPM of the AI/ML team, you will be responsible for establishing cross-functional partnerships with ML partner understanding their use cases and improve the ease of use of the compute services.
- You will collaborate with the Apple’s AIML engineering teams to define a partnership strategy across the ML ecosystem including 3rd party public cloud, Apple’s internal cloud, silicon vendors, and OSS providers
- You will lead technical evaluations of emerging accelerator technologies (GPUs, TPUs, and custom silicon), balancing power, performance, cost, and compatibility to ensure infrastructure decisions are forward-looking and cost-efficient
- Own cross-functional execution of capacity integration efforts — aligning hardware procurement, rack deployment, networking, and software readiness to ensure seamless delivery at scale
- Translate ML platform and model training requirements into concrete infrastructure programs, ensuring technical risks are anticipated and mitigated early
- 5+ years of meaningful work experience in Product/Program Management, Systems Engineering, or Infrastructure Architecture
- Demonstrated ability to define vision and lead cross-functional execution in highly technical domains
- MS/PhD in EE, CS, Systems Engineering, or equivalent work experience
- Experience leading vendor engagements and partnerships across cloud, silicon, and hardware infrastructure providers
- Strong understanding of large-scale compute architecture and capacity planning for ML workloads
- Familiarity with AI/ML frameworks (e.g., TensorFlow, PyTorch), infrastructure orchestration, and high-performance computing environments
- Hands-on experience with accelerator benchmarking, evaluation frameworks, or infrastructure cost modeling
- Experience managing data center expansion programs or deploying high-density compute for ML
- Strong competence in price/performance parity analysis for hardware procurement decisions
- Advanced technical degree and/or deep infrastructure consulting background
- Prior experience scaling ML infrastructure in hybrid or on-prem environments
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.
Similar Jobs
Bally's Interactive
London, England, United Kingdom (On-Site)
• 1 Month ago
Roblox
San Mateo, California, United States (On-Site)
• 2 Months ago
Monzo
Cardiff, Wales, United Kingdom (Remote)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Roblox
San Mateo, California, United States (On-Site)
• 1 Month ago
CME Group
Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
Nightfall AI
San Francisco, California, United States (On-Site)
• 2 Months ago
Apple
Cupertino, California, United States (On-Site)
• 1 Month ago
nissan
(On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Seattle, Washington, United States
Penn Interactive
Philadelphia, Pennsylvania, United States (On-Site)
• 4 Weeks ago
Get notifed when new similar jobs are uploaded
Research Development Jobs
bytedance
San Jose, California, United States (On-Site)
• 9 Months ago
bytedance
San Jose, California, United States (On-Site)
• 9 Months ago
Grammarly
San Francisco, California, United States (Hybrid)
• 1 Month ago
bytedance
San Jose, California, United States (On-Site)
• 4 Months ago
PwC
Noida, Uttar Pradesh, India (On-Site)
• 3 Weeks ago
bytedance
Seattle, Washington, United States (On-Site)
• 4 Months ago
Get notifed when new similar jobs are uploaded
