AIML - Machine Learning Engineer, Model Evaluations

3 Months ago • All levels • Research Development • $175,800 PA - $312,200 PA

Job Summary

Job Description

This role focuses on evaluating and mitigating safety risks in generative AI features within Apple Intelligence. The responsibilities include developing metrics for safety and fairness evaluations, designing datasets, collaborating with cross-functional teams, translating regional safety requirements into evaluation criteria, building expertise in machine translation and data synthesis, and developing ML-based enhancements to improve product quality. The role involves working with highly sensitive and potentially offensive content. The candidate will work at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication.
Must have:
  • Develop metrics for evaluation of safety and fairness risks.
  • Design datasets, identify data needs and creative solutions.
  • Collaborate with cross-functional partners.
  • Translate regional safety and inclusivity requirements.

Job Details

Apple Intelligence is driven by intentional data design—spanning careful sampling, creation, and curation of high-quality datasets, enriched with precise annotations. Our data powers our ability to evaluate and mitigate safety risks in new generative AI features. This role sits at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication. It requires strong scientific judgment, cross-functional collaboration, and the ability to translate evaluation findings into actionable insights. - Develop metrics for evaluation of safety and fairness risks inherent to generative models and Gen-AI features - Design datasets, identify data needs, and work on creative solutions, scaling and expanding data coverage through human and synthetic generation methods - Collaborate with cross-functional partners—including engineering, product, and research teams—to ensure evaluations align with feature goals and deployment plans - Partner with policy teams to translate regional safety and inclusivity requirements into measurable evaluation criteria - Build expertise in machine translation and data synthesis techniques to generate localized and culturally aligned evaluation datasets at scale - Develop ML-based enhancements to red teaming, model evaluation, and other processes to improve the quality of Apple Intelligence’s user-facing products - Work with highly-sensitive content with exposure to offensive and controversial content

Similar Jobs

binance - Senior Product Manager, Options Trading (Frontend)

binance

Taipei City, Taiwan (Remote)
1 Year ago
Figma - Software Engineer, Platform Engineering

Figma

San Francisco, California, United States (Remote)
4 Weeks ago
bytedance - Machine Learning Engineer Intern

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Glean - Head of Sales, Americas

Glean

United States (Remote)
1 Month ago
Saviynt - Senior Principal Security Architect

Saviynt

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
AiDash - Staff Machine Learning / Perception Engineer

AiDash

Palo Alto, California, United States (Hybrid)
3 Months ago
Apple - AI Engineer

Apple

Austin, Texas, United States (On-Site)
1 Month ago
EvenUp - Backend Software Engineer, AI Document Generation (All Levels)

EvenUp

San Francisco, California, United States (Hybrid)
6 Months ago
Sonar Source - Application Security Researcher

Sonar Source

Bochum, North Rhine-Westphalia, Germany (On-Site)
5 Months ago
Ansys - R&D Engineer

Ansys

Canonsburg, Pennsylvania, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

attentive - Manager, Solutions Marketing

attentive

United States (Remote)
1 Month ago
Blinkhealth - People and Culture Partner, Pharmacy Operations

Blinkhealth

Chesterfield, Missouri, United States (On-Site)
3 Months ago
Sonar Source - NetSuite Administrator

Sonar Source

Austin, Texas, United States (On-Site)
3 Months ago
Scout - Senior Manager, Connected Vehicle

Scout

United States (On-Site)
1 Month ago
Capgemini - Agile Coach

Capgemini

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Tavus - Machine Learning Engineer

Tavus

San Francisco, California, United States (Hybrid)
2 Months ago
BioFire - Reagent Technical Project Manager III

BioFire

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Interface AI - Staff Engineer (Backend + AI) : Nexus

Interface AI

San Francisco, California, United States (On-Site)
3 Weeks ago
Ansys - R&D Engineer II (MAPDL Material Modeling)

Ansys

Canonsburg, Pennsylvania, United States (On-Site)
1 Month ago
Nagarro - Staff Engineer (QA Automation Engineer)

Nagarro

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Cupertino, California, United States

Warm n fuzzy  - Page not found

Warm n fuzzy

Los Angeles, California, United States (On-Site)
1 Month ago
Interactive Brokers - Director of Corporate Tax Reporting

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
3 Months ago
Varonis  - Technical Support Engineer

Varonis

Morrisville, North Carolina, United States (On-Site)
6 Months ago
moonlight - iOS Engineer

moonlight

San Francisco, California, United States (Hybrid)
2 Months ago
Safe security - Regional Vice President, Sales (New England)

Safe security

Boston, Massachusetts, United States (Remote)
5 Months ago
CoinTracker - Tax Analyst, AI CPA

CoinTracker

United States (Remote)
1 Month ago
Buckman - Sr. Process Safety Engineer

Buckman

Memphis, Tennessee, United States (On-Site)
4 Weeks ago
Apple - Display Algorithm Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Alpha Sense - Payroll Specialist

Alpha Sense

United States (Remote)
2 Months ago
Enverus - Principal Consultant

Enverus

Austin, Texas, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

zoox - Senior/Staff Safety Research Engineer, Crash and Injury Modeling

zoox

Foster City, California, United States (Hybrid)
4 Months ago
Tekion Corp - Manager, Machine Learning

Tekion Corp

Bengaluru, Karnataka, India (On-Site)
3 Months ago
reality.co - Machine Learning Engineer - Monopoly World

reality.co

London, England, United Kingdom (On-Site)
2 Months ago
flip fit - Senior Machine Learning Engineer

flip fit

(Remote)
4 Months ago
ElevenLabs - AI Safety Operations

ElevenLabs

United Kingdom (Remote)
4 Months ago
Apple - AIML - Machine Learning Educator

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Dream Sports - Lead Machine Learning Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Year ago
Numrah - Software Engineer (AI)

Numrah

(On-Site)
4 Months ago
ZeniMax Media - Senior AI Programmer

ZeniMax Media

Rockville, Maryland, United States (On-Site)
1 Year ago
Apple - AIML Triage and Diagnostic Tooling Engineer, AIML Integration and Delivery

Apple

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Sunnyvale, California, United States (On-Site)

Cupertino, California, United States (On-Site)

San Diego, California, United States (On-Site)

Culver City, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Austin, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apple

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug