AIML - Machine Learning Engineer, Model Evaluations

1 Month ago • All levels • Research Development • $175,800 PA - $312,200 PA

Job Summary

Job Description

This role focuses on evaluating and mitigating safety risks in generative AI features within Apple Intelligence. The responsibilities include developing metrics for safety and fairness evaluations, designing datasets, collaborating with cross-functional teams, translating regional safety requirements into evaluation criteria, building expertise in machine translation and data synthesis, and developing ML-based enhancements to improve product quality. The role involves working with highly sensitive and potentially offensive content. The candidate will work at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication.
Must have:
  • Develop metrics for evaluation of safety and fairness risks.
  • Design datasets, identify data needs and creative solutions.
  • Collaborate with cross-functional partners.
  • Translate regional safety and inclusivity requirements.

Job Details

Apple Intelligence is driven by intentional data design—spanning careful sampling, creation, and curation of high-quality datasets, enriched with precise annotations. Our data powers our ability to evaluate and mitigate safety risks in new generative AI features. This role sits at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication. It requires strong scientific judgment, cross-functional collaboration, and the ability to translate evaluation findings into actionable insights. - Develop metrics for evaluation of safety and fairness risks inherent to generative models and Gen-AI features - Design datasets, identify data needs, and work on creative solutions, scaling and expanding data coverage through human and synthetic generation methods - Collaborate with cross-functional partners—including engineering, product, and research teams—to ensure evaluations align with feature goals and deployment plans - Partner with policy teams to translate regional safety and inclusivity requirements into measurable evaluation criteria - Build expertise in machine translation and data synthesis techniques to generate localized and culturally aligned evaluation datasets at scale - Develop ML-based enhancements to red teaming, model evaluation, and other processes to improve the quality of Apple Intelligence’s user-facing products - Work with highly-sensitive content with exposure to offensive and controversial content

Similar Jobs

Airbyte - Solutions Architect

Airbyte

New York, United States (On-Site)
1 Month ago
Google - Program Manager I, Maintenance Planning, Data Center Operations

Google

New Albany, Ohio, United States (On-Site)
2 Months ago
Bebopbee - Game Producer

Bebopbee

Palo Alto, California, United States (Remote)
1 Month ago
Nagarro - Principal Engineer, Delivery

Nagarro

Mexico (Remote)
8 Months ago
Illumina - Sr. Funnel Ops Analyst

Illumina

San Diego, California, United States (On-Site)
6 Days ago
Thales - Applied AI Research Scientist

Thales

Montreal, Quebec, Canada (Hybrid)
1 Month ago
sony global (Games) - Artificial intelligence researcher

sony global (Games)

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
sony global (Games) - Robotics Researcher

sony global (Games)

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

Netherlands (Remote)
8 Months ago
bytedance - Research Scientist for Generative AI, Multimodal and LLM

bytedance

San Jose, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Glean - Product Management Lead, Verticals

Glean

Palo Alto, California, United States (On-Site)
1 Month ago
Jelly Smack - Join Our Talent Pipeline: Future Account Manager Roles

Jelly Smack

Los Angeles, California, United States (Hybrid)
8 Months ago
Dentsu - Senior Manager, Media Activation

Dentsu

New York, United States (Remote)
2 Weeks ago
GoTo Group - Senior Data Warehouse Engineer

GoTo Group

Jakarta, Indonesia (On-Site)
4 Months ago
Capgemini - Agile Coach

Capgemini

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Crunchyroll - Theatrical Film Marketing Manager - EMEA

Crunchyroll

London, England, United Kingdom (Hybrid)
4 Months ago
AppLovin - Product Designer

AppLovin

Beijing, China (On-Site)
1 Month ago
Enphase Energy - Sr. Global EH&S Manager

Enphase Energy

Austin, Texas, United States (On-Site)
4 Months ago
bytedance - ByteDance Back-end Engineer Graduate Program (Dubai 2025)

bytedance

Dubai, Dubai, United Arab Emirates (On-Site)
2 Months ago
Shipt - Engineering Manager

Shipt

Minneapolis, Minnesota, United States (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Cupertino, California, United States

Hawkeye Innovations - Director of Technical Sales and Business Development

Hawkeye Innovations

Atlanta, Georgia, United States (Remote)
2 Months ago
fluence - Senior Manager, Sales Engineering (East Region)

fluence

Arlington, Virginia, United States (Hybrid)
3 Days ago
Coherent corp. - Manufacturing Operator - Team C

Coherent corp.

Starkville, Mississippi, United States (On-Site)
1 Month ago
Granicus - Audio/Video Installation Technician

Granicus

Dallas, Texas, United States (On-Site)
1 Month ago
Amazon games  - Anti-Cheat Engineer

Amazon games

Seattle, Washington, United States (On-Site)
2 Months ago
imerza - Head of Finance

imerza

Sarasota, Florida, United States (On-Site)
1 Month ago
Nintendo - Buyer - Nintendo Stores

Nintendo

Redmond, Washington, United States (Hybrid)
8 Months ago
bytedance - Software Engineer Graduate (Multi Cloud CDN) - 2025 Start (BS/MS)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
lifechruh - APIs Staff Engineer

lifechruh

Edmond, Oklahoma, United States (On-Site)
8 Months ago
gitlab - Senior Corporate Events Manager

gitlab

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Valeo - R&D Warranty Engineer

Valeo

Czechowice, Łódź Voivodeship, Poland (On-Site)
1 Month ago
PwC - Expert AI Developer

PwC

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
8 Months ago
Devoteam - Ride the AI wave as an experienced ServiceNow consultant

Devoteam

Copenhagen, Denmark (Hybrid)
2 Months ago
Apple - AIML - Backend Engineer, Evaluation

Apple

Santa Clara, California, United States (On-Site)
2 Weeks ago
AI Fund - ML Engineer

AI Fund

San Francisco, California, United States (On-Site)
1 Month ago
Microsoft - Software Engineer - AI/ML

Microsoft

Redmond, Washington, United States (On-Site)
2 Months ago
Google - Senior Staff Software Engineer, AI/ML GenAI, Google Ads

Google

Mountain View, California, United States (On-Site)
2 Months ago
Capgemini - Kore.Ai Developer/Consultant/Lead/Architect

Capgemini

India (On-Site)
2 Weeks ago
Haleon - CSPX Principal Scientist

Haleon

Weybridge, England, United Kingdom (Hybrid)
3 Weeks ago
bytedance - Research Scientist, Foundation Model, Speech Understanding

bytedance

San Jose, California, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Cupertino, California, United States (On-Site)

Sunnyvale, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Cupertino, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Culver City, California, United States (On-Site)

Culver City, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apple

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug