AIML - Machine Learning Engineer, Model Evaluations

1 Day ago • All levels • $175,800 PA - $312,200 PA

Job Summary

Job Description

This role focuses on evaluating and mitigating safety risks in generative AI features within Apple Intelligence. The responsibilities include developing metrics for safety and fairness evaluations, designing datasets, collaborating with cross-functional teams, translating regional safety requirements into evaluation criteria, building expertise in machine translation and data synthesis, and developing ML-based enhancements to improve product quality. The role involves working with highly sensitive and potentially offensive content. The candidate will work at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication.
Must have:
  • Develop metrics for evaluation of safety and fairness risks.
  • Design datasets, identify data needs and creative solutions.
  • Collaborate with cross-functional partners.
  • Translate regional safety and inclusivity requirements.

Job Details

Apple Intelligence is driven by intentional data design—spanning careful sampling, creation, and curation of high-quality datasets, enriched with precise annotations. Our data powers our ability to evaluate and mitigate safety risks in new generative AI features. This role sits at the intersection of applied data science, empirical analysis, cultural and linguistic expertise, and stakeholder communication. It requires strong scientific judgment, cross-functional collaboration, and the ability to translate evaluation findings into actionable insights. - Develop metrics for evaluation of safety and fairness risks inherent to generative models and Gen-AI features - Design datasets, identify data needs, and work on creative solutions, scaling and expanding data coverage through human and synthetic generation methods - Collaborate with cross-functional partners—including engineering, product, and research teams—to ensure evaluations align with feature goals and deployment plans - Partner with policy teams to translate regional safety and inclusivity requirements into measurable evaluation criteria - Build expertise in machine translation and data synthesis techniques to generate localized and culturally aligned evaluation datasets at scale - Develop ML-based enhancements to red teaming, model evaluation, and other processes to improve the quality of Apple Intelligence’s user-facing products - Work with highly-sensitive content with exposure to offensive and controversial content

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Cupertino, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

We’re a diverse collective of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways. And the same innovation that goes into our products also applies to our practices — strengthening our commitment to leave the world better than we found it. This is where your work can make a difference in people’s lives. Including your own.


Apple is an equal opportunity employer that is committed to inclusion and diversity. Visit apple.com/careers to learn more.

Cupertino, California, United States (On-Site)

Cupertino, California, United States (On-Site)

Elk Grove, California, United States (On-Site)

Austin, Texas, United States (On-Site)

Cupertino, California, United States (On-Site)

Houston, Texas, United States (On-Site)

San Diego, California, United States (On-Site)

Atlanta, Georgia, United States (On-Site)

Cupertino, California, United States (On-Site)

Cupertino, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Apple

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug