Principal Researcher: AI Trust & Safety

1 Month ago • 4-6 Years • Artificial Intelligence • $137,600 PA - $294,000 PA

Job Summary

Job Description

Microsoft's AI Red Team seeks a Principal Researcher: AI Trust & Safety to proactively identify vulnerabilities in large AI systems like Bing Copilot, Github Copilot, etc. Responsibilities include discovering and exploiting GenAI vulnerabilities, developing novel red teaming methodologies, collaborating with research and tooling teams, researching emerging threats, and working with offensive security engineers and adversarial ML experts. The role demands experience in trust and safety, responsible AI, and ideally, national security or experience with AI-generated harmful content. This is a sprint-based role requiring communication of findings to various stakeholders and influencing mitigation strategies. The ideal candidate will help improve the operational effectiveness of the AI Red Team.
Must have:
  • Discover and exploit GenAI vulnerabilities
  • Develop novel red teaming methodologies
  • Collaborate with research and tooling teams
  • Experience in Trust and Safety or Responsible AI
  • Excellent communication and collaboration skills
Good to have:
  • Experience in national security
  • Multilingual proficiency
  • Experience in red teaming events (GRT, LLM CTFs)
  • Basic/intermediate Python programming
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

Do you want to find responsible AI failures in Microsoft’s largest AI systems impacting millions of users? Join Microsoft’s AI Red Team where you'll emulate work alongside security experts to cause trust and safety failures in Microsoft’s big AI systems. We are looking for a Principal Researcher: AI Trust & Safety focused with tactical experience in trust, safety, or responsible AI for our team to help make AI security better and help our customers expand with our AI systems. Our team is an interdisciplinary group of red teamers, adversarial Machine Learning (ML) researchers, Safety & Responsible AI experts and software developers with the mission of proactively finding failures in Microsoft’s big bet AI systems. In this role, you will be an individual contributor, red teaming AI models and applications across Microsoft’s AI portfolio including Bing Copilot, Security Copilot, Github Copilot, Office Copilot and Windows Copilot. This work is sprint based, working with AI Safety and Product Development teams, to run operations that aim to find safety and security risks that inform internal key business decisions. As a Principal Researcher: AI Trust & Safety, you will have the latitude to define emerging threat areas for the company, responsible for operations delivery, communicating impact of findings to diverse internal stakeholders, and pushing cross-team efforts to improve operational effectiveness. This Principal Researcher: AI Trust & Safety role is also expected to bring insight into the AI Safety space and collaborate closely with our tooling and research teams to orchestrate innovation with the operations testing team. We are open to remote work. More about our approach to AI Red Teaming:

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

 

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Qualifications

Required/Minimum Qualifications

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.


Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Experience in Trust and Safety area or policy area, especially working with human-generated or AI-generated harmful materials across multiple media types and creating objective recommendations, grounded and supported by research and data.
  • Experience in national security, specifically CBRN
  • Preferred multilingual proficiency, especially in languages used in Microsoft userbase in Europe, EMEA and APAC region
  • Prior experience in red teaming events such as GRT at Defcon AI Village or other LLM CTFs
  • While extensive coding experience is not necessary, candidate should be comfortable with basic/intermediate Python programming
  • 1+ years' experience in a field related to Responsible AI including but not limited to ethics, chemistry, biology, linguistics, sociology, psychology, medicine, socio-technical safety space, online safety, privacy

Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Microsoft will accept applications for the role until January 10, 2025.

 

 

#MSFTSecurity #airedteam #MSECAIR #AEGIS

 

Responsibilities

  • Discover and exploit GenAI vulnerabilities with respect to end-to-end capabilities in order to assess the safety of systems and lead communication of impact of vulnerabilities to partner stakeholders
  • Develop novel methodologies and techniques to scale and accelerate AI Red Teaming in collaboration with our research team, our tooling team, and leaders in the Microsoft AI Safety & Security ecosystem
  • Collaborate with teams to influence measurement and mitigations of these vulnerabilities in AI systems
  • Research new and emerging threats to inform the organization and craft solutions to operationalize testing within the AI Red Team function
  • Work alongside traditional offensive security engineers, adversarial ML experts, developers to land responsible AI operations -Model and coach other red teamers on functional strategies for effective delivery, communication, and prioritization in fast moving environments.
  • Embody our and  
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

Luxoft - Android Developer / CTS Expert

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
Kaedim - UX/UI Designer

Kaedim

San Francisco, California, United States (On-Site)
6 Months ago
Riot Games - Manager, Software Engineering, BuRST - 2XKO

Riot Games

United States (On-Site)
2 Months ago
Egnyte - Staff Software Engineer - C++

Egnyte

Poznań, Greater Poland Voivodeship, Poland (On-Site)
2 Months ago
Meta - Research Intern, Computer Vision for Egocentric Representation Learning (PhD)

Meta

Redmond, Washington, United States (On-Site)
3 Months ago
DraftKings - Senior Lead Software Engineer, Machine Learning

DraftKings

United States (Remote)
2 Months ago
Thumbtack - Staff Software Engineer,  Machine Learning Infrastructure

Thumbtack

United States (Remote)
2 Months ago
Glean - Software Engineer, Machine Learning (India)

Glean

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

SSC Technologies - Sr. Platform Engineer

SSC Technologies

Kansas, United States (Remote)
3 Months ago
Phenom - Devops Engineer - I

Phenom

Hyderabad, Telangana, India (On-Site)
3 Months ago
Netflix - Network Deployment Engineer L5

Netflix

Los Gatos, California, United States (On-Site)
1 Month ago
PwC - IN-Senior Associate –D365 CRM Technical_MS Dynamics_Advisory_Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Luxoft - Senior PySpark Data Engineer

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
2 Months ago
Paypal - Staff Software Engineer - Web SDK

Paypal

Chicago, Illinois, United States (Hybrid)
4 Months ago
Playrix - Lead Technical Designer

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago
AGS - American Gaming Systems - Software Engineer II- Interactive

AGS - American Gaming Systems

Arizona, United States (On-Site)
1 Month ago
PlayStation Global - Business Intelligence Developer

PlayStation Global

United States (Remote)
1 Month ago
Diligent - Software Engineer (Mobile)

Diligent

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Smarsh - Director, IT Incident and Problem Management

Smarsh

Atlanta, Georgia, United States (Hybrid)
3 Months ago
Scientific Games  - Field Service Tech I - Tulsa

Scientific Games

Oklahoma, United States (On-Site)
2 Months ago
Universal Music - Director, Privacy Operations

Universal Music

Santa Monica, California, United States (On-Site)
2 Months ago
Microsoft - Hardware Engineer 2

Microsoft

Mountain View, California, United States (On-Site)
1 Month ago
Niantic - Producer II, Pokémon Go

Niantic

Seattle, Washington, United States (Hybrid)
2 Months ago
Nagarro - Associate Principal Engineer

Nagarro

New York, New York, United States (On-Site)
3 Months ago
Paypal - Sr. UX Designer, Venmo Teens

Paypal

San Jose, California, United States (On-Site)
4 Months ago
2K - Senior Rendering Engineer

2K

San Mateo, California, United States (On-Site)
4 Months ago
Netflix - ML Engineer L5 - Ads Platform Engineering (Forecasting)

Netflix

United States (Remote)
3 Months ago
Activision - Senior Technical Designer - Infinity Ward

Activision

Los Angeles, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Zoox - Staff/Senior Staff Software Engineer, ML Performance Optimization

Zoox

Seattle, Washington, United States (On-Site)
3 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Meta - AI Research Scientist, Language - Generative AI

Meta

Bellevue, Washington, United States (On-Site)
3 Months ago
Tencent - NLP Research Intern 104493

Tencent

London, England, United Kingdom (On-Site)
1 Month ago
Microsoft - Principal Scientist Robot Learning - Spatial AI Lab

Microsoft

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Microsoft - Member of Technical Staff, High Performance Computing Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago
Honeywell - Sr Advanced Data Scientist

Honeywell

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Zoox - Software Engineer - Simulaton Scenario Automation

Zoox

Seattle, Washington, United States (Hybrid)
3 Months ago
Microsoft - Senior Applied Scientist- Content Service

Microsoft

Beijing, Beijing, China (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

London, England, United Kingdom (Hybrid)

London, England, United Kingdom (On-Site)

Jakarta, Jakarta, Indonesia (On-Site)

Milan, Lombardy, Italy (On-Site)

Gurugram, Haryana, India (On-Site)

Prague, Prague, Czechia (On-Site)

Montreal, Quebec, Canada (On-Site)

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug