Senior Product Manager, Copilot AI

1 Month ago • 5-8 Years • Product Management • $117,200 PA - $250,200 PA

Job Summary

Job Description

As a Senior Product Manager for Copilot AI at Microsoft, you'll be at the forefront of AI innovation, focusing on information retrieval for language models powering Microsoft Copilot. Responsibilities include identifying and prioritizing language model issues impacting quality, factuality, and safety; improving model grounding with information retrieval; engineering prompts; defining measurable evaluations; creating data collection tasks; collaborating with researchers and engineers on projects; deploying and tracking A/B tests; and owning project status and risk management. You'll need experience in leading multi-disciplinary projects, building ML/LLM-powered products, and ideally, experience with search products and large language models. The role requires a blend of technical skills and effective people management.
Must have:
  • 5+ years product/technical program management or software development experience
  • 3+ years leading multi-disciplinary projects
  • Experience building ML/LLM-powered products
  • Strong problem-solving and collaboration skills
Good to have:
  • Experience shipping consumer-facing products
  • Experience with search products or search-powered products
  • Familiarity with information retrieval techniques for language models
  • Technical depth in software development, data science, and machine learning

Job Details

Job Description

Overview
As Microsoft AI we are pushing the boundaries of technology.

We are creating unique, beautiful and powerful products that will change lives. A small, friendly, fast-moving team, we support each other to do the best work of our lives, always looking to break new ground, fast. We are proud of what we build, how we build it and that our products will define the AI era. We run lean, obsess about users, and always make our decisions based on the evidence. We ship regularly, so your work will have real and immediate impact. It’s a time of huge change in the AI landscape, and this role will put you right in the heart of it.

As an AI Product Manager, you will work at the nexus of product and research specifically focused on information retrieval for language models. Your products are the language models that power Microsoft Copilot. You will be responsible for balancing product needs with research priorities, ensuring that Copilot's messages are high quality, factual and safe. You will also be responsible for prioritizing new features and research, identifying gaps, building evaluations, defining metrics and working closely with Engineers, AI researchers and other dependency teams to build and execute product plans. We’re looking for someone with an abundance of positive energy, empathy, and kindness, in addition to being highly effective. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.

Our newly formed organization, Microsoft AI (MAI), focuses on Copilot and other consumer AI products and research. We combine world-class AI research together with top notch design and product craft. The wider team is responsible for Copilot, Bing, Edge, and generative AI research, while the Mobile Engineering team is responsible for leading and building the mobile experience of Copilot on iOS and Android, collaborating closely with our Product Management, Design and AI Research teams. This role requires a balance of technical skills and effective people management skills.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. Mountain View, CA OR Redmond, WA position, you are required to be local to the San Francisco area OR Seattle area and in office 3 days a week.


Responsibilities
  • Identifying and prioritizing language model issues that impact quality, factuality and safety and working with engineers and researchers to find a path to resolution.
  • Identifying and executing on strategies to improve grounding of language models with information retrieval.
  • Engineering prompts to teach language models how to behave across a wide range of scenarios.
  • Defining measurable evaluations that use technical and product metrics to demonstrate quality improvements.
  • Creating novel data collection tasks for taskers to evaluate language models.
  • Working closely with researchers and engineers to define and manage engineering and research projects.
  • Deploying and tracking AB model experiments in production.
  • Being accountable to own the status of key projects, proactively identifying risks and proposing solutions to ensure timely delivery.
  • Embodying our.

Qualifications

Required Qualifications:
  • Bachelor's Degree AND 5 years experience in product/technical program management or software development
  • OR equivalent experience.
  • 3 years of experience leading multi-disciplinary projects, defining requirements, developing project plans and working with multi-disciplinary teams to execute them.
  • Experience in building ML-powered or LLM-powered products.
   
Preferred Qualifications:
  • 3 years of experience shipping consumer-facing products. You’ve brought products to market, collected user feedback, defined success metrics and iteratively improved products.
  • 3 years of experience in building search products or search-powered products.
  • Familiarity and experience with information retrieval techniques for language models.
  • Technical depth in software development, data science and machine learning. While you are not expected to write code on the critical path, you’re able to define and execute on zero-to-one prototypes, reason over large amounts of data, and speak the language of the engineers and researchers you work with.
  • Experience using and applying Large Language Models. LLMs will be your clay – you should know how to prompt engineer them, how to evaluate them, and understand how they are tuned.

Product Management IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.
 
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 
 
Microsoft will accept applications and processes offers for these roles on an ongoing basis.


Similar Jobs

Riyo games - Lead UI/UX Designer

Riyo games

Canada (Remote)
1 Month ago
WongDoody - (CX) CUSTOMER EXPERIENCE CONSULTANT

WongDoody

Australia (On-Site)
8 Months ago
Ubisoft - Technical Director - Cinematics & Realization

Ubisoft

Bordeaux, Nouvelle-Aquitaine, France (Hybrid)
1 Month ago
Ubisoft - Game Designer (3C)

Ubisoft

Montreal, Quebec, Canada (Hybrid)
2 Weeks ago
Ethos Life - Principal Product Manager, Consumer

Ethos Life

United States (Hybrid)
1 Month ago
bytedance - Senior Manager, Product Management - Customer Service Platform - International E-commerce

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
good job games - Product Specialist (New Grad)

good job games

İstanbul, Türkiye (On-Site)
1 Year ago
Evolution  - Technical Compliance Team Lead

Evolution

St. Julian's, Malta (On-Site)
4 Months ago
PwC - Digital Banking Consultant - Manager

PwC

Bangkok, Bangkok, Thailand (On-Site)
8 Months ago
Nagarro - SAP Product Compliance Consultant

Nagarro

Germany (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Principal Game Designer - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Ubisoft - Junior Programmer

Ubisoft

Chengdu, Sichuan, China (On-Site)
1 Month ago
Riot Games - Senior Game Designer, Combat

Riot Games

Shanghai, China (On-Site)
1 Month ago
Gearbox - Technical Artist

Gearbox

Frisco, Texas, United States (On-Site)
4 Days ago
Critical mass - Lead User Experience Designer

Critical mass

London, England, United Kingdom (Hybrid)
1 Week ago
HoYoverse - Combat Designer - Fresh Grad

HoYoverse

Singapore (On-Site)
10 Months ago
Lighthouse Games - Lead VFX Artist

Lighthouse Games

England, United Kingdom (Hybrid)
2 Months ago
bytedance - Senior Software Engineer - IaaS AI Infra

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Giant Sparrow - Creature (and Gameplay) Programmer

Giant Sparrow

Los Angeles, California, United States (Remote)
3 Months ago
Blenheim Chalcot India - AI-Augmented Software Engineer

Blenheim Chalcot India

Mumbai, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Power Integrations - Sr. Sales Operations Manager

Power Integrations

San Jose, California, United States (On-Site)
1 Month ago
Trek - Seasonal Service Technician/Builder

Trek

Columbus, Ohio, United States (On-Site)
4 Months ago
Zinnia - Analyst IV, Client Success

Zinnia

Topeka, Kansas, United States (Hybrid)
1 Month ago
Linden lab - Customer Success Specialist

Linden lab

Duluth, Georgia, United States (On-Site)
1 Week ago
Axon - Senior Manager, Billing Compliance

Axon

Denver, Colorado, United States (Hybrid)
2 Weeks ago
bytedance - Software Engineer, Model Inference

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Optiv - Sr. Splunk Engineer

Optiv

Fort Meade, Maryland, United States (On-Site)
1 Month ago
Obsidian Entertainment - Senior Systems Designer

Obsidian Entertainment

Irvine, California, United States (On-Site)
1 Month ago
Gupta - Senior Social Media Strategist

Gupta

Boston, Massachusetts, United States (On-Site)
1 Month ago
bytedance - Senior Backend Software Engineer

bytedance

San Jose, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Product Management Jobs

Evolution  - Certification Specialist (Costa Rica)

Evolution

San José, San José Province, Costa Rica (On-Site)
1 Year ago
Scopely - QA Analyst - Unannounced Project

Scopely

Barcelona, Catalonia, Spain (Hybrid)
3 Months ago
Realworld one - Software Project Manager

Realworld one

Freiburg, Lower Saxony, Germany (On-Site)
2 Months ago
Epic Games - Director, Product Management (Subscription + Pass Products)

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Keywords Studios - Lead Research Associate - AI

Keywords Studios

Gurugram, Haryana, India (On-Site)
1 Month ago
Epic Games - Product Director

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Ion - Project Management Office

Ion

Italy (On-Site)
7 Months ago
bytedance - Senior Product Operations Advocate - R&D Tools

bytedance

San Jose, California, United States (On-Site)
1 Month ago
bytedance - Principal Product Manager - IaaS AI Infra

bytedance

San Jose, California, United States (On-Site)
4 Months ago
Ion - Implementation Analyst (Fixed Income)

Ion

Pisa, Tuscany, Italy (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Vancouver, British Columbia, Canada (On-Site)

Mountain View, California, United States (Hybrid)

Shenzhen, Guangdong Province, China (On-Site)

Noida, Uttar Pradesh, India (On-Site)

Redmond, Washington, United States (On-Site)

Paris, Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug