Senior Product Manager - Copilot Measurement & Evaluation

3 Days ago • 5-7 Years • Product Management • $117,200 PA - $250,200 PA

Job Summary

Job Description

This Senior Product Manager role focuses on Copilot Measurement & Evaluation within Microsoft AI. Responsibilities include defining the product roadmap for Copilot's data science team, extracting data insights to improve the product, influencing key success metrics, and evangelizing learnings to drive broader product strategy. The ideal candidate will have strong technical expertise, experience with AI/ML, and a proven ability to collaborate effectively with data scientists, engineers, and designers. The role requires a balance of technical and people management skills and involves working on a fast-paced, data-driven team to build world-class consumer experiences.
Must have:
  • 5+ years product management experience
  • Experience building user-facing product roadmaps
  • Technical expertise in data analysis
  • Data-driven decision making
  • Collaboration and communication skills
Good to have:
  • Experience with AI, personal productivity, or search products
  • Experience building products using ML or LLMs
  • SQL and coding skills (Python, JavaScript)

Job Details

Overview

As Microsoft AI we are pushing the boundaries of technology.

 

We are creating unique, beautiful and powerful products that will change lives. A small, friendly, fast-moving team, we support each other to do the best work of our lives, always looking to break new ground, fast. We are proud of what we build, how we build it and that our products will define the AI era. We run lean, obsess about users, and always make our decisions based on the evidence. We ship regularly, so your work will have real and immediate impact. It’s a time of huge change in the AI landscape, and this role will put you right in the heart of it.

 

We’re on the lookout for a data-driven Product Manager (PM) to help build the next wave of capabilities of our personal AI, Copilot. As an experienced Product Manager for Measurement and Evaluation on the team, you will balance creativity, curiosity, technical expertise, to drive challenging projects to successful completion. You will collaboratively work with data scientists, AI researchers, engineers, designers, and product managers to take ambiguous projects and mold them into amazing experiences to delight our customers. We’re looking for someone with a strong technical depth, an abundance of positive energy, empathy, and kindness, in addition to being highly effective. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.

 

Our newly formed organization, Microsoft AI (MAI), focuses on Copilot and other consumer AI products and research. We combine world-class AI research together with top notch design and product craft. The wider team is responsible for Copilot, Bing, Edge, and generative AI research, while the Mobile Engineering team is responsible for leading and building the mobile experience of Copilot on iOS and Android, collaborating closely with our Product Management, Design and AI

Research teams. This role requires a balance of technical skills and effective people management skills.

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

 

By applying to this U.S. Mountain View, CA, you are required to be local to the San Francisco area and in office 3 days a week.

Qualifications

Required Qualifications:

  • Bachelor's Degree AND 5+ years experience in product management
    • OR equivalent experience.
  • Experience building product roadmaps for user facing products.

Preferred Qualifications:

  • Bachelor's Degree AND 7+ years of experience in product management
    • OR equivalent experience.
  • Technical expertise, previous experience in quantitative or technical roles (Data Scientist, ML Engineer, Product Analyst, etc.)
  • Experience leading product teams building consumer products in AI, personal productivity, search, education or messaging.  
  • Experience building consumer products leveraging Machine Learning or Large Language Models. 
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.  
  • Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.  
  • Experience with data analytics and experimentation tools. Working knowledge of SQL and coding skills (Python, JavaScript). 

Product Management IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year. Certain roles may be eligible for benefits and other compensation.

 

Find additional benefits and pay information here:

 

Microsoft will accept applications for the role until Febuary 14, 2025. 

 

 

#Copilot #MicrosoftAI

Responsibilities

  • Define the Product Roadmap: Build the product roadmap and strategic direction for the Copilot Data Science team responsible for measuring, evaluating and understanding Copilot: from the model performance to the user behaviors.
  • Spin the Data Flywheel: Extract data insights from billions of data points to uncover issues and opportunities and share recommendations to lead to direct product improvements. Work with AI teams to transform learnings into direct model improvements.
  • Orient the Success Metrics: Influence our NorthStar metrics (successful sessions, active users, revenue, etc.) and how we measure the success of Copilot.
  • Evangelize learnings to drive impact: Share Data Science and Product Analytics Insights in Weekly Product Reviews and Team All Hands.
  • Orient the overall Copilot product strategy: Use metrics and insights to influence the broader Copilot product roadmap.
  • Embody our and .

Similar Jobs

4ThePlayer - REMOTE Junior Backend JavaScript Developer

4ThePlayer

(Remote)
2 Weeks ago
bytro studios - Senior PHP Developer

bytro studios

Hamburg, Hamburg, Germany (Hybrid)
1 Day ago
Google - Technical Solutions Consultant, Ads, Authoring Automation, gTech

Google

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Coda - Senior/Staff Front End Engineer

Coda

Bucharest, Bucharest, Romania (Hybrid)
1 Year ago
commerce iq - Software Development Engineer Testing II

commerce iq

Bengaluru, Karnataka, India (On-Site)
18 Hours ago
HoYoverse - AI Product Management Intern

HoYoverse

Singapore (On-Site)
1 Month ago
Scientific Games  - Project Manager, Digital Product Development

Scientific Games

Georgia, United States (Remote)
2 Months ago
Google - Software Engineering Manager II, Google Ads

Google

Irvine, California, United States (On-Site)
2 Weeks ago
Blitz app - Senior Product Manager II, Games

Blitz app

Los Angeles, California, United States (Hybrid)
5 Months ago
DraftKings - Manager of Delivery Management, Sportsbook

DraftKings

United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

N-iX - Senior Angular Engineer

N-iX

Colombia (Remote)
3 Days ago
Google - Software Engineering Manager II, Google Distributed Cloud air-gapped Operations Engineering

Google

Kirkland, Washington, United States (On-Site)
2 Days ago
Nagarro - Staff Engineer, QA Automation

Nagarro

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
6 Months ago
House of How - Lead Game Engineer - Sweden

House of How

Boden, Norrbotten County, Sweden (On-Site)
5 Months ago
Schbang - Senior HubSpot Developer

Schbang

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Riot Games - Principal Software Engineer, Gameplay - Teamfight Tactics

Riot Games

Los Angeles, California, United States (On-Site)
1 Day ago
Aisera - Sales Engineer

Aisera

(Remote)
7 Hours ago
Google - Software Engineer II, Google Messages

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Mountain View, California, United States

VX Media - Social Media Intern

VX Media

New York, New York, United States (On-Site)
1 Month ago
Egnyte - Sr. Software Engineer

Egnyte

Mountain View, California, United States (Hybrid)
5 Months ago
Discord - Staff Software Engineer, Media Infrastructure

Discord

San Francisco, California, United States (On-Site)
3 Months ago
Luxoft - Senior Angular JS Developer

Luxoft

New York, New York, United States (On-Site)
4 Months ago
Marks, part of SGS & Co - Senior Line Producer

Marks, part of SGS & Co

Chicago, Illinois, United States (On-Site)
1 Week ago
Dmg - Territory Account Executive

Dmg

Denver, Colorado, United States (On-Site)
1 Month ago
Patreon - Senior Data Scientist

Patreon

New York, New York, United States (Hybrid)
1 Month ago
Google - Systems Development Engineer, Google Distributed Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Senior Software Engineer, Machine Learning (Recommendations, Rankings, and Predictions)

Google

Mountain View, California, United States (On-Site)
2 Days ago
Universal Music - Senior Internal Auditor

Universal Music

Santa Monica, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Product Management Jobs

Google - Product Manager II, Ads

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Keywords Studios - Product Planner - AI

Keywords Studios

Silesian Voivodeship, Poland (On-Site)
2 Weeks ago
Firemonkeys - Game Product Manager

Firemonkeys

Melbourne, Victoria, Australia (Hybrid)
2 Months ago
Google - Leadership Technical Program Manager II, Pixel Watch

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Google - Program Manager, Product Data Management

Google

Taipei City, Taiwan (On-Site)
1 Week ago
GoTo Group - Lead Product Manager - Digital Signature

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
6 Months ago
Google - Global Product Activation Manager, YouTube Shopping

Google

San Bruno, California, United States (On-Site)
2 Days ago
Dream Sports - Senior Manager/Director - Product Strategy

Dream Sports

Mumbai, Maharashtra, India (On-Site)
1 Month ago
ByteDance - Customer Success Manager - Lark - Philippines

ByteDance

Taguig, Metro Manila, Philippines (On-Site)
6 Months ago
Google - Media Solutions Specialist, Video

Google

Dublin, County Dublin, Ireland (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

London, England, United Kingdom (On-Site)

Redmond, Washington, United States (On-Site)

Redmond, Washington, United States (Hybrid)

Shanghai, Shanghai, China (Hybrid)

Beijing, Beijing, China (On-Site)

Washington, United States (On-Site)

Phoenix, Arizona, United States (On-Site)

Penang, Malaysia (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug