Senior Product Manager - Copilot Measurement & Evaluation

As Microsoft AI we are pushing the boundaries of technology.

We are creating unique, beautiful and powerful products that will change lives. A small, friendly, fast-moving team, we support each other to do the best work of our lives, always looking to break new ground, fast. We are proud of what we build, how we build it and that our products will define the AI era. We run lean, obsess about users, and always make our decisions based on the evidence. We ship regularly, so your work will have real and immediate impact. It’s a time of huge change in the AI landscape, and this role will put you right in the heart of it.

We’re on the lookout for a data-driven Product Manager (PM) to help build the next wave of capabilities of our personal AI, Copilot. As an experienced Product Manager for Measurement and Evaluation on the team, you will balance creativity, curiosity, technical expertise, to drive challenging projects to successful completion. You will collaboratively work with data scientists, AI researchers, engineers, designers, and product managers to take ambiguous projects and mold them into amazing experiences to delight our customers. We’re looking for someone with a strong technical depth, an abundance of positive energy, empathy, and kindness, in addition to being highly effective. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.

Our newly formed organization, Microsoft AI (MAI), focuses on Copilot and other consumer AI products and research. We combine world-class AI research together with top notch design and product craft. The wider team is responsible for Copilot, Bing, Edge, and generative AI research, while the Mobile Engineering team is responsible for leading and building the mobile experience of Copilot on iOS and Android, collaborating closely with our Product Management, Design and AI

Research teams. This role requires a balance of technical skills and effective people management skills.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. Mountain View, CA, you are required to be local to the San Francisco area and in office 3 days a week.

• Define the Product Roadmap: Build the product roadmap and strategic direction for the Copilot Data Science team responsible for measuring, evaluating and understanding Copilot: from the model performance to the user behaviors.
• Spin the Data Flywheel: Extract data insights from billions of data points to uncover issues and opportunities and share recommendations to lead to direct product improvements. Work with AI teams to transform learnings into direct model improvements.
• Orient the Success Metrics: Influence our NorthStar metrics (successful sessions, active users, revenue, etc.) and how we measure the success of Copilot.
• Evangelize learnings to drive impact: Share Data Science and Product Analytics Insights in Weekly Product Reviews and Team All Hands.
• Orient the overall Copilot product strategy: Use metrics and insights to influence the broader Copilot product roadmap.
• Embody our and .