Senior Data & Applied Scientist

5 Months ago • 1-7 Years • Research Development • $117,200 PA - $250,200 PA

Job Summary

Job Description

The Senior Data & Applied Scientist will be part of the Core Search and AI team at Microsoft, responsible for enhancing the search experience across Bing, Yahoo, DuckDuckGo, and other platforms. This role involves designing, implementing, and evaluating metrics for search engine performance using LLMs. Responsibilities include defining customer satisfaction metrics, researching sampling strategies, leading teams to obtain high-quality labels, enabling other scientists to conduct efficient experiments, making independent decisions, translating strategies into measurable plans, collaborating with various teams, and working to improve search relevance, summarization, and recommendations. The ideal candidate will possess strong Python skills and experience with search engine metrics, especially those involving LLMs.
Must have:
  • Bachelor's/Master's/PhD in relevant field
  • 2+ years Python experience
  • 2+ years experience designing search engine metrics (LLMs)
  • Define and deliver customer satisfaction metrics
  • Lead teams, make independent decisions
Good to have:
  • 3+ years customer-facing experience
  • Understanding of traditional search engine metrics (e.g., MRR, NDCG)
  • Experience with latest labeling technologies
Perks:
  • Industry-leading healthcare
  • Educational resources
  • Product and service discounts
  • Savings and investment plans
  • Maternity/paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

The Core Search and AI team is the leading applied machine learning team at Microsoft responsible for delivering the highest-quality search experience to over 500M+ monthly active users around the world in Microsoft’s search engine, Bing and other dependent search engines such as Yahoo, DuckDuckGo, and new startups like Neeva.


We are looking for a Senior Data & Applied Scientist who wants to build the next generation of search to revolutionize the way people discover and access information by harnessing the power of advanced language models and search technologies, ensuring a personalized, reliable, and inclusive search experience for all users. We are responsible for the largest machine learning models at Microsoft by volume and take pride in being the first in the world to solve many practical AI at Scale challenges. Our work spans a very large scope of scenarios including delivering high quality search results from a massive document corpus, extractive and abstractive summarization to generate document snippets, machine reading comprehension, and document recommendations.

As a team, we leverage the diverse backgrounds and experiences of passionate engineers, scientists, and program managers to help us realize our goal of making the world smarter and more productive. We believe great products are built by inclusive teams of customer-obsessed individuals who trust each other and work together closely.  We collaborate regularly across the company both to find the technology breakthroughs from groups like Microsoft Research to infusing AI into the rest of Microsoft products like Office and Azure.

 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Qualifications

Required Qualifications:

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
    • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience.
  • 2+ years experience in Python.
  • 2+ years experience in designing and implementing search engine metrics, preferably with projects that involve LLMs.

Additional or Preferred Qualifications:

  • 3+ years customer-facing, project-delivery experience, professional services, and/or consulting experience.
  • Understanding of traditional search engine metrics like precision, recall, Mean Reciprocal Rank (MRR), and Normalized Discounted Cumulative Gain (NDCG)
  • Customer focused, strategic, drives for results, is self-motivated, and has a propensity for action.

 

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

 

Microsoft will accept applications for the role until January 1, 2025.

 

Responsibilities

  • Define, invent, and deliver behavioral and human labeled metrics which accurately measure the satisfaction and success of our customers.
  • Research, analyze, and decide between various sampling strategies which accurately reflect user perception.
  • Lead a team to design a blueprint for how to get high quality labels with latest technologies and expert judges.
  • Enable other machine learning scientists in the broader group to experiment quickly and accurately.
  • Make independent decisions for the team and handle difficult tradeoffs.
  • Translate strategy into plans that are clear and measurable, with progress shared out monthly to stakeholders.
  • Partner effectively with program management, engineers, and other areas of the business.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

CharacterAI - Staff Software Engineer, Applied ML

CharacterAI

Menlo Park, California, United States (On-Site)
7 Months ago
Rockstar Games - Manager, Data Engineering

Rockstar Games

New York, New York, United States (On-Site)
6 Months ago
ZeniMax Media - Programmeur.se DevOps senior / Senior DevOps Programmer

ZeniMax Media

Montreal, Quebec, Canada (On-Site)
9 Months ago
DEVOTEAM - Ingénieur Microsoft 365 H/F

DEVOTEAM

(Remote)
7 Months ago
Luxoft - Senior Data Analyst/Data QA

Luxoft

Poland, Ohio, United States (Remote)
6 Months ago
Thumbtack - Senior Applied Scientist

Thumbtack

Ontario, Canada (Remote)
7 Months ago
PwC - IN-Senior Associate_ Python Developers _Advisory Corporate_ Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Riot Games - Senior Technical Producer, League Studios - Build Test Ship

Riot Games

Dublin, County Dublin, Ireland (On-Site)
7 Months ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Riot Games - Staff Software Engineer - Developer Connections

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ajmera Infotech - Senior Azure DevOps Engineer (IaaS)

Ajmera Infotech

Ahmedabad, Gujarat, India (On-Site)
11 Months ago
Paypal - Software Engineer- AI Data Governance

Paypal

San Jose, California, United States (Hybrid)
8 Months ago
Zones - Cloud Technical Specialist

Zones

Lahore, Punjab, Pakistan (On-Site)
7 Months ago
Warner Bros Discovery - Sr. Integration Developer

Warner Bros Discovery

Mexico City, Mexico City, Mexico (On-Site)
6 Months ago
Keywords Studios (Player Support) - Cloud Engineer

Keywords Studios (Player Support)

United Kingdom (Remote)
1 Year ago
ARHS - Application Security Expert

ARHS

Amsterdam, North Holland, Netherlands (On-Site)
7 Months ago
Playtech - Junior Cloud Security Engineer

Playtech

(On-Site)
7 Months ago
Everyday Health Group - Senior Software Engineer, Backend - Lose It!

Everyday Health Group

United States (On-Site)
7 Months ago
GoTo Group - Principal SRE Engineer (SE5)

GoTo Group

Gurugram, Haryana, India (On-Site)
7 Months ago
PwC - ETIC, Data Solution Architect - Senior Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

The Walt Disney Company - Sr Data Analyst

The Walt Disney Company

San Francisco, California, United States (On-Site)
5 Months ago
Scale AI - Strategic Account Executive - Generative AI

Scale AI

Seattle, Washington, United States (On-Site)
8 Months ago
Blizzard Entertainment - Senior Sound Designer TEMP - World of Warcraft | Irvine, CA or Remote

Blizzard Entertainment

Irvine, California, United States (Hybrid)
6 Months ago
ByteDance - Senior Software Engineer, Payment Solution

ByteDance

Seattle, Washington, United States (On-Site)
7 Months ago
Netflix - Software Engineer (L4) - Performance Engineering

Netflix

Los Gatos, California, United States (On-Site)
7 Months ago
Nintendo - Senior Software Engineer (Python/React)

Nintendo

Redmond, Washington, United States (Hybrid)
9 Months ago
Meta - Software Engineer, Infrastructure

Meta

Atlanta, Georgia, United States (Remote)
7 Months ago
IGT - Systems Engineer

IGT

Reno, Nevada, United States (Remote)
6 Months ago
Critical mass - Freelance Senior Copywriter, Future Opportunity

Critical mass

Chicago, Illinois, United States (On-Site)
8 Months ago
Anthology  Inc  - Customer Success Manager, Blackboard

Anthology Inc

United States (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Microsoft - Senior Machine Learning Engineer – Xbox Games Technology Group – The Coalition

Microsoft

Vancouver, British Columbia, Canada (On-Site)
5 Months ago
Google - Software Engineer, Android App, Pixel Camera

Google

(On-Site)
6 Months ago
ByteDance - SoC System Software Architect

ByteDance

San Jose, California, United States (On-Site)
7 Months ago
Ubisoft - Team Lead Programmer [Rainbow Six]

Ubisoft

Toronto, Ontario, Canada (Hybrid)
9 Months ago
Synopsys  Inc  - Mac OS Virtualization Specialist

Synopsys Inc

Bengaluru, Karnataka, India (On-Site)
7 Months ago
The Walt Disney Company - Software Engineer, Post Production Engineering

The Walt Disney Company

Emeryville, California, United States (On-Site)
7 Months ago
Google - Digital ASIC Micro Architect Design Engineer

Google

Mountain View, California, United States (On-System)
5 Months ago
HP - R&D Mechanical Engineer Internship

HP

Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
8 Months ago
Recro - Automatic speech Recognition

Recro

Gurugram, Haryana, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Chennai, Tamil Nadu, India (On-Site)

Vancouver, British Columbia, Canada (On-Site)

Mountain View, California, United States (Hybrid)

Noida, Uttar Pradesh, India (On-Site)

Redmond, Washington, United States (On-Site)

Paris, Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug