Member of Technical Staff – Machine Learning Engineer

2 Months ago • 6-10 Years • Artificial Intelligence • $137,600 PA - $294,000 PA

Job Summary

Job Description

Microsoft seeks a passionate Machine Learning Engineer to build inference infrastructure for its AI products. Responsibilities include creating ML pipelines (data preparation, inference, system integration), processing large-scale data, experimenting with LLMs, partnering with engineering and product teams to build robust client libraries for large-scale inference, driving design and technical strategy, providing technical leadership, and embodying Microsoft's culture and values. The ideal candidate has experience in HPC, distributed inference, cloud infrastructure, and Python, SQL, and/or Spark. The role involves working on the most interesting and challenging AI questions, making AI accessible to all, and building systems with true artificial intelligence.
Must have:
  • Experience with Python, SQL, and/or Spark
  • Create ML pipelines
  • Large-scale data processing
  • LLM experience
  • Collaborate with engineering teams
  • Technical leadership
Good to have:
  • Experience with Azure Machine Learning
  • Python package development
  • Experience with ML and data science libraries
  • Prompt engineering

Job Details

Job Description
Overview

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Help us push the frontiers of metrics and measurement. Our team focuses on building insights into Microsoft’s AI products. We’re looking for a talented Machine Learning (ML) Engineer to build inference infrastructure to help us understand and improve how people interact with Microsoft’s AI products. Our team is seeking people with deep technical talent, a drive to deliver, and a creative/entrepreneurial spirit.
The ideal candidate has experience in High-Performance Computing (HPC), distributed (batch) inference in machine learning, and/or working with cloud infrastructure.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. New York, New York OR Mountain View, CA OR Redmond, WA , OR Boulder, CO position, you are required to be local to the New York OR San Francisco OR Seattle OR Denver area and in office 3 days a week.


Responsibilities
  • Creates pipelines for machine learning, inclusive of data preparation, inference, and integration with downstream systems.  
  • Comfortable with large scale data processing pipelines to extract business value from user logs.  
  • Learning about, understanding, and experimenting with the latest LLM capabilities that keep up with your customers.  
  • Partnering with engineering, product, and leadership teams to create robust client libraries that facilitate large scale inference on user data.  
  • Driving design and technical strategy decisions based on product needs, customer feedback and best development practices.  
  • Providing technical leadership and subject matter expertise as you establish and grow best practices for the integration of emerging technology.  
  • Embodying Microsoft’s culture and values.  
  • Embody our  and


Qualifications

Required Qualifications:
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python  
    • OR equivalent experience.  
  • Experience with Python, SQL, and/or Spark.

Preferred Qualifications:
  • Bachelor's Degree in Computer Science or related technical field AND 10 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
    • OR Master's Degree in Computer Science or related technical field AND 8 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
    • OR equivalent experience
  • Experience with Azure Machine Learning or similar systems, including deployment and monitoring of large-scale pipelines.
  • Experience with Python package development.
  • Experience with LLMs and prompt engineering.
  • Experience with ML and data science libraries such as sklearn, PySpark, pandas, and transformers.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
 
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:  
 
Microsoft will accept applications and processes offers for these roles on an ongoing basis.


Similar Jobs

Visa - Senior Software Engineer - Backend

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
Google - Cloud Technical Solutions Engineer, Infrastructure

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Anthology - Software Engineer in Test I

Anthology

(Remote)
2 Months ago
Gamomat - Quality Assurance Engineer

Gamomat

Berlin, Berlin, Germany (Hybrid)
2 Months ago
Google - Student Researcher, BS/MS, Winter/Summer 2025

Google

Mountain View, California, United States (On-Site)
7 Months ago
Google - Software Engineer III, Generative AI, MSCA

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
DraftKings - Senior Manager, Technical Learning & Development

DraftKings

New York, New York, United States (On-Site)
1 Month ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
6 Months ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
3 Months ago
NVIDIA - Senior AI-HPC Cluster Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Thales - Lead SDET

Thales

Bengaluru, Karnataka, India (Hybrid)
4 Weeks ago
NCR Voyix - Software Engineer III - Dotnet Backend, C#

NCR Voyix

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
luxsoft - DevOps Engineer

luxsoft

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
PwC - Associate, Data and Analytics Advisory

PwC

Kolkata, West Bengal, India (On-Site)
2 Months ago
Fluxon - Staff Software Engineer

Fluxon

Hyderabad, Telangana, India (Remote)
7 Months ago
Enphase Energy - EVSE - Tech Lead Backend Developer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
luxsoft - Senior Software Developer - React Native

luxsoft

(Remote)
3 Weeks ago
Tekion Corp - Automation QA Engineer

Tekion Corp

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Google - Software Engineer II, App Hub, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
GoTo Group - Software Engineer - Identity Platform

GoTo Group

Gurugram, Haryana, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Wisk - Staff Battery Test Engineer

Wisk

Mountain View, California, United States (On-Site)
2 Months ago
Google - Software Engineering Manager II, Infrastructure, Google Cloud Compute

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Cognite - Senior Solution Architect

Cognite

Houston, Texas, United States (Hybrid)
3 Weeks ago
The New York Times - Director of Strategic Communications, Emerging Tech

The New York Times

New York, United States (Hybrid)
2 Months ago
Next Level Business Services - Product Development Manager

Next Level Business Services

Bentonville, Arkansas, United States (On-Site)
7 Months ago
Regent Craft - Modeling and Simulation Engineer

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
2 Years ago
Rush Street Interactive - Risk & Payment Analyst

Rush Street Interactive

Collingswood, New Jersey, United States (Hybrid)
5 Months ago
Trackman - Customer Service Representative

Trackman

Phoenix, Arizona, United States (On-Site)
1 Year ago
Mobility ware - Lead Data Analyst

Mobility ware

Irvine, California, United States (Hybrid)
1 Month ago
Riot Games - Staff Software Engineer, Gameplay Systems - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Ubisoft - Senior C++ Programmer - Machine Learning Content Creation Technology Group

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
Google - Senior Technical Program Manager, AI Risk Reporting Lead

Google

Seattle, Washington, United States (On-Site)
1 Month ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
4 Months ago
Google - Senior Software Engineer, Google Cloud AI

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Bragg - AI/ML Engineer

Bragg

Ljubljana, Ljubljana, Slovenia (Hybrid)
1 Month ago
Virtuos - Senior Machine Learning Engineer (Game)

Virtuos

Vietnam (On-Site)
1 Month ago
Electronic Arts - Senior Manager, Generative AI Software Engineering

Electronic Arts

Orlando, Florida, United States (On-Site)
2 Months ago
Arrise Solutions (India)   - Lead ML Engineer

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
8 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
7 Months ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Vancouver, British Columbia, Canada (On-Site)

Mountain View, California, United States (Hybrid)

Shenzhen, Guangdong Province, China (On-Site)

Noida, Uttar Pradesh, India (On-Site)

Redmond, Washington, United States (On-Site)

Paris, Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug