Member of Technical Staff – Machine Learning Engineer

1 Week ago • 6-10 Years • Artificial Intelligence • $137,600 PA - $294,000 PA

Job Summary

Job Description

Microsoft seeks a passionate Machine Learning Engineer to build inference infrastructure for its AI products. Responsibilities include creating ML pipelines (data preparation, inference, system integration), processing large-scale data, experimenting with LLMs, partnering with engineering and product teams to build robust client libraries for large-scale inference, driving design and technical strategy, providing technical leadership, and embodying Microsoft's culture and values. The ideal candidate has experience in HPC, distributed inference, cloud infrastructure, and Python, SQL, and/or Spark. The role involves working on the most interesting and challenging AI questions, making AI accessible to all, and building systems with true artificial intelligence.
Must have:
  • Experience with Python, SQL, and/or Spark
  • Create ML pipelines
  • Large-scale data processing
  • LLM experience
  • Collaborate with engineering teams
  • Technical leadership
Good to have:
  • Experience with Azure Machine Learning
  • Python package development
  • Experience with ML and data science libraries
  • Prompt engineering

Job Details

Job Description
Overview

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.

Help us push the frontiers of metrics and measurement. Our team focuses on building insights into Microsoft’s AI products. We’re looking for a talented Machine Learning (ML) Engineer to build inference infrastructure to help us understand and improve how people interact with Microsoft’s AI products. Our team is seeking people with deep technical talent, a drive to deliver, and a creative/entrepreneurial spirit.
The ideal candidate has experience in High-Performance Computing (HPC), distributed (batch) inference in machine learning, and/or working with cloud infrastructure.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

By applying to this U.S. New York, New York OR Mountain View, CA OR Redmond, WA , OR Boulder, CO position, you are required to be local to the New York OR San Francisco OR Seattle OR Denver area and in office 3 days a week.


Responsibilities
  • Creates pipelines for machine learning, inclusive of data preparation, inference, and integration with downstream systems.  
  • Comfortable with large scale data processing pipelines to extract business value from user logs.  
  • Learning about, understanding, and experimenting with the latest LLM capabilities that keep up with your customers.  
  • Partnering with engineering, product, and leadership teams to create robust client libraries that facilitate large scale inference on user data.  
  • Driving design and technical strategy decisions based on product needs, customer feedback and best development practices.  
  • Providing technical leadership and subject matter expertise as you establish and grow best practices for the integration of emerging technology.  
  • Embodying Microsoft’s culture and values.  
  • Embody our  and


Qualifications

Required Qualifications:
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python  
    • OR equivalent experience.  
  • Experience with Python, SQL, and/or Spark.

Preferred Qualifications:
  • Bachelor's Degree in Computer Science or related technical field AND 10 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
    • OR Master's Degree in Computer Science or related technical field AND 8 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
    • OR equivalent experience
  • Experience with Azure Machine Learning or similar systems, including deployment and monitoring of large-scale pipelines.
  • Experience with Python package development.
  • Experience with LLMs and prompt engineering.
  • Experience with ML and data science libraries such as sklearn, PySpark, pandas, and transformers.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
 
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:  
 
Microsoft will accept applications and processes offers for these roles on an ongoing basis.


Similar Jobs

DraftKings - Senior Software Engineer – Streaming & Real-Time Systems

DraftKings

Sofia, Sofia City Province, Bulgaria (On-Site)
3 Weeks ago
Visa - Staff Data Engineer

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
5 Months ago
Riot Games - Staff Software Engineer (Services) - Teamfight Tactics, Core Tech

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Rackspace Technology - Oracle Business Systems Analyst II

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Week ago
The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Celebration, Florida, United States (On-Site)
1 Week ago
Zoox - Collision Avoidance System, Machine Learning Internship/Co-op

Zoox

Foster City, California, United States (On-Site)
5 Months ago
ByteDance - Research Scientist- Foundation Model, Video Generation

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Zoox - Machine Learning Engineer - Collision Avoidance System

Zoox

Foster City, California, United States (Hybrid)
5 Months ago
Google - Senior Software Engineer, AI/ML, Google Cloud AI

Google

(On-Site)
3 Months ago
GoTo Group - Senior Data Scientist - Computer Vision - KYC

GoTo Group

Singapore (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Globalization Partners - Sr Software Engineer

Globalization Partners

(Remote)
1 Month ago
Zinrelo - QA Engineer

Zinrelo

Pune, Maharashtra, India (Hybrid)
5 Months ago
ByteDance - Software Engineer (Payment Network) - Global Payment - Singapore

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Site Reliability Engineer, Compute Platform

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Meta - Software Engineer, Product

Meta

Seattle, Washington, United States (Remote)
4 Months ago
Axinous - Principal Software Development Engineer

Axinous

(Remote)
1 Month ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
1 Month ago
Rush Street Interactive - Systems Analyst

Rush Street Interactive

Bogotá, Bogota, Colombia (On-Site)
2 Months ago
SmileGate - Platform Division Store Service Backend Developer

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

ByteDance - Principal Product Manager - IaaS AI Infra

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
NVIDIA - Senior Synthesis Flow Development Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Weeks ago
Probably Monsters - Design Director

Probably Monsters

Washington, United States (On-Site)
4 Months ago
Next Level Business Services - MDM IDQ Developer/ Solution Architect - Full Time Only

Next Level Business Services

New York, New York, United States (On-Site)
5 Months ago
Rivos - Silicon Logic Formal Verification - Full Time

Rivos

Santa Clara, California, United States (Hybrid)
5 Months ago
SKYDANCE - Internship - Animation Production Management (Summer 2025)

SKYDANCE

Connecticut, United States (Hybrid)
3 Weeks ago
NVIDIA - Senior Product Marketing Manager, GPUs

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
Universal Music - Coordinator, NA Copyright

Universal Music

Franklin, Tennessee, United States (On-Site)
1 Month ago
ZeniMax Media - Backend Programmer

ZeniMax Media

Rockville, Maryland, United States (On-Site)
6 Months ago
Sunblink - Marketing Artist (Contract)

Sunblink

Boulder, Colorado, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Backend Engineer (Model Inference), Machine Learning Systems

ByteDance

Singapore (On-Site)
5 Months ago
Level AI - Principal Software Engineer

Level AI

Noida, Uttar Pradesh, India (Hybrid)
5 Months ago
Google DeepMind - Research Scientist, Language

Google DeepMind

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
ByteDance - Research Engineer - Multimodal Model

ByteDance

Singapore (On-Site)
5 Months ago
prizepicks - Customer Insights Internship

prizepicks

(Remote)
1 Week ago
Airlab Inc  - Junior Programmer Artificial Intelligence

Airlab Inc

Quebec, Canada (On-Site)
6 Days ago
PAPAYA - Data Scientist

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Interface AI - Sr. Implementation Engineer

Interface AI

United States (Remote)
4 Months ago
Vigaet - Internship -AI Agents

Vigaet

(Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Redmond, Washington, United States (Hybrid)

Redmond, Washington, United States (On-Site)

Mountain View, California, United States (On-Site)

Mountain View, California, United States (On-Site)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Redmond, Washington, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug