Member of Technical Staff – Machine Learning Engineer
Job Summary
Job Description
Microsoft seeks a Machine Learning Engineer to build inference infrastructure for understanding and improving user interaction with AI products. Responsibilities include creating ML pipelines (data preparation, inference, system integration), processing large-scale data, experimenting with LLMs, partnering with engineering and product teams to create client libraries for large-scale inference, driving design and technical strategy, and providing technical leadership. The ideal candidate possesses expertise in HPC, distributed inference, cloud infrastructure, and Python, SQL, and/or Spark.
Must have:
- Experience with Python, SQL, and/or Spark
- ML pipeline creation (data prep, inference, integration)
- Large-scale data processing
- LLM understanding and experimentation
- Collaboration with engineering and product teams
Good to have:
- Experience with Azure Machine Learning
- Python package development
- LLM and prompt engineering experience
- Experience with ML/data science libraries (sklearn, PySpark, pandas, transformers)
8 skills required
Job Details
Job Description
Overview
As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.
Help us push the frontiers of metrics and measurement. Our team focuses on building insights into Microsoft’s AI products. We’re looking for a talented Machine Learning (ML) Engineer to build inference infrastructure to help us understand and improve how people interact with Microsoft’s AI products. Our team is seeking people with deep technical talent, a drive to deliver, and a creative/entrepreneurial spirit.
The ideal candidate has experience in High-Performance Computing (HPC), distributed (batch) inference in machine learning, and/or working with cloud infrastructure.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
By applying to this U.S. New York, New York OR Mountain View, CA OR Redmond, WA , OR Boulder, CO position, you are required to be local to the New York OR San Francisco OR Seattle OR Denver area and in office 3 days a week.
Responsibilities
- Creates pipelines for machine learning, inclusive of data preparation, inference, and integration with downstream systems.
- Comfortable with large scale data processing pipelines to extract business value from user logs.
- Learning about, understanding, and experimenting with the latest LLM capabilities that keep up with your customers.
- Partnering with engineering, product, and leadership teams to create robust client libraries that facilitate large scale inference on user data.
- Driving design and technical strategy decisions based on product needs, customer feedback and best development practices.
- Providing technical leadership and subject matter expertise as you establish and grow best practices for the integration of emerging technology.
- Embodying Microsoft’s culture and values.
- Embody our and
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science, or related technical discipline AND 6 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
- OR equivalent experience.
- Experience with Python, SQL, and/or Spark.
Preferred Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 10 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
- OR Master's Degree in Computer Science or related technical field AND 8 years technical engineering experience with coding in languages including, but not limited to, C, C , C#, Java, or Python
- OR equivalent experience
- Experience with Azure Machine Learning or similar systems, including deployment and monitoring of large-scale pipelines.
- Experience with Python package development.
- Experience with LLMs and prompt engineering.
- Experience with ML and data science libraries such as sklearn, PySpark, pandas, and transformers.
Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
Similar Jobs
ByteDance
San Jose, California, United States (On-Site)
• 3 Months ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Meta
Los Angeles, California, United States (On-Site)
• 3 Months ago
ByteDance
San Jose, California, United States (On-Site)
• 3 Months ago
The Walt Disney Company
New York, New York, United States (On-Site)
• 2 Months ago
Keywords Studios (Player Support)
Pune, Maharashtra, India (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Jobs in New York, New York, United States
Sphere Entertainment Co
Las Vegas, Nevada, United States (On-Site)
• 3 Months ago
The Walt Disney Company
Burbank, California, United States (On-Site)
• 5 Days ago
AGS - American Gaming Systems
Nevada, United States (On-Site)
• 3 Weeks ago
Fliff Inc
Philadelphia, Pennsylvania, United States (On-Site)
• 7 Months ago
Feld Entertainment
Ellenton, Florida, United States (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Artificial Intelligence Jobs
Discord
San Francisco, California, United States (Remote)
• 1 Month ago
Netflix
United States (Remote)
• 3 Months ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 1 Month ago
Ubisoft
Lyon, Auvergne-Rhône-Alpes, France (On-Site)
• 2 Months ago
Meta
New York, New York, United States (On-Site)
• 3 Months ago
Zoox
Foster City, California, United States (Hybrid)
• 4 Months ago
Meta
Pittsburgh, Pennsylvania, United States (On-Site)
• 3 Months ago
Inworld AI
Mountain View, California, United States (On-Site)
• 4 Months ago
ByteDance
Seattle, Washington, United States (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
About The Company
Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
Get notified when new jobs are added by Microsoft
