Member of Technical Staff, Machine Learning Engineer
Job Summary
Job Description
The Member of Technical Staff - Machine Learning Engineer role at Microsoft focuses on ensuring Copilot's messages adhere to content policies and organizational values. Responsibilities include developing LLM evaluation methods, experimenting with data collection, training content classifiers, iterating on models based on user interactions, monitoring model performance, analyzing user feedback, and generalizing ML solutions. The ideal candidate possesses strong data science and machine learning skills, excellent communication, and a collaborative spirit. They will work within the Technical Safety squad and contribute to building world-class consumer experiences in a fast-paced environment. This position requires working in the office three days a week and is based in Mountain View, CA.
Must have:
- Experience with LLMs
- Production-quality Python code
- Data science experience
- Model iteration & performance monitoring
- User feedback analysis
- ML solution generalization
Good to have:
- Responsible AI interest
6 skills required
Job Details
Job Description
Overview:
As a Member of Technical Staff - Machine Learning, you will work on the Technical Safety squad to ensure that Copilot’s messages comply with content policies and the larger values of the organization. You may be responsible for developing new methods to evaluate LLMs, experimenting with data collection techniques for safety post-training, or training content classifiers to support the Copilot experience. We’re looking for someone with experience in data science and machine learning, but also a strong communicator and great teammate. The right candidate takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
By applying to this U.S. Mountain View, CA position, you are required to be local to the San Francisco area and in office 3 days a week.
Responsibilities:
- Iterate on models and features based on insights from user interactions.
- Experiment with emerging technologies to enhance user-facing features.
- Monitor and improve model performance metrics like accuracy and response time.
- Analyze user feedback to identify areas for improvement in LLM-based features.
- Generalize machine learning (ML) solutions into repeatable frameworks.
- Conduct thorough review of data analysis and techniques used to summarize the process review and highlight areas that have been missed or need reexamining.
- Track advances in industry and academia, identifies relevant state-of-the-art research, and adapts algorithms and/or techniques to drive innovation and develop new solutions.
- Independently write efficient, readable, extensible code and model pipelines.
- Commit to a customer-oriented focus by acknowledging customer needs and perspectives, validating customer perspectives, focusing on broader customer context, and serving as a trusted advisor.
Qualifications:
Required Qualifications:
- Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1 year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
- OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3 years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
- OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5 years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results,
- OR equivalent experience.
- Experience prompting and working with large language models.
- Experience writing production-quality Python code.
Preferred Qualifications:
- Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 8 years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
- OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 10 years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
- OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 12 years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
- OR equivalent experience.
- Demonstrated interest in Responsible AI.
Data Science IC4 - The typical base pay range for this role across the U.S. is USD $117,200 - $229,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $153,600 - $250,200 per year.
Data Science IC5 - The typical base pay range for this role across the U.S. is USD $137,600 - $267,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $180,400 - $294,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
Microsoft will accept applications and processes offers for these roles on an ongoing basis.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the .
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
#copilot
Similar Jobs
Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
Microsoft
Redmond, Washington, United States (On-Site)
• 1 Month ago
Epic Games
London, England, United Kingdom (On-Site)
• 1 Month ago
ByteDance
San Jose, California, United States (On-Site)
• 6 Months ago
Netflix
Los Angeles, California, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
PlayStation Global
San Mateo, California, United States (On-Site)
• 1 Month ago
Inkittt
Krakow Am See, Mecklenburg-Vorpommern, Germany (Hybrid)
• 2 Months ago
ByteDance
Seattle, Washington, United States (On-Site)
• 6 Months ago
Meta
Menlo Park, California, United States (On-Site)
• 6 Months ago
Dublin, County Dublin, Ireland (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Mountain View, California, United States
NVIDIA
Santa Clara, California, United States (On-Site)
• 1 Month ago
Netflix
Los Angeles, California, United States (On-Site)
• 1 Month ago
PlayStation Global
Carlsbad, California, United States (On-Site)
• 1 Month ago
NVIDIA
Santa Clara, California, United States (On-Site)
• 1 Month ago
Next Level Business Services
San Jose, California, United States (On-Site)
• 7 Months ago
Tap Nation
New York, New York, United States (Remote)
• 4 Months ago
Snail Games
Beverly Hills, California, United States (On-Site)
• 6 Months ago
Rivos
Santa Clara, California, United States (On-Site)
• 7 Months ago
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
PwC
Kolkata, West Bengal, India (On-Site)
• 7 Months ago
Aristocrat Gaming
London, England, United Kingdom (Hybrid)
• 6 Months ago
SLAY
Berlin, Berlin, Germany (On-Site)
• 2 Months ago
Inkittt
Krakow Am See, Mecklenburg-Vorpommern, Germany (Hybrid)
• 6 Months ago
Get notifed when new similar jobs are uploaded
About The Company
Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
Get notified when new jobs are added by Microsoft
