Senior Applied Scientist - Fine Tuning AI

Microsoft 365 Copilot is a groundbreaking productivity tool that leverages the power of large language models, user data, Microsoft Graph, and the web to drive unparalleled creativity and productivity. We are a small, nimble team that is advancing the state of the art of models in M365 Copilot. Come join our team and help transform the LLM experience in the enterprise. 

 
We are seeking candidates with stellar research and system building skills and the desire to pursue the cutting edge in model development that pushes technological boundaries. We are looking for candidates with interest and experience in language model training, reinforcement learning, and supervised fine-tuning. 

We provide a nurturing environment to support passionate researchers and engineers in technology innovation. We seek candidates that excel in deep thinking, advanced development, and fast-paced entrepreneurial execution in a collaborative setting. In this role, you will have the opportunity to work with researchers and engineers at Microsoft to push forward the product roadmap and to impact businesses.   

We firmly believe in building and fostering a diverse and inclusive work environment. We practice open communication and respectful dialogue. We support multiple social and career building opportunities in our team. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Required Qualifications: 

• Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field
• OR equivalent experience.
• Hands on experience training/fine tuning AI/ML models, preferably LLMs/SLMs. 
• Hands on experience building Generative AI pipelines, e.g. with RAG. 
• Proficient with Python and PyTorch. 

Preferred Qualifications:

• Doctorate in Statistics, Econometrics, Computer Science, Electrical
• 1+ year(s) experience creating publications (e.g., patents, peer-reviewed academic papers).
• Experience with reinforcement learning literature and algorithms. 
• Deep knowledge of transformer models and architectures 
• Experience with reinforcement learning algorithms and applications. 

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

#M365CORE

• Train and deploy Language Models adapted to specific industry needs. 
• Create and adapt novel training and fine-tuning algorithms for language models. 
• Identifies, researches, and implements machine learning solutions given product requirements. 
• Brings a research project to successful completion yielding new algorithms, prototypes, theories, tools, methods, analyses, insights, or collections of data which solve one or more open research problems. 
• Document and share best practices across the organization.   
• Supports mentorship by assisting with onboarding of research interns or other entry-level team members. 
• Embody our and .