Member of Technical Staff, AI Post-Training
Job Description
- Develop data collection and evaluation methods
- Design experiments for model performance iteration
- Prototype new model features and capabilities
- Collaborate with various teams for model deployment
- Expertise in Post-Training AI Models and techniques (DPO, PPO, RLHF)
Overview
Help us develop and train the cutting-edge models that are served in Copilot.
At Microsoft AI, we are on a mission to develop the most cutting-edge algorithms for post-training large language models (LLMs) and ship those models to millions of users using Copilot every day.
The AI Post-Training team at Microsoft AI is responsible for all aspects of post-training the models that we serve in Copilot, including: data collection, building evaluations that are aligned with our product and model capability goals, prototyping new capabilities to make Copilot more powerful, developing new finetuning algorithms to supercharge our models, working with platform and engineering teams to deploy those models, and closing the loop by improving the models with feedback we receive from our users. We work on the bleeding edge and leverage the most powerful pretrained models and algorithms for our needs. We are an interdisciplinary team of engineers and scientists, learning from each other and collaborating to create the best models and products.
We are looking for outstanding individuals excited about contributing to the next generation of models that will transform the field. We are looking for candidates who:
- Are passionate about shipping models into products that users will love
- Will thrive in a highly collaborative, fast-paced environment
- Have a high degree of craftsmanship and pay close attention to details
- Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies
- Are willing to meaningfully contribute as individuals with multiple responsibilities and can adjust to shifting priorities
Qualifications
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work OR equivalent experience.
- Expertise in the area of Post-Training AI Models and in applying post-training techniques such as DPO, PPO, or RLHF
#Copilot #MicrosoftAI
Responsibilities
- Develop data collection, evaluation, and finetuning methods for models.
- Design hypotheses and experiment plans for rapidly iterating on model performance.
- Prototype new model features and capabilities and collaborate with engineers and researchers across Microsoft AI to make them a reality.
- Collaborate with pretraining and product platform teams to establish good vertical integration and ship models that Copilot users love.
- Embody our culture and values.
