Member of Technical Staff, AI Pretraining Platform

3 Months ago • All levels • Research Development

Job Summary

Job Description

The Member of Technical Staff, AI Pretraining Platform at Microsoft AI will contribute to building a world-leading pre-training platform for developing cutting-edge AI models. Responsibilities involve designing and developing Python and CUDA/HIP C++ code for distributed training of multimodal LLMs, building and maintaining infrastructure to handle petabytes of data, collaborating with pre-training and post-training teams to optimize data pipelines, and partnering with product teams and researchers to identify model gaps. The role requires expertise in HPC, parallel programming, and experience with pre-training large AI models. This position is crucial for pushing the boundaries of AI model capabilities and powers the consumer Copilot experience.
Must have:
  • Python and CUDA/HIP C++ coding
  • HPC and parallel programming experience
  • Experience with AI model pre-training
  • Building and maintaining large-scale infrastructure
  • Collaborating with cross-functional teams

Job Details

Overview

Help build the world’s most advanced training platform at Microsoft AI 

We are on a mission to create the leading pretraining platform to develop the world’s most capable AI frontier models. This platform will span one of the world’s foremost GPU clusters, pushing the boundaries of scale, performance, and reliability. 

The AI Pre-training Platform team at Microsoft AI is responsible for all aspects of infrastructure including scalability, benchmarking, kernel development, performance optimizations, communications, and fault tolerance to support our model pre-training operations. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models, methods and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience. 

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who: 

  • Are passionate about the infrastructure enabling large-scale AI model training 
  • Will thrive in a highly collaborative, fast-paced environment 
  • Have a high degree of craftsmanship and pay close attention to details 
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies 
  • Effectively manage multiple responsibilities and can adjust to shifting priorities.  

Qualifications

  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work 
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work 
  • OR equivalent experience. 
  • Experience with HPC (High performance computing) and/ or parallel programming.
  • Experience in the area of pretraining
  • Experience working with GPU clusters

 

 

 

#Copilot #MicrosoftAI

Responsibilities

  • Design and develop Python and CUDA/HIP C++ code that enable distributed training of multimodal LLMs ingesting text, audio, images, or video data. 
  • Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models. 
  • Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation. 
  • Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models. 
  • Embody our and . 

Similar Jobs

Aptive - Software Engineer - Camera Specialization

Aptive

Chennai, Tamil Nadu, India (On-Site)
1 Year ago
Epic Games - Senior Network Programmer

Epic Games

Montreal, Quebec, Canada (On-Site)
5 Months ago
legion - Senior Software Engineer, Backend

legion

Bucharest, Bucharest, Romania (Hybrid)
1 Month ago
Electronic Arts - Software Developer II

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
3 Weeks ago
Scanline VFX - Senior Compositor

Scanline VFX

Montreal, Quebec, Canada (Hybrid)
4 Months ago
Take-Two Interactive - Senior Architect II - AI

Take-Two Interactive

Texas, United States (Remote)
2 Weeks ago
Microsoft - Member of Technical Staff, AI Multimodal

Microsoft

London, England, United Kingdom (On-Site)
4 Months ago
Apple - Senior Machine Learning Engineer - Large Language Models (LLMs), Siri Planner Team

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Apple - AIML - Machine Learning Researcher Engineer

Apple

Seattle, Washington, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Staff Software Engineer, MGS - 2XKO

Riot Games

Dublin, County Dublin, Ireland (On-Site)
8 Months ago
Riot Games - Software Engineer - Platform & Tools (Contractor)

Riot Games

Dublin, County Dublin, Ireland (On-Site)
8 Months ago
playrix  - Senior Unity Software Engineer (Gameplay)

playrix

Portugal (Remote)
9 Months ago
bytedance - Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
KingsIsle Entertainment - Build and Tools Software Engineer

KingsIsle Entertainment

Texas, United States (Hybrid)
4 Months ago
warner bros games - Lead Rendering Programmer

warner bros games

London, England, United Kingdom (Hybrid)
5 Months ago
Activision - Principal Online Programmer

Activision

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Ubisoft - Senior C++ Programmer

Ubisoft

Malmö, Skåne County, Sweden (Hybrid)
5 Months ago
Rockstar Games - Senior Technical Artist: Performance Capture

Rockstar Games

Edinburgh, Scotland, United Kingdom (On-Site)
2 Months ago
Glean - Software Engineer, Machine Learning

Glean

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Zürich, Zurich, Switzerland

PwC - Senior Associate - SAP Global Trade Services

PwC

Zürich, Zurich, Switzerland (On-Site)
9 Months ago
IMC - Middle Office Specialist

IMC

Zug, Zug, Switzerland (On-Site)
2 Months ago
PwC - Manager/Senior Manager within EPM Consulting

PwC

Zürich, Zurich, Switzerland (On-Site)
10 Months ago
Sika Group - Civil Engineer ETH/FH as Market Field Developer (Eastern Region) 80 - 100%

Sika Group

Lindau, Zurich, Switzerland (On-Site)
2 Weeks ago
Sonar Source - Software Engineer (Java)

Sonar Source

Geneva, Geneva, Switzerland (On-Site)
4 Days ago
Sonar Source - Lead Cloud Platform Engineer

Sonar Source

Geneva, Geneva, Switzerland (On-Site)
4 Months ago
Saxo Bank - Head of Digital Onboarding and ODD for the Swiss Market

Saxo Bank

Zürich, Zurich, Switzerland (On-Site)
2 Weeks ago
moonee games - Playable Ad Developer

moonee games

Fully, Valais, Switzerland (Remote)
1 Week ago
PwC - Manager / Senior Manager –Technology Strategy & Transformation Consulting

PwC

Zürich, Zurich, Switzerland (On-Site)
10 Months ago
neural concept - IT & Security Innovation Specialist

neural concept

Lausanne, Vaud, Switzerland (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Sharkmob - Principal User Researcher

Sharkmob

Malmö, Skåne County, Sweden (On-Site)
1 Month ago
playrix  - Generative AI Engineer

playrix

Ireland (Remote)
4 Months ago
Alpha Sense - Staff AI Engineer

Alpha Sense

Bengaluru, Karnataka, India (On-Site)
2 Months ago
bytedance - Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

bytedance

Seattle, Washington, United States (On-Site)
9 Months ago
Zscaler - Sr. Staff ML Engineer

Zscaler

San Jose, California, United States (Hybrid)
6 Months ago
cirrus logic - Mixed-Signal CAD/Design Engineer – AI-Driven EDA CAD Development

cirrus logic

Austin, Texas, United States (Hybrid)
1 Month ago
Lilt - Talent Recruitment Manager - AI Data Solutions

Lilt

Buenos Aires, Buenos Aires, Argentina (Remote)
1 Month ago
Unity - Principal Machine Learning Engineer

Unity

San Francisco, California, United States (On-Site)
3 Weeks ago
Dentsu - AI Engineer

Dentsu

Maryland, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Hyderabad, Telangana, India (On-Site)

London, England, United Kingdom (On-Site)

Redmond, Washington, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Redmond, Washington, United States (On-Site)

Hyderabad, Telangana, India (On-Site)

Mountain View, California, United States (Hybrid)

Zürich, Zurich, Switzerland (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug