Member of Technical Staff, AI Pretraining Platform

2 Months ago • All levels • Research Development

Job Summary

Job Description

The Member of Technical Staff, AI Pretraining Platform at Microsoft AI will contribute to building a world-leading pre-training platform for developing cutting-edge AI models. Responsibilities involve designing and developing Python and CUDA/HIP C++ code for distributed training of multimodal LLMs, building and maintaining infrastructure to handle petabytes of data, collaborating with pre-training and post-training teams to optimize data pipelines, and partnering with product teams and researchers to identify model gaps. The role requires expertise in HPC, parallel programming, and experience with pre-training large AI models. This position is crucial for pushing the boundaries of AI model capabilities and powers the consumer Copilot experience.
Must have:
  • Python and CUDA/HIP C++ coding
  • HPC and parallel programming experience
  • Experience with AI model pre-training
  • Building and maintaining large-scale infrastructure
  • Collaborating with cross-functional teams

Job Details

Overview

Help build the world’s most advanced training platform at Microsoft AI 

We are on a mission to create the leading pretraining platform to develop the world’s most capable AI frontier models. This platform will span one of the world’s foremost GPU clusters, pushing the boundaries of scale, performance, and reliability. 

The AI Pre-training Platform team at Microsoft AI is responsible for all aspects of infrastructure including scalability, benchmarking, kernel development, performance optimizations, communications, and fault tolerance to support our model pre-training operations. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models, methods and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience. 

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. We are looking for candidates who: 

  • Are passionate about the infrastructure enabling large-scale AI model training 
  • Will thrive in a highly collaborative, fast-paced environment 
  • Have a high degree of craftsmanship and pay close attention to details 
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies 
  • Effectively manage multiple responsibilities and can adjust to shifting priorities.  

Qualifications

  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work 
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work 
  • OR equivalent experience. 
  • Experience with HPC (High performance computing) and/ or parallel programming.
  • Experience in the area of pretraining
  • Experience working with GPU clusters

 

 

 

#Copilot #MicrosoftAI

Responsibilities

  • Design and develop Python and CUDA/HIP C++ code that enable distributed training of multimodal LLMs ingesting text, audio, images, or video data. 
  • Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models. 
  • Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation. 
  • Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models. 
  • Embody our and . 

Similar Jobs

SEGA - Lead / Principal Animation Programmer

SEGA

Horsham, England, United Kingdom (Hybrid)
1 Month ago
Warner Bros Discovery - Senior Game Programmer

Warner Bros Discovery

Knutsford, England, United Kingdom (Hybrid)
1 Month ago
Qualcomm - Senior Digital Design Engineer

Qualcomm

Cambridge, England, United Kingdom (On-Site)
3 Weeks ago
Western Digital - Engineer, Product Design Engineering

Western Digital

Prachin Buri, Thailand (On-Site)
1 Month ago
Tagwiz - Lead Game Developer

Tagwiz

(On-Site)
5 Days ago
oportun - Senior Staff AI Software Engineer

oportun

Mexico (Remote)
1 Month ago
NVIDIA - Deep Learning Engineer, Datacenters

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Brillio - Agentic AI Lead

Brillio

Dallas, Texas, United States (Hybrid)
2 Weeks ago
Airlab Inc  - Artificial Intelligence Researcher

Airlab Inc

Quebec, Canada (On-Site)
3 Months ago
Apple - MacOS Machine Learning Engineer

Apple

Seattle, Washington, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Amazon games  - Software Development Engineer - Generalist

Amazon games

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
Scorewarrior - Core Client Senior C++ Developer

Scorewarrior

Limassol, Limassol, Cyprus (On-Site)
3 Months ago
2tainment - Senior Game Developer

2tainment

Magdeburg, Saxony-Anhalt, Germany (Hybrid)
6 Days ago
Meta - Network Production Engineer, Network Infrastructure

Meta

Menlo Park, California, United States (On-Site)
7 Months ago
Epic Games - Programador(a) de UI

Epic Games

Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
6 Months ago
Google - Software Engineer II, Android Automotive

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Nvizzio Creations - Programmeur(euse) Senior - Unreal

Nvizzio Creations

Québec City, Quebec, Canada (On-Site)
8 Months ago
luxsoft - Junior Embedded C++ Software Developer

luxsoft

Egypt (Remote)
1 Month ago
bytedance - Software Development Engineer Graduate (Intent-based networking) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Epic Games - Senior Tools Programmer, UI Systems

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Zürich, Zurich, Switzerland

GIANTS Software - Tools Programmer

GIANTS Software

Schlieren, Zurich, Switzerland (On-Site)
6 Months ago
extreme network - Country/Sales Manager - Alpine

extreme network

Zürich, Zurich, Switzerland (Remote)
3 Weeks ago
Tesla - Sales Advisor

Tesla

Bern, Canton Of Bern, Switzerland (On-Site)
5 Months ago
Tesla - Senior Business Planning Coordinator

Tesla

Zug, Zug, Switzerland (On-Site)
5 Months ago
The Walt Disney Company - Disney Research Intern

The Walt Disney Company

Zürich, Zurich, Switzerland (On-Site)
8 Months ago
Tesla - Service Advisor

Tesla

Zürich, Zurich, Switzerland (On-Site)
5 Months ago
PwC - Senior Associate - SAP Global Trade Services

PwC

Zürich, Zurich, Switzerland (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Illumina - Technical Applications Scientist

Illumina

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Philips - Senior R&D Project Leader-Pipeline

Philips

Suzhou, Jiangsu, China (On-Site)
1 Month ago
Nice - AI Data Specialist

Nice

Atlanta, Georgia, United States (On-Site)
6 Days ago
Razer - AI Software Engineer

Razer

Singapore (On-Site)
1 Month ago
Unity - Senior Machine Learning Engineer

Unity

San Francisco, California, United States (On-Site)
5 Days ago
London stock Exchange - Research Intern (Vietnamese)

London stock Exchange

Penang, Malaysia (On-Site)
2 Months ago
Token Metrics - AI Prompt Engineer

Token Metrics

Medellín, Antioquia, Colombia (Remote)
7 Months ago
Apple - Machine Learning Engineer, Siri Attention & Invocation

Apple

Seattle, Washington, United States (On-Site)
2 Weeks ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model - Video Generation) - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
8 Months ago
CyberArk - Senior AI Platform Architect

CyberArk

Israel (Hybrid)
4 Days ago

Get notifed when new similar jobs are uploaded

About The Company

United States (On-Site)

Mountain View, California, United States (Hybrid)

Vancouver, British Columbia, Canada (On-Site)

Hyderabad, Telangana, India (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

London, England, United Kingdom (On-Site)

Redmond, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug