Member of Technical Staff, AI Data

2 Months ago • All levels • Research Development

Job Summary

Job Description

The Member of Technical Staff, AI Data at Microsoft AI will contribute to building the world's most advanced multimodal dataset. Responsibilities include designing and developing data pipelines for ingesting massive amounts of multimodal data (text, audio, images, video), building and maintaining infrastructure for petabyte-scale data storage and processing, collaborating with pre-training and post-training teams to improve data quality through experimentation, and working with product teams and researchers to identify model gaps. The role requires expertise in data processing technologies, distributed computing tools (Spark, Kubernetes, TensorFlow, Flink, Pyspark), and experience with large-scale data handling. The ideal candidate is passionate about data's role in large-scale AI model training, thrives in fast-paced environments, and possesses strong problem-solving skills.
Must have:
  • Experience with data processing technologies
  • Expertise in distributed computing tools (Spark, Kubernetes, etc.)
  • Experience designing & developing data pipelines for multimodal data
  • Ability to build infrastructure for petabyte-scale data
  • Collaboration with pre-training and post-training teams
Good to have:
  • Experience with petabyte-scale data
  • Experience in ML research or as an ML Engineer/MLOps/SWE

Job Details

Overview

Help build the world’s most advanced multimodal dataset at Microsoft AI.

We are on a mission to create the largest and most advanced multimodal dataset in the world. This dataset, spanning all modalities from across the web and beyond, will power the training of the world’s most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment.  

The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience 

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. In particular, we are looking for candidates who: 

  • Are passionate about the role of data in large-scale AI model training 
  • Will thrive in a highly collaborative, fast-paced environment 
  • Have a high degree of craftsmanship and pay close attention to details 
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies 
  • Effectively manage multiple responsibilities and can adjust to shifting priorities.  

Qualifications

Required/Minimum Qualifications

  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work 
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work 
  • OR equivalent experience. 
  • Experience using data processing technologies for Multimodal dataset scalability, parellel processing, data handling, streaming/batch processing, etc.
  • Experience working with distributed computing tools such as; Spark, Kubernetes, TensorFlow, Flink and Pyspark.
  • Experience conducted research in Machine Learning or worked as an ML Engineer/ MLOps/ SWE.
  • Experience designing and developing data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video) AND have the skills to be able to build infrastructure to support this work from ground up.

Preferred:

  • Experience working with large scale of data ideal Petabyte scale or above. 

 

Responsibilities

  • Design and develop data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video). 
  • Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models. 
  • Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation. 
  • Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models. 
  • Embody our and . 

Similar Jobs

OKX - (Senior/Principal) Product Manager, Blockchain Explorer

OKX

Singapore, Singapore (On-Site)
8 Months ago
PwC - Risk Assurance Services - Associate

PwC

Port Of Spain, Port Of Spain Corporation, Trinidad And Tobago (On-Site)
4 Weeks ago
Daybreak - Business Intelligence Engineer

Daybreak

San Diego, California, United States (Hybrid)
2 Months ago
cirrus logic - Senior Human Resources Business Partner

cirrus logic

Austin, Texas, United States (Hybrid)
1 Month ago
Avercareers - Power Platform Developer

Avercareers

United States (On-Site)
1 Month ago
Cadence - Intern: Software Engineering - Verisium Debug R&D

Cadence

Brazil (On-Site)
1 Month ago
Sony Interactive Entertainment - Learning & Development Specialist (AI Talent Development & Training Program Lead)

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
3 Months ago
Unity - Senior Machine Learning Developer

Unity

Montreal, Quebec, Canada (Remote)
3 Days ago
Super.com - AI Lead

Super.com

(Remote)
1 Month ago
Zynga - Principal Machine Learning Engineer

Zynga

Austin, Texas, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Dentsu - Data & Analytics Strategy Specialist

Dentsu

Taipei City, Taiwan (On-Site)
3 Weeks ago
Yodlee - Technical Architect - Credit & Analytics Domain

Yodlee

Raleigh, North Carolina, United States (Remote)
2 Months ago
SparkCognition - Senior DevOps Engineer

SparkCognition

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Vimeo - Web Platform Operations Contractor

Vimeo

New York, New York, United States (On-Site)
2 Months ago
Philips - Senior Analyst, Sales Compensation Design

Philips

Plymouth, Minnesota, United States (On-Site)
2 Months ago
Tesla - Supply Chain Program Manager

Tesla

Brandenburg, Germany (On-Site)
5 Months ago
Zones - Storage and Datacentre Solution Architect

Zones

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Poppulo - Marketing Automation Analyst

Poppulo

Bengaluru, Karnataka, India (Hybrid)
3 Days ago
FICO - Software Engineering - Senior Engineer

FICO

Bozeman, Montana, United States (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Jobs in Zürich, Zurich, Switzerland

The Walt Disney Company - Disney Research Intern

The Walt Disney Company

Zürich, Zurich, Switzerland (On-Site)
8 Months ago
Sonar Source - Senior Software Engineer (Python)

Sonar Source

Geneva, Geneva, Switzerland (Hybrid)
3 Months ago
Haleon - Process Safety Specialist

Haleon

Nyon, Vaud, Switzerland (On-Site)
1 Month ago
Niantic - Senior Software Engineer, Security

Niantic

Zürich, Zurich, Switzerland (Hybrid)
3 Months ago
GIANTS Software - Tools Programmer

GIANTS Software

Schlieren, Zurich, Switzerland (On-Site)
6 Months ago
Dentsu - Principal Consultant Banking and Insurance

Dentsu

Geneva, Geneva, Switzerland (Hybrid)
1 Month ago
Haleon - Outbound Operations Planner

Haleon

Nyon, Vaud, Switzerland (On-Site)
3 Weeks ago
GIANTS Software - Tools Programmer

GIANTS Software

Zürich, Zurich, Switzerland (On-Site)
6 Months ago
PwC - Aktuar/-in – Manager/Senior Manager Nichtleben – Actuarial Services

PwC

Zürich, Zurich, Switzerland (On-Site)
9 Months ago
Thales - System Integration & Test Engineer

Thales

Bern, Canton Of Bern, Switzerland (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Epic Games - Machine Learning Engineer

Epic Games

London, England, United Kingdom (On-Site)
3 Months ago
Riot Games - Research Operation Coordinator - Global Research Operations Team (Contract)

Riot Games

Shanghai, Shanghai, China (On-Site)
2 Months ago
Marks, part of SGS & Co - AI Creative Technologist

Marks, part of SGS & Co

Toronto, Ontario, Canada (On-Site)
3 Weeks ago
Game freak - R&D Programmer: Library

Game freak

Chiyoda City, Tokyo, Japan (On-Site)
1 Month ago
Scale AI - AI Strategy Consultant, Frontier Tech

Scale AI

San Francisco, California, United States (Remote)
2 Months ago
Apple - ML Engineer - Generative AI, Siri Agent Modeling

Apple

Sunnyvale, California, United States (On-Site)
2 Months ago
Yahoo - Senior ML/AI Engineer

Yahoo

United States (Hybrid)
3 Weeks ago
Google - Student Researcher, BS/MS, Winter/Summer 2025

Google

Mountain View, California, United States (On-Site)
8 Months ago
zoox - Senior AI Developer Productivity Engineer

zoox

Foster City, California, United States (On-Site)
5 Months ago
sony global (Games) - Research Intern on Generative AI for Content Creation

sony global (Games)

New York, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

United States (On-Site)

Mountain View, California, United States (Hybrid)

Vancouver, British Columbia, Canada (On-Site)

California, United States (On-Site)

Hyderabad, Telangana, India (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug