Member of Technical Staff, AI Data

22 Hours ago • All levels • Data Analyst

Job Summary

Job Description

The Member of Technical Staff, AI Data at Microsoft AI will contribute to building the world's most advanced multimodal dataset. Responsibilities include designing and developing data pipelines for ingesting massive amounts of multimodal data (text, audio, images, video), building and maintaining infrastructure for petabyte-scale data storage and processing, collaborating with pre-training and post-training teams to improve data quality through experimentation, and working with product teams and researchers to identify model gaps. The role requires expertise in data processing technologies, distributed computing tools (Spark, Kubernetes, TensorFlow, Flink, Pyspark), and experience with large-scale data handling. The ideal candidate is passionate about data's role in large-scale AI model training, thrives in fast-paced environments, and possesses strong problem-solving skills.
Must have:
  • Experience with data processing technologies
  • Expertise in distributed computing tools (Spark, Kubernetes, etc.)
  • Experience designing & developing data pipelines for multimodal data
  • Ability to build infrastructure for petabyte-scale data
  • Collaboration with pre-training and post-training teams
Good to have:
  • Experience with petabyte-scale data
  • Experience in ML research or as an ML Engineer/MLOps/SWE

Job Details

Overview

Help build the world’s most advanced multimodal dataset at Microsoft AI.

We are on a mission to create the largest and most advanced multimodal dataset in the world. This dataset, spanning all modalities from across the web and beyond, will power the training of the world’s most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment.  

The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience 

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. In particular, we are looking for candidates who: 

  • Are passionate about the role of data in large-scale AI model training 
  • Will thrive in a highly collaborative, fast-paced environment 
  • Have a high degree of craftsmanship and pay close attention to details 
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies 
  • Effectively manage multiple responsibilities and can adjust to shifting priorities.  

Qualifications

Required/Minimum Qualifications

  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modeling or data engineering work 
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work 
  • OR equivalent experience. 
  • Experience using data processing technologies for Multimodal dataset scalability, parellel processing, data handling, streaming/batch processing, etc.
  • Experience working with distributed computing tools such as; Spark, Kubernetes, TensorFlow, Flink and Pyspark.
  • Experience conducted research in Machine Learning or worked as an ML Engineer/ MLOps/ SWE.
  • Experience designing and developing data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video) AND have the skills to be able to build infrastructure to support this work from ground up.

Preferred:

  • Experience working with large scale of data ideal Petabyte scale or above. 

 

Responsibilities

  • Design and develop data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video). 
  • Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models. 
  • Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation. 
  • Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models. 
  • Embody our and . 

Similar Jobs

Canva - Senior Machine Learning Engineer - Canva UK

Canva

London, England, United Kingdom (Remote)
4 Months ago
Ness Digital - AI/ML Engineer

Ness Digital

Iași, Iași County, Romania (Remote)
3 Weeks ago
Scale AI - Machine Learning Engineer, International Public Sector

Scale AI

United Kingdom (On-Site)
6 Months ago
Bragg - Principal AI/ML Engineer

Bragg

Ljubljana, Ljubljana, Slovenia (Hybrid)
6 Days ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
1 Week ago
Zynga - Data Analyst - Gram Games

Zynga

İstanbul, Türkiye (Hybrid)
3 Months ago
EXUSIA - Data Governance Specialist - Collibra

EXUSIA

Hyderabad, Telangana, India (Remote)
3 Weeks ago
Varonis  - BI Developer

Varonis

United States (On-Site)
4 Months ago
Bungie - Senior Product Security Analyst

Bungie

(Hybrid)
3 Months ago
Miniclip - Senior Data Analyst

Miniclip

London, England, United Kingdom (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (MS)

ByteDance

San Diego, California, United States (On-Site)
5 Months ago
Canva - Staff Machine Learning Engineer - User Voice

Canva

Sydney, New South Wales, Australia (Remote)
1 Week ago
Google - Senior Software Engineer, Generative AI, Google Cloud AI

Google

Sunnyvale, California, United States (On-Site)
19 Hours ago
NVIDIA - Senior Software Engineer - Distributed Inference

NVIDIA

California, United States (Remote)
1 Month ago
Microsoft - Research Intern - AI HW/SW Co-design

Microsoft

Redmond, Washington, United States (On-Site)
1 Day ago
Hedra - Machine Learning Engineer (CUDA)

Hedra

New York, New York, United States (On-Site)
3 Weeks ago
Samsung Semiconductor - Principal Engineer, AI/ML Software Compiler

Samsung Semiconductor

San Jose, California, United States (On-Site)
2 Days ago
PlayStation Global - Staff Machine Learning Engineer, Enterprise Enablement

PlayStation Global

California, United States (On-Site)
3 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
5 Months ago
N-iX - AI Engineer

N-iX

Poland (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Zürich, Zurich, Switzerland

Meta - AI Research Scientist - Generative AI Red Teaming (London or Paris)

Meta

Zürich, Zurich, Switzerland (On-Site)
5 Months ago
PwC - Manager - Insurance Consulting (P&C Retail & Commercial)

PwC

Zürich, Zurich, Switzerland (On-Site)
6 Months ago
PwC - Corporate Tax Manager Zentralschweiz

PwC

Lucerne, Lucerne, Switzerland (On-Site)
6 Months ago
Microsoft - Member of Technical Staff, AI Reinforcement Systems

Microsoft

Zürich, Zurich, Switzerland (On-Site)
1 Day ago
Sonar Source - Enterprise Expansion Representative - DACH

Sonar Source

Geneva, Geneva, Switzerland (On-Site)
5 Months ago
Google - Software Engineering Manager II, Site Reliability Engineering

Google

Zürich, Zurich, Switzerland (On-Site)
19 Hours ago
PwC - Transfer Pricing Manager

PwC

Zürich, Zurich, Switzerland (On-Site)
6 Months ago
PwC - Manager / Senior Manager-ITSM- Technology Strategy & Transformation Consulting

PwC

Zürich, Zurich, Switzerland (On-Site)
3 Months ago
Google - Software Engineer II, User Protections, Core

Google

Zürich, Zurich, Switzerland (On-Site)
18 Hours ago
Tesla - Employee Advisor

Tesla

Zug, Zug, Switzerland (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Hike - Business Analyst

Hike

(Remote)
4 Weeks ago
Google - Product Strategy and Operations Lead

Google

San Francisco, California, United States (On-Site)
20 Hours ago
Netflix - Senior Data Scientist (L5), Games

Netflix

United States (Remote)
1 Day ago
ION - Data Engineer

ION

Budapest, Hungary (On-Site)
6 Months ago
The Walt Disney Company - Senior Product Manager II - Data

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
SciPlay - Data Analyst - Maternity Leave Replacement

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Canva - Senior Accessibility Compliance Analyst

Canva

Auckland, Auckland, New Zealand (Remote)
1 Month ago
N-iX - Senior/Lead Product Owner

N-iX

Ukraine (Remote)
3 Days ago
Egnyte - PLSQL/Celigo Integration Developer

Egnyte

India (Remote)
5 Months ago
ByteDance - Data Analyst - Corporate Information System

ByteDance

Singapore (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Vancouver, British Columbia, Canada (On-Site)

Beijing, Beijing, China (On-Site)

Bengaluru, Karnataka, India (On-Site)

Hyderabad, Telangana, India (Hybrid)

Dublin, County Dublin, Ireland (On-Site)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug