Member of Technical Staff, AI Data

2 Months ago • All levels • Data Analyst

Job Summary

Job Description

Microsoft AI is seeking a Member of Technical Staff to contribute to the creation of the world's most advanced multimodal dataset. This role involves designing and developing data pipelines for massive amounts of multi-modal data (text, audio, images, video), building and maintaining infrastructure to store and process petabytes of data, and collaborating with pre-training and post-training teams to improve data quality. Responsibilities include partnering with product teams and researchers to identify model gaps, ensuring data quality through rigorous experimentation, and contributing to the development of AI models for the consumer Copilot experience. The ideal candidate is passionate about data's role in large-scale AI, thrives in a fast-paced environment, and possesses a high degree of craftsmanship.
Must have:
  • Large-scale data engineering experience (AI focus preferred)
  • Expertise in Spark, Kubernetes, or similar technologies
  • Data pipeline design and development
  • Collaboration with cross-functional teams

Job Details

Job Description

Help build the world’s most advanced multimodal dataset at Microsoft AI 

We are on a mission to create the largest and most advanced multimodal dataset in the world. This dataset, spanning all modalities from across the web and beyond, will power the training of the world’s most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment.  

The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models and products. We work closely with the teams that transform pre-trained models into the models that power the consumer Copilot experience.  

We are looking for outstanding individuals excited about contributing to the next generation of systems that will transform the field. In particular, we are looking for candidates who: 
  • Are passionate about the role of data in large-scale AI model training 
  • Will thrive in a highly collaborative, fast-paced environment 
  • Have a high degree of craftsmanship and pay close attention to details 
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies 
  • Effectively manage multiple responsibilities and can adjust to shifting priorities.  
 
Responsibilities 
  • Design and develop data pipelines that ingest enormous amounts of multi-modal training data (text, audio, images, video). 
  • Build and maintain cutting-edge infrastructure that can store and process the petabytes of data needed to power models. 
  • Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation. 
  • Collaborate with the product team and other engineers and researchers across Microsoft AI to identify gaps in the current generation of models. 
  • Embody our and . 
 
Required/Minimum Qualifications
  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, data modelling or data engineering work 
  • OR equivalent experience.
  • Expertise in large scale data engineering ideally applied to AI
  • Expertise in Spark, Kubernetes or similar. 


Similar Jobs

Wind River - Sr. Engineer - Studio Operator - Technical Support Engineer

Wind River

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Playtika - Senior Data/AI SRE Engineer

Playtika

Ukraine (On-Site)
7 Months ago
Argus Labs - Senior Software Engineer (Infrastructure/Backend)

Argus Labs

(Remote)
2 Months ago
Ness - Principal Architect/Director (Data Streaming & Integration)

Ness

London, England, United Kingdom (Hybrid)
4 Months ago
Sourcegraph - Senior Support Engineer

Sourcegraph

(Remote)
2 Weeks ago
Linden lab - Director, Strategic Insights

Linden lab

San Francisco, California, United States (On-Site)
3 Months ago
bytedance - Data Scientist

bytedance

New York, New York, United States (On-Site)
1 Month ago
GoTo Group - Associate Strategy & Planning (Demand)

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago
Trendyol - Data Science Professionals (Computer Vision & NLP)

Trendyol

Istanbul, İstanbul, Türkiye (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Azra Games - Senior Backend (Data) Engineer

Azra Games

Sacramento, California, United States (Hybrid)
1 Month ago
Zazz - Data Engineer (6–8 Years) Adhoc

Zazz

India (On-Site)
5 Months ago
Tide - Staff Backend Engineer - DevEx

Tide

Bengaluru, Karnataka, India (On-Site)
1 Month ago
bosh group india - 2024_MS_EDE3_XC_SRE_DataEngineering

bosh group india

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Qualcomm - Engineer - CI/CD

Qualcomm

Hyderabad, Telangana, India (On-Site)
5 Days ago
Bragg - Principal AI/ML Engineer

Bragg

Ljubljana, Ljubljana, Slovenia (Hybrid)
1 Month ago
Scale AI - Security Engineer (Infrastructure)

Scale AI

Washington, District Of Columbia, United States (On-Site)
1 Month ago
Penn Interactive - Senior Database Engineer

Penn Interactive

Philadelphia, Pennsylvania, United States (Remote)
1 Month ago
Glean - Designated Technical Support Engineer

Glean

United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in London, England, United Kingdom

Epic Games - Senior UI Engineer, Fortnite

Epic Games

London, England, United Kingdom (On-Site)
1 Month ago
Climax Studios - Technical Designer - Monsters

Climax Studios

London, England, United Kingdom (On-Site)
3 Weeks ago
Kwalee - Junior Product Marketing Manager

Kwalee

Royal Leamington Spa, England, United Kingdom (On-Site)
1 Month ago
Sprinkler - Field Marketing Director - Europe

Sprinkler

London, England, United Kingdom (On-Site)
1 Month ago
Just wont die - Technical Artist

Just wont die

Cambridge, England, United Kingdom (Remote)
3 Weeks ago
WebFX - Copywriter (Digital Marketing & B2B)

WebFX

United Kingdom (Remote)
3 Months ago
Likewise - Content Workflow Administrator

Likewise

Bristol, England, United Kingdom (On-Site)
2 Weeks ago
Interactive Brokers - Legal Counsel - Financial Regulation/Trading

Interactive Brokers

London, England, United Kingdom (Hybrid)
2 Weeks ago
McDonald's Corporation - Cyber Security & Data Manager

McDonald's Corporation

London, England, United Kingdom (Hybrid)
4 Months ago
Maverick Games - Senior Virtual Camera Operator

Maverick Games

Warwick, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

OKX - Data Engineer

OKX

Singapore, Singapore (On-Site)
7 Months ago
PwC - IN-Senior Associate_AWS Data Engineer_Data &Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
The Walt Disney Company - Analyst, Marketing Insights

The Walt Disney Company

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Month ago
Smilegate - Management Strategy Planning

Smilegate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
2 Months ago
GoTo Group - Senior Data Analyst

GoTo Group

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Trek - Business Analyst (Mobile)

Trek

Haryana, India (On-Site)
3 Months ago
Playtika - Expert Business Analyst

Playtika

Israel (On-Site)
1 Month ago
Jam City - Product Manager

Jam City

Montevideo, Montevideo Department, Uruguay (On-Site)
9 Months ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
6 Months ago
Zengame Technology - Advertising Optimization Specialist

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Vancouver, British Columbia, Canada (On-Site)

Mountain View, California, United States (Hybrid)

Shenzhen, Guangdong Province, China (On-Site)

Noida, Uttar Pradesh, India (On-Site)

Redmond, Washington, United States (On-Site)

Paris, Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug