Research Intern - Post-Transformer

3 Months ago • 1 Years + • Research & Development • $78,600 PA - $154,560 PA

Job Summary

Job Description

Microsoft is seeking summer Research Interns to collaborate with machine learning researchers to build the next generation of models beyond transformer architectures, focusing on efficiency and robustness. Interns will explore novel model architectures, develop training strategies, work on post-training alignment and task-specific fine-tuning. The goal is to enhance knowledge abstraction, boost performance, and mitigate vulnerabilities. The 12-week internship involves collaboration with mentors and other researchers, presenting findings, and contributing to the research community. This internship requires a PhD program enrollment (or acceptance) in a related STEM field, at least 1 year of research experience, and peer-reviewed publications. Preferred qualifications include experience with large language model training, post-training alignment, ROCm, and strong communication skills.
Must have:
  • PhD in relevant STEM field
  • 1+ years research experience
  • Peer-reviewed publications
  • Explore novel model architectures
  • Develop training strategies
Good to have:
  • Experience with 7-32B parameter language models
  • Post-training alignment & fine-tuning experience
  • ROCm experience
  • Strong communication skills
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

 is seeking summer Research Interns to collaborate with machine learning researchers across MSR and various product teams to build the next generation of models beyond transformer architectures, with a focus on efficiency and robustness. As a Research Intern, you will explore novel model architectures, develop training strategies, and work on post-training alignment and task-specific fine-tuning. Our goal is to deepen the understanding of model learning dynamics, enhance knowledge abstraction, boost overall performance, and mitigate vulnerabilities such as jailbreaking. 

Qualifications

Required Qualifications

  • Currently enrolled or accepted in a PhD program in Computer Science, Software Engineering, Electrical Engineering, or a related STEM field. 
  • At least 1 year of experience in conducting research and authoring peer-reviewed publications.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. 

Preferred Qualifications

  • Experience in training language models with 7-32B parameters.
  • Experience with post-training alignment and fine-tuning.
  • Experience with ROCm.
  • Proficient written and verbal communication skills.
  • Ability to work in a cross-functional, multi-disciplinary environment across research and product teams.

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 

Microsoft accepts applications and processes offers for these roles on an ongoing basis.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

Playtika - TypeScript Technical Lead /Kyiv

Playtika

Ukraine (On-Site)
5 Months ago
Playtika - Incident Engineer

Playtika

Poland (Hybrid)
3 Months ago
Universal Music - Executive Assistant

Universal Music

Los Angeles, California, United States (On-Site)
2 Months ago
Universal Music - Coordinator, Royalties

Universal Music

California, United States (Remote)
2 Months ago
Luxoft - Murex Front Office Consultant - Structured Products

Luxoft

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
5 Months ago
ByteDance - CPU Application Platform Engineer Intern (Server Platform)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Netflix - Machine Learning Software Engineer (L5) - Content and Studio

Netflix

United States (Remote)
1 Month ago
Microsoft - Senior Verification Engineer

Microsoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Tesla - PLC Programmer

Tesla

Neutraubling, Bavaria, Germany (On-Site)
2 Months ago
Krafton  - [Corporate Brand Div.] Brand Strategy Senior Manager (5년 ~ 10년)

Krafton

Seoul, South Korea (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playgendary - Lead Motion Designer

Playgendary

Limassol, Limassol, Cyprus (Remote)
2 Months ago
Teesta Investment   - Senior Software Engineer

Teesta Investment

Kolkata, West Bengal, India (On-Site)
7 Months ago
Playtika - TypeScript Technical Lead /Kyiv

Playtika

Ukraine (On-Site)
5 Months ago
NVIDIA - Silicon Performance, Power and Binning Tools Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Capcom - Communications Intern

Capcom

California, United States (Hybrid)
4 Months ago
Universal Music - Director, Commercial Marketing

Universal Music

Beverly Hills, California, United States (On-Site)
1 Month ago
G5 Games - Game Systems Designer

G5 Games

Limassol, Limassol, Cyprus (Remote)
4 Months ago
CD PROJEKT RED - Physics Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
8 Months ago
Intel Corporation - Quality and Reliability Engineer

Intel Corporation

San José, San José Province, Costa Rica (On-Site)
3 Months ago
CD PROJEKT RED - Senior Cinematic Animator

CD PROJEKT RED

Boston, Massachusetts, United States (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

The Walt Disney Company - Lead Media Systems Engineer

The Walt Disney Company

Los Angeles, California, United States (On-Site)
2 Months ago
Nintendo - CONTRACT - Experiential Marketing Specialist

Nintendo

Redmond, Washington, United States (Hybrid)
4 Months ago
CD PROJEKT RED - Senior Events and Communications Specialist

CD PROJEKT RED

Boston, Massachusetts, United States (On-Site)
2 Months ago
Xsolla - Assistant Controller

Xsolla

Los Angeles, California, United States (Hybrid)
6 Months ago
Niantic - Emerging Markets Manager, LATAM

Niantic

San Francisco, California, United States (Hybrid)
4 Months ago
PlayStation Global - Senior Manager, Creative - Global Licensed Merchandise

PlayStation Global

United States (Hybrid)
2 Months ago
The Walt Disney Company - Culinary Cook 1 (Advanced Line Cook)

The Walt Disney Company

Florida, United States (On-Site)
2 Months ago
The Walt Disney Company - DLR Operations Coordinator

The Walt Disney Company

Anaheim, California, United States (On-Site)
2 Months ago
Crunchyroll - Software Engineer III

Crunchyroll

San Francisco, California, United States (On-Site)
2 Months ago
Onward Search - Java Developer III

Onward Search

New York, New York, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Software Engineering Intern, Autonomous Vehicles (RDSS)

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
ByteDance - Research Scientist- Foundation Model, Vision and Language

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Tesla - Electrical Engineering Standardization / Administrator CAE

Tesla

Prüm, Rhineland-Palatinate, Germany (On-Site)
2 Months ago
Riot Games - Executive Recruiting Partner

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
NVIDIA - Senior Math Libraries Engineer – AI and HPC

NVIDIA

Santa Clara, California, United States (Remote)
2 Months ago
Regent Craft - Propulsion Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
6 Months ago
NVIDIA - VLSI Integration Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
3 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
5 Months ago
Tesla - Mechanical Assembly Team Lead

Tesla

Rhineland-Palatinate, Germany (On-Site)
2 Months ago
Tesla - PLC Programmer

Tesla

Rhineland-Palatinate, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug