Research Intern - Post-Transformer

1 Month ago • 1 Years + • Research & Development • $78,600 PA - $154,560 PA

Job Summary

Job Description

Microsoft is seeking summer Research Interns to collaborate with machine learning researchers to build the next generation of models beyond transformer architectures, focusing on efficiency and robustness. Interns will explore novel model architectures, develop training strategies, work on post-training alignment and task-specific fine-tuning. The goal is to enhance knowledge abstraction, boost performance, and mitigate vulnerabilities. The 12-week internship involves collaboration with mentors and other researchers, presenting findings, and contributing to the research community. This internship requires a PhD program enrollment (or acceptance) in a related STEM field, at least 1 year of research experience, and peer-reviewed publications. Preferred qualifications include experience with large language model training, post-training alignment, ROCm, and strong communication skills.
Must have:
  • PhD in relevant STEM field
  • 1+ years research experience
  • Peer-reviewed publications
  • Explore novel model architectures
  • Develop training strategies
Good to have:
  • Experience with 7-32B parameter language models
  • Post-training alignment & fine-tuning experience
  • ROCm experience
  • Strong communication skills
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

 is seeking summer Research Interns to collaborate with machine learning researchers across MSR and various product teams to build the next generation of models beyond transformer architectures, with a focus on efficiency and robustness. As a Research Intern, you will explore novel model architectures, develop training strategies, and work on post-training alignment and task-specific fine-tuning. Our goal is to deepen the understanding of model learning dynamics, enhance knowledge abstraction, boost overall performance, and mitigate vulnerabilities such as jailbreaking. 

Qualifications

Required Qualifications

  • Currently enrolled or accepted in a PhD program in Computer Science, Software Engineering, Electrical Engineering, or a related STEM field. 
  • At least 1 year of experience in conducting research and authoring peer-reviewed publications.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. 

Preferred Qualifications

  • Experience in training language models with 7-32B parameters.
  • Experience with post-training alignment and fine-tuning.
  • Experience with ROCm.
  • Proficient written and verbal communication skills.
  • Ability to work in a cross-functional, multi-disciplinary environment across research and product teams.

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 

Microsoft accepts applications and processes offers for these roles on an ongoing basis.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

The Walt Disney Company - Assistant Show Lighting Designer (15-months contract)

The Walt Disney Company

Hong Kong (On-Site)
3 Months ago
Logitech - CX Technical Training Lead Logitech for Business

Logitech

British Columbia, Canada (Remote)
2 Months ago
NVIDIA - Senior Circuit Design Engineer - Power Modeling and Simulation

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Crytek - NOC Linux Specialist (Remote only)

Crytek

(Remote)
1 Month ago
Playtika - TypeScript Technical Lead /Kyiv

Playtika

Ukraine (On-Site)
3 Months ago
NVIDIA - ASIC Verification Engineer - Clocks

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
bosh group india - Circuit Analysis Engineer - Team Lead

bosh group india

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

(On-Site)
3 Months ago
NVIDIA - Signal and Power Integrity Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - Technical Product Manager - AV Simulation

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ION - Technical Support Analyst, Toronto - 4363

ION

Toronto, Ontario, Canada (On-Site)
4 Months ago
CD PROJEKT RED - Senior Programmer, Story

CD PROJEKT RED

Boston, Massachusetts, United States (On-Site)
2 Months ago
CD PROJEKT RED - Offensive Security Engineer, Purple Team

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
5 Days ago
Codeway - Jr. Product Specialist

Codeway

İstanbul, Türkiye (On-Site)
1 Month ago
Virtuos - 3D Environment Artist (Dalat)

Virtuos

Vietnam (On-Site)
4 Months ago
Match Group - Engineering Manager II, Android, Core Experience

Match Group

Los Angeles, California, United States (Hybrid)
4 Months ago
Sorare  - Affiliate Marketing Manager - Paris

Sorare

Paris, Île-de-France, France (Hybrid)
4 Weeks ago
A Thinking Ape - Software Engineer Co-op (May-Aug 2025)

A Thinking Ape

Vancouver, British Columbia, Canada (Remote)
1 Month ago
Crytek - Lead VFX Artist

Crytek

(Remote)
2 Months ago
Techland - QA Engineer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

My Fitness Pal - Food Data Curator (Contractor)

My Fitness Pal

United States (Remote)
4 Weeks ago
Palo Alto Networks - Presales, Prisma Cloud Solutions Architect, Majors

Palo Alto Networks

Chicago, Illinois, United States (Remote)
3 Months ago
Epic Games - Senior Engineer, Patching

Epic Games

United States (On-Site)
1 Month ago
Mattel  Inc  - Sr Development Program Management Associate

Mattel Inc

California, United States (On-Site)
2 Months ago
The Pokemon Company International - Paralegal & Music Administrator

The Pokemon Company International

Bellevue, Washington, United States (Hybrid)
1 Month ago
Fluence - Chief Mechanical Engineer

Fluence

Arlington, Virginia, United States (Hybrid)
4 Months ago
Canva - Corporate Controller

Canva

Los Angeles, California, United States (Remote)
2 Weeks ago
Zoox - Powertrain Systems Integration Internship/Co-Op

Zoox

Foster City, California, United States (On-Site)
4 Months ago
ByteDance - Research Scientist, Applied GAI-Vision

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
AGS - American Gaming Systems - Field Service Technician I

AGS - American Gaming Systems

Nevada, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior Software Engineer - NVLINK NOS

NVIDIA

Santa Clara, California, United States (Hybrid)
1 Month ago
Fabric - Applied Researcher, Cryptography Hardware

Fabric

France (Remote)
4 Months ago
Rec Room - Machine Learning Engineer

Rec Room

United States (Remote)
3 Months ago
Assystems - Sr. HVAC Design Engineer

Assystems

Hyderabad, Telangana, India (On-Site)
3 Months ago
Riot Games - Senior Visual Design Artist - League of Legends, Summoner's Rift Environment

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
ByteDance - RF Hardware Engineer/Architect - Pico- San Jose

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Intel Corporation - Graduate Talent (PDK Development)

Intel Corporation

Penang, Malaysia (On-Site)
3 Months ago
Krafton  - HR (HRM) Manager (5-10 years experience)

Krafton

Seoul, South Korea (On-Site)
2 Weeks ago
NVIDIA - Senior Package Layout Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
Riot Games - Staff Software Engineer - Developer Connections

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

New York, New York, United States (Hybrid)

Mountain View, California, United States (Hybrid)

Mountain View, California, United States (Hybrid)

London, England, United Kingdom (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Mountain View, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug