Research Intern - Memory & Orchestration in Large Language Models

3 Months ago • Upto 1 Years • Research & Development • Artificial Intelligence • $78,600 PA - $154,560 PA

Job Summary

Job Description

Microsoft's Societal Resilience team seeks Research Interns to advance AI capabilities in large language models (LLMs) and multimodal models. The internship focuses on memory and orchestration within these models, involving developing new embedding methods (graph and multimodal), creating advanced RAG systems, and conducting context-specific fine-tuning. Interns will conduct hands-on research, investigate embedding techniques, develop RAG systems, specialize in context-specific fine-tuning, and collaborate with interdisciplinary teams. The 12-week internship includes mentorship, collaboration, presentation of findings, and contributions to the research community. The research aims to build more resilient and adaptive AI systems.
Must have:
  • PhD in relevant STEM field
  • Experience with LLMs and multimodal models
  • Strong Python programming skills
  • Familiarity with AI/ML frameworks
  • Conducting hands-on research
Good to have:
  • Experience with graph and multimodal embeddings
  • Familiarity with generative model architectures
  • Experience building RAG systems
  • Experience publishing research
  • Experience in interdisciplinary teams
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment. 

 

Our Societal Resilience team is seeking Research Interns to join us in pushing the boundaries of AI capabilities with large language models (LLMs) and multimodal models. Our mission is to prepare for the unknown challenges of the future by developing resilient systems and technologies that can support societal and individual resilience during times of crisis. 

 

The research focuses on memory and orchestration within LLMs and multimodal models. We are particularly interested in developing new methods for leveraging and training various types of embeddings, such as graph embeddings and multimodal embeddings, creating advanced retrieval augmented generation (RAG) systems, and conducting specialized context-specific fine-tuning to build more capable and adaptive models. We believe that these capabilities will play a critical role in building resilience by amplifying the ability of individuals and organizations to respond to uncertainty. 

Qualifications

Required Qualifications

  • Currently enrolled in a PhD program in Computer Science, Machine Learning, Artificial Intelligence, or a related STEM field. 

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. 

Preferred Qualifications

  • Experience with large language models and multimodal models, including training and fine-tuning. 
  • Familiarity with embeddings, including graph embeddings and multimodal embeddings.
  • Familiarity with the architecture of generative models, such as variational autoencoders and diffusion models.
  • Experience building and deploying retrieval augmented generation systems. 
  • Experience working in interdisciplinary teams, with a focus on AI research and development. 
  • Strong programming skills in Python and familiarity with AI/ML frameworks such as PyTorch or TensorFlow. 
  • Previous experience publishing academic research in top-tier conferences or journals. 

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 

Microsoft accepts applications and processes offers for these roles on an ongoing basis.

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Additional Responsibilities

  • Conducting hands-on research into systems for memory and orchestration of LLMs and multimodal models. 
  • Investigating new embedding techniques, including graph embeddings and multimodal embeddings. 
  • Developing advanced retrieval augmented generation systems to enhance LLM capabilities. 
  • Specializing in context-specific fine-tuning for creating adaptable AI systems. 
  • Collaborating with interdisciplinary teams of researchers and engineers on challenging and impactful projects. 
  • Presenting research findings and participating in research discussions. 
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

ByteDance - Senior Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Arrise Solutions (India)   - Lead ML Engineer

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
7 Months ago
Salesforce - Principal Data Scientist

Salesforce

Palo Alto, California, United States (On-Site)
5 Months ago
ByteDance - AI Security Researcher - Security - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Canva - Staff Machine Learning Engineer - User Voice

Canva

Perth, Western Australia, Australia (Remote)
6 Months ago
Backbone - Lead Electrical Engineer

Backbone

Atherton, California, United States (Hybrid)
9 Months ago
NVIDIA - Interconnect Hardware Test Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
Meta - Research Scientist, NLP, GenAI (PhD)

Meta

Paris, Île-de-France, France (On-Site)
5 Months ago
ByteDance - Software Engineer Intern (Applied Machine Learning) - 2025 Summer/Fall (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Skydio - Flight Test Operator - Flight Core and Hardware Validation

Skydio

San Mateo, California, United States (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
3 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Sausalito, California, United States (On-Site)
5 Months ago
Linden Lab - Senior Software Engineer, Mobile

Linden Lab

San Francisco, California, United States (On-Site)
6 Months ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
NetEase Games - Senior AI Engineer (Asset Creation)

NetEase Games

(Remote)
3 Months ago
Rackspace Technology - ML/LLM Ops Intern

Rackspace Technology

Mexico City, Mexico City, Mexico (Remote)
2 Months ago
NVIDIA - Senior Software Engineer - Triton Tools

NVIDIA

California, United States (Remote)
3 Months ago
Arkose Labs - Senior Machine Learning Researcher

Arkose Labs

Pune, Maharashtra, India (Hybrid)
6 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Bungie - Marathon Activities Senior Design Lead

Bungie

United States (Hybrid)
1 Month ago
Next Level Business Services - Project Manager with mobility

Next Level Business Services

Schenectady, New York, United States (On-Site)
5 Months ago
The Walt Disney Company - Senior Product Manager II

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
The Walt Disney Company - Security Officer

The Walt Disney Company

New York, New York, United States (On-Site)
2 Months ago
Daybreak Game Company LLC - Business Intelligence Engineer

Daybreak Game Company LLC

San Diego, California, United States (Hybrid)
2 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
5 Months ago
Epic Games - Senior Policy Manager, Trust & Safety

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Varonis  - Product Security GRC

Varonis

Morrisville, North Carolina, United States (On-Site)
6 Months ago
Beghou Consulting - Manager, Commercial Operations & Analytics

Beghou Consulting

Evanston, Illinois, United States (Hybrid)
6 Months ago
The Walt Disney Company - Asset Protection Agent - Part Time

The Walt Disney Company

New York, New York, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Krafton  - [Deep Learning Div.] Deep Learning Engineer - ML (1년 ~ 3년)

Krafton

Seoul, South Korea (On-Site)
4 Months ago
ByteDance - Software Development Engineer - Large Language Models, AML

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal and Analog Circuit Designer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
NVIDIA - Senior SRAM Engineer, Circuit Design

NVIDIA

Austin, Texas, United States (Hybrid)
2 Months ago
NVIDIA - Senior Formal Verification Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago
Google - Senior Staff Software Engineer, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
5 Months ago
Riot Games - Staff Software Engineer (UI) - League of Legends

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
Valeo - Management Controller

Valeo

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Krafton  - [Audio Dept.] Sr. Audio Engineer (7년 이상)

Krafton

(On-Site)
5 Months ago
Microsoft - Research Intern - Maia-100 - AI Kernel Fusion

Microsoft

Redmond, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug