Research Intern - IMAIS Group: Situated Intelligence and Multimodal Interaction in the Physical World

3 Months ago • 2 Years + • Research & Development • $78,600 PA - $154,560 PA

Job Summary

Job Description

The Interactive Multimodal AI Systems (IMAIS) group at Microsoft Research seeks a Research Intern to work on Situated Intelligence, enabling computers to reason about the physical world at human scale. The internship involves developing and refining multimodal interactive systems using egocentric sensors, analyzing multimodal data, building models from this data, and implementing techniques for computationally modeling social processes (turn-taking, attention, etc.). Responsibilities include working with egocentric sensors and other devices, collecting and analyzing multimodal data, building models, implementing and testing new techniques for modeling social processes, and collaborating with researchers and product development teams. The internship is 12 weeks long, and interns are paired with mentors, present findings, and contribute to the research community.
Must have:
  • PhD in CS or related field
  • 2+ years postgraduate experience with publications
  • 2+ years programming experience with multimodal data
  • 1+ year experience with multimodal ML models or human subject experiments
Good to have:
  • Experience programming multimodal systems interacting with real users (robots/virtual agents)
  • Experience with field research or in-the-wild studies
  • Ability to develop original research agendas
  • Strong collaboration and communication skills
Perks:
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Networking opportunities

Job Details

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

The Interactive Multimodal AI Systems (IMAIS) group at Microsoft Research seeks a Research Intern to work on a project related to Situated Intelligence. The Situated Intelligence research effort aims to enable computers to reason about the physical everyday world, at human scale, and in real time, and fluidly collaborate with people in physical space. Fueled by current advances in perception, large language models, and devices, this emerging computing paradigm will generate within the next decade a new ecosystem of applications, such as systems for mixed-reality task assistance, remote collaboration, educational scenarios, social robots in homes or public spaces, intelligent factory floors, and many more. These systems require computational models for situated communicative processes anchored into reasoning about the physical context. Our work ranges from developing representations (for example, what are key variables for reasoning about turn-taking in a multiparty conversation?) to constructing inference models (for example, which of the surrounding objects is the target of my interlocutor’s attention?) to decision making (for example, should I take an action now?) and all the way to execution (for example, how should I render that action in the world, given the context?).

Qualifications

Required Qualifications

  • Currently enrolled in a PhD program in Computer Science or a related STEM field.
  • At least 2 years of postgraduate experience, including peer-reviewed publications, researching a topic closely related to the above description, such as AI systems for mixed reality, human-robot interaction, embodied conversational agents, multimodal interaction, etc.
  • At least 2 years of programming experience working with multimodal data and/or interactive systems.
  • At least 1 year of experience applying multimodal machine learning models in real-time interactive systems, or at least one year of experience designing, conducting, and analyzing controlled experiments with human subjects.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. 

Preferred Qualifications

  • Demonstrated experience in programming multimodal systems that interact with real human users, e.g., robots or virtual agents, particularly by integrating multiple machine-learned components such as computer vision, speech recognition, dialogue handling, natural language generation, etc.
  • Demonstrated experience in conducting research outside of a controlled lab environment, e.g., field research, ethnography, in-the-wild studies, etc.
  • Demonstrated ability to develop original research agendas.
  • Must be able to collaborate effectively with other researchers and product development teams.
  • Proficient interpersonal skills, cross-group, and cross-culture collaboration.

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 

Microsoft accepts applications and processes offers for these roles on an ongoing basis.

 

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

 

For this Research Internship (summer 2025), our group in Redmond is seeking a PhD student with a passion for research on multimodal, situated interaction topics. Research Intern responsibilities will include (1) helping to develop and refine multimodal interactive systems involving egocentric sensors and other devices, (2) collecting, analyzing, and building models from multimodal data generated by existing systems, and (3) implementing and testing new techniques for computationally modeling social processes like turn-taking, engagement, attention, F-formations, etc.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Similar Jobs

ByteDance - Algorithm Engineer Intern (Multimedia Lab - Video Processing and Enhancement)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Hedra - Full-Stack Engineer

Hedra

San Francisco, California, United States (On-Site)
7 Months ago
Imagineio - Senior Generative AI Engineer

Imagineio

India (Remote)
5 Months ago
PlayStation Global - Machine Learning Engineer for Game Technology

PlayStation Global

Aliso Viejo, California, United States (On-Site)
9 Months ago
Matic Robots - Robotics Production Internship

Matic Robots

Mountain View, California, United States (On-Site)
6 Months ago
Tesla - Associate/Senior/Staff Power Electronic/Electrical Design Engineer

Tesla

Brandenburg, Germany (On-Site)
2 Months ago
Krafton  - [Global Ops & HR Div.] Recruiting Planning/Operation (10~12년)

Krafton

Seoul, South Korea (On-Site)
3 Months ago
NVIDIA - Physical Design Power Optimization Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
Netflix - Systems and Networking Research Intern, Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
NVIDIA - Senior Chip Design Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Magic Leap - Director, Calibration Software

Magic Leap

Sunnyvale, California, United States (Hybrid)
9 Months ago
Trackman - Customer Service Specialist

Trackman

Phoenix, Arizona, United States (On-Site)
1 Month ago
GameChanger  - Senior Cloud Engineer, ML Platform

GameChanger

United States (Remote)
1 Month ago
NVIDIA - Video Data Student

NVIDIA

Ra'anana, Center District, Israel (On-Site)
1 Month ago
ByteDance - Research Engineer, Computer Vision

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Research Scientist, Multimodality

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Activision - Research Associate, Graphics

Activision

Los Angeles, California, United States (On-Site)
1 Month ago
Dolby Laboratories - Senior Computer Vision Researcher

Dolby Laboratories

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Canva - Research Engineering Manager - Image Generation (m/f/x) - Canva Austria

Canva

Vienna, Vienna, Austria (Remote)
5 Months ago
PwC - Consultant expérimenté en IA et Data Science | CDI | H/F

PwC

Toulouse, Occitanie, France (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Xsolla - Outsourcing Producer

Xsolla

Los Angeles, California, United States (Remote)
2 Months ago
Next Level Business Services - Salesforce Veeva Developer

Next Level Business Services

North Chicago, Illinois, United States (On-Site)
6 Months ago
Rackspace Technology - Senior Practice Manager - Data Engineering

Rackspace Technology

California, United States (Remote)
4 Months ago
The Walt Disney Company - Manager, Product Design (Disney +)

The Walt Disney Company

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Scientific Games  - Bench Technician I

Scientific Games

Bismarck, North Dakota, United States (On-Site)
1 Month ago
Super - Staff Software Engineer - Fullstack (Remote!)

Super

Los Angeles, California, United States (Remote)
6 Months ago
Samsung Semiconductor - Staff Engineer, Firmware

Samsung Semiconductor

San Jose, California, United States (Hybrid)
6 Months ago
Netflix - Product Marketing Manager, Programmatic - Ads Marketing

Netflix

California, United States (On-Site)
5 Months ago
Warner Bros Discovery - Senior EVS Operator

Warner Bros Discovery

Atlanta, Georgia, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Layout Design Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Info Stretch - Engineering Lead - ETL Architecture

Info Stretch

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Microsoft - Senior Applied Scientist

Microsoft

(On-Site)
3 Months ago
Tesla - Senior PLC Programmer

Tesla

Prüm, Rhineland-Palatinate, Germany (On-Site)
2 Months ago
Social Discovery Group - Senior business analyst (R&D Growth)

Social Discovery Group

Serbia (Remote)
4 Months ago
Google - Senior Software Engineering Manager, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
3 Months ago
Krafton  - Strategic Planning Manager

Krafton

Seoul, South Korea (On-Site)
2 Months ago
Riot Games - Principal Software Engineer, Gameplay - Teamfight Tactics

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
Capgemini - L3 Developer-Parwana Shahdi

Capgemini

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Fabric - Applied Researcher, Cryptography Proof Systems

Fabric

Chicago, Illinois, United States (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.
View All Jobs

Get notified when new jobs are added by Microsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug