Research Intern - Formal Document Processing

2 Hours ago • Upto 1 Years • Research & Development

About the job

Job Description

Microsoft Research Interns work in a dynamic environment, collaborating with world-class researchers to solve complex challenges using large language models (LLMs). This internship focuses on improving LLM accuracy in document processing by incorporating formal reasoning to reduce errors. Interns will investigate methods to augment statistical processing with logical reasoning. The 12-week program involves mentoring, collaboration, presentation of findings, and contributing to the research community. Interns are expected to be physically present at the Microsoft worksite. Specific tasks include exploring LLM decoding mechanisms, fine-tuning LLMs, and leveraging APIs and local installations. A strong background in formal reasoning, theorem proving, and natural language processing (particularly parsing) is highly beneficial.
Must have:
  • PhD in Computer Science or related field
  • Experience with LLMs
  • Formal reasoning/theorem proving background
  • NLP experience, especially parsing
Good to have:
  • Experience with LLM decoding mechanisms
  • LM fine-tuning experience
  • Experience using LM APIs and local installations
Perks:
  • Industry-leading healthcare
  • Educational resources
  • Product and service discounts
  • Savings and investment programs
  • Maternity and paternity leave
  • Generous time off
  • Giving programs
  • Networking opportunities

Overview

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment.

 

Processing documents, by querying, generating or acting on their content, is one of the most common applications of large language models (LLMs). Although LLMs enable a quantum leap in document processing, they are error prone. We will explore how to augment the statistical processing that LLMs provide with formal (or "logical") reasoning to reduce the error rate.

Qualifications

Required Qualifications

  • Currently enrolled in a PhD program in Computer Science or a related STEM field.

Other Requirements

  • Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
  • In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter. 

Preferred Qualifications

  • Experience interacting directly with the LLM decoding mechanism,e.g., attention heads, key-value cache, VLLM.
  • Experience fine-tuning LMs.
  • Experience using LMs through APIs, and local installations.
  • Background in formal reasoning/theorem proving.
  • Background in natural language processing, esp parsing.

The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.

 

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 

Microsoft accepts applications and processes offers for these roles on an ongoing basis.

 

Responsibilities

Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect
View Full Job Description
$78.6K - $154.6K/yr (Outscal est.)
$116.6K/yr avg.
Redmond, Washington, United States

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Microsoft is a tech giant that develops, licenses, and supports a range of software products, services, and devices.

London, England, United Kingdom (On-Site)

Dublin, County Dublin, Ireland (On-Site)

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)

San José, San José Province, Costa Rica (On-Site)

Prague, Prague, Czechia (On-Site)

View All Jobs

Get notified when new jobs are added by Microsoft

Similar Jobs

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Get notifed when new similar jobs are uploaded

Jobs in Redmond, Washington, United States

Axon - Material Program Planner II (Onsite)

Axon, United States (On-Site)

Inkittt - Senior Product Manager, Monetization

Inkittt, United States (On-Site)

Netflix - Studio Design Director, Game Studio

Netflix, United States (On-Site)

Polygon Labs - Product Marketing Manager (Miden)

Polygon Labs, United States (Remote)

Next Level Business Services - Salesforce Technical Lead

Next Level Business Services, United States (On-Site)

Fluence - Project Controller - Energy Storage

Fluence, United States (On-Site)

Microsoft - Portfolio Planning Manager

Microsoft, United States (Hybrid)

Match Group - Senior Data Scientist (Product Analytics)

Match Group, United States (Hybrid)

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Pattern® - Senior Software Engineer - frontend

Pattern®, India (On-Site)

Rivos - Member of Technical Staff (91839)

Rivos, United States (Hybrid)

Genies - Research Scientist Intern - NLP/ LLM

Genies, United States (Hybrid)

HP - Machine Learning Engineer

HP, United States (On-Site)

Microsoft - STCA Chief Scientist

Microsoft, China (On-Site)

Onsemi - Image Quality & Tuning Engineer

Onsemi, India (On-Site)

Match Group - Staff Software Engineer, Machine Learning

Match Group, United States (Hybrid)

Get notifed when new similar jobs are uploaded