Research Scientist Intern, Systems ML - SW/HW Co-Design - Inference

7 Months ago • Upto 1 Years • Research Development

Job Summary

Job Description

Meta is seeking Research Scientist Interns to join our AI & Systems Co-Design HPC & Inference team to drive the definition of our next-generation AI Systems Inference and Training architectures. The team works across HW types (GPUs, ASICs), workload types (Recommendation Models, LLM, LDM) and workloads (Training & Inference). The team drives innovation on: - Low precision Numerics for Training & Inference - ML operator / Kernel optimizations for Training & inference - Inference E2E performance - Model, SW, System, Accelerator - Performance modeling and simulations - HPC Software Optimizations - GPU / ASIC optimizations - Software libraries, models, and frameworks In this role, you will work cross-functionally with internal software and platforms engineering teams to understand the workloads and infrastructure requirements. You will drive technology path-finding, roadmap definition and co-design activities to deliver new capabilities and efficient systems for our fleet. You will also work with external industry partners to influence their roadmaps and build the best products for Meta’s Infrastructure.
Must have:
  • PhD in Computer Science or related STEM field
  • Experience with hardware architecture, compute technologies and/or storage systems
  • Work authorization in the country of employment
Good to have:
  • Track record of achieving results (grants, fellowships, patents, publications)
  • Architectural understanding of CPU, GPU, Accelerators, Networking, systems
  • Experience with large-scale infrastructure, distributed systems
  • Experience developing and debugging in C/C++, Python and/or PyTorch
  • Experience driving original scholarship in collaboration with a team
  • Experience leading a team in solving analytical problems using quantitative approaches
  • Interpersonal experience: cross-group and cross-culture collaboration
  • Experience in theoretical and empirical research and for answering questions with research
  • Experience communicating research for public audiences of peers

Job Details

AI System SW/HW Co-design team’s mission is to explore, develop and help productize high-performance software and hardware technologies for AI at datacenter scale. We achieve this via concurrent design and optimization of many aspects of the system such as models, algorithms, numerics, performance and AI hardware including compute, networking and storage. In essence, we drive the AI HW roadmap at Meta and ensure our existing and future AI workloads and software are well optimized and suited for the hardware infrastructure. Meta is seeking Research Scientist Interns to join our AI & Systems Co-Design HPC & Inference team to drive the definition of our next-generation AI Systems Inference and Training architectures. The team works across HW types (GPUs, ASICs), workload types (Recommendation Models, LLM, LDM) and workloads (Training & Inference). The team drives innovation on: - Low precision Numerics for Training & Inference - ML operator / Kernel optimizations for Training & inference - Inference E2E performance - Model, SW, System, Accelerator - Performance modeling and simulations - HPC Software Optimizations - GPU / ASIC optimizations - Software libraries, models, and frameworks In this role, you will work cross-functionally with internal software and platforms engineering teams to understand the workloads and infrastructure requirements. You will drive technology path-finding, roadmap definition and co-design activities to deliver new capabilities and efficient systems for our fleet. You will also work with external industry partners to influence their roadmaps and build the best products for Meta’s Infrastructure. Join our team and help shape one of the largest infrastructure footprints which powers Meta’s applications used by billions of people across the globe. Our team at Meta AI offers twelve (12) to sixteen (16) weeks long internships and we have various start dates throughout the year. To learn more about our research, visit https://ai.facebook.com.
Research Scientist Intern, Systems ML - SW/HW Co-Design - Inference Responsibilities
  • Develop tools and methodologies for large scale workload analysis and extract representative benchmarks (in C++/Python/Hack) to drive early evaluation of upcoming platforms.
  • Analyze evolving Meta workload trends and business needs to derive requirements for future offerings. Apply in depth knowledge of how the AI/ML systems interact with the compute and storage systems around.
  • Utilize extensive understanding of CPUs (x86/ARM), GPU (Nvidia/AMD/Intel), Collectives and systems to identify bottlenecks and enhance product/service efficiency. Collaborate closely with software developers to re-architect services, improve codebase through algorithm redesign, reduce resource consumption, and identify hardware/software co-design opportunities.
  • Identify industry trends, analyze emerging technologies and disruptive paradigms. Conduct prototyping exercises to quantify the value proposition for Meta and develop adoption plans. Influence vendor hardware roadmap and broader ecosystem to align with Meta's roadmap requirements.
  • Work with Software Services, Product Engineering, and Infrastructure Engineering teams to find the optimal way to deliver the hardware roadmap into production and drive adoption.
Minimum Qualifications
  • Currently has, or is in the process of obtaining, PhD degree in the field of Computer Science or a related STEM field.
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.
  • Experience with hardware architecture, compute technologies and/or storage systems
Preferred Qualifications
  • Intent to return to degree-program after the completion of the internship/co-op.
  • Track record of achieving results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as MICRO, ISCA, HPCA, ASPLOS, ATC, SOSP, OSDI, MLSys or similar.
  • Architectural understanding of CPU, GPU, Accelerators, Networking, systems.
  • Some experience with large-scale infrastructure, distributed systems, full stack analysis of server applications.
  • Experience or knowledge in developing and debugging in C/C++, Python and/or PyTorch.
  • Experience driving original scholarship in collaboration with a team.
  • Experience leading a team in solving analytical problems using quantitative approaches.
  • Interpersonal experience: cross-group and cross-culture collaboration.
  • Experience in theoretical and empirical research and for answering questions with research.
  • Experience communicating research for public audiences of peers.
For those who live in or expect to work from California if hired for this position, please click for additional information.
Locations
Data Center
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$7,800/month to $11,293/month + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about at Meta.


Equal Employment Opportunity and Affirmative Action
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to .

Similar Jobs

Reddit - Senior Software Engineer, Security Partner

Reddit

United States (Remote)
1 Month ago
nord current - Gameplay Programmer

nord current

Vilnius, Vilnius County, Lithuania (On-Site)
8 Months ago
Motorola solutions - Video Analytics - Quality Assurance Automation Lead

Motorola solutions

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
SoftSwiss - Ruby on Rails Developer - Junior/Middle

SoftSwiss

Warsaw, Masovian Voivodeship, Poland (Remote)
4 Weeks ago
bytedance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Unity - Senior Machine Learning/MLOps Engineer

Unity

San Francisco, California, United States (On-Site)
2 Months ago
Ion - Freelance Credit Research Analyst

Ion

London, England, United Kingdom (Remote)
1 Year ago
Ansys - Senior R&D Engineer - HFSS Development

Ansys

Canonsburg, Pennsylvania, United States (On-Site)
1 Month ago
Tencent - NLP Research Intern

Tencent

London, England, United Kingdom (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ion - Oracle Database Administrator, Italy

Ion

Italy (Hybrid)
8 Months ago
Tesla - Senior Wastewater Engineer

Tesla

Brandenburg, Germany (On-Site)
4 Months ago
velotio technologies  - Lead Fullstack Engineer

velotio technologies

Pune, Maharashtra, India (Remote)
1 Week ago
NVIDIA - Senior Hardware Validation Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
NCR Voyix - Hardware Electrical Engineer I

NCR Voyix

Cebu City, Central Visayas, Philippines (On-Site)
3 Weeks ago
Trend Micro - Data Scientist

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Riot Games - Network Engineer III - Infrastructure Reliability

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
zeta - Sr. Site Reliability Engineer

zeta

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Thumbtack - Engineering Manager, Marketplace

Thumbtack

United States (Remote)
1 Month ago
bytedance - Senior Research Scientist, Data Management and Security - Infrastructure System Lab

bytedance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Menlo Park, California, United States

Apple - Audio Algorithm R&D Manager

Apple

Cambridge, Massachusetts, United States (On-Site)
1 Month ago
Corsair - Director Supply Chain Planning

Corsair

Milpitas, California, United States (On-Site)
2 Months ago
Nice - Account Executive, Actimize (Middle Markets)

Nice

United States (Remote)
1 Month ago
Gearbox - Senior Site Reliability Engineer

Gearbox

Frisco, Texas, United States (On-Site)
1 Month ago
Visa - Sr. Manager, Cyber Products

Visa

Ashburn, Virginia, United States (Hybrid)
1 Month ago
Aptive - Sales Account Manager

Aptive

Denver, Colorado, United States (On-Site)
1 Month ago
onwards Search - Senior ServiceNow Developer

onwards Search

Santa Clara, California, United States (Remote)
1 Month ago
Zscaler - Account Executive, Enterprise

Zscaler

Florida, United States (Remote)
1 Month ago
JMA - Contracts and Legal Operations Specialist

JMA

Syracuse, New York, United States (On-Site)
1 Month ago
bytedance - Senior Product Operations Advocate - R&D Tools Direction

bytedance

San Jose, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Trend Micro - Engineer - Threat Research (MITRE)

Trend Micro

Taipei City, Taiwan (On-Site)
1 Month ago
Ansys - Senior R&D Engineer - Astrodynamics/Trajectory Optimization

Ansys

Exton, Pennsylvania, United States (On-Site)
1 Month ago
Apple - Machine Learning Engineer

Apple

New York, New York, United States (On-Site)
1 Month ago
bytedance - High-Performance Computing Research Scientist (Inference Optimization)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
 Many Chat  Inc  - Lead Machine Learning Scientist

Many Chat Inc

Amsterdam, North Holland, Netherlands (Hybrid)
1 Month ago
Synechron - AI Design Architecture

Synechron

Charlotte, North Carolina, United States (On-Site)
1 Month ago
bytedance - Research Scientist/Engineer - Multimodal Interaction & World Model

bytedance

Singapore (On-Site)
7 Months ago
NXP - Internship - AI/ML Verification Framework for Mixed-Signal Systems

NXP

Eindhoven, North Brabant, Netherlands (On-Site)
3 Weeks ago
Adyen - Machine Learning Scientist

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
1 Month ago
London stock Exchange - Senior Research Analyst

London stock Exchange

Shanghai, China (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.


We want to give people the power to build community and bring the world closer together. To do that, we ask that you help create a safe and respectful online space. These community values encourage constructive conversations on this page:


• Start with an open mind. Whether you agree or disagree, engage with empathy.

• Comments violating our Community Standards will be removed or hidden. So please treat everybody with respect.

• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.

• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.

• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).


For a full listing of our jobs, visit https://www.metacareers.com

Seattle, Washington, United States (On-Site)

United States (Remote)

Menlo Park, California, United States (On-Site)

New York, New York, United States (On-Site)

Seattle, Washington, United States (On-Site)

Austin, Texas, United States (On-Site)

Boston, Massachusetts, United States (On-Site)

Menlo Park, California, United States (On-Site)

Bellevue, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Meta

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug