Software Engineer, Systems ML - Frameworks/Compilers/Kernels

1 Month ago • 3-7 Years • Artificial Intelligence • $70,670 PA - $208,000 PA

Job Summary

Job Description

This Software Engineer role within Meta's MTIA (Meta Training & Inference Accelerator) Software team focuses on developing a high-performance AI compiler strategy. You'll contribute to the PyTorch framework, optimizing deep learning model training and inference on Meta's AI hardware. Responsibilities include developing AI frameworks, compiler stacks, and high-performance kernels; analyzing deep learning networks and implementing compiler optimization algorithms; collaborating with AI researchers; and performing performance tuning and optimization. The role requires expertise in C/C++, AI frameworks, and hardware architectures, with experience in CUDA, OpenMP, OpenCL, or AI accelerator kernel programming preferred.
Must have:
  • Proven C/C++ skills
  • AI framework development experience
  • Deep learning model acceleration
  • Compiler optimization knowledge
Good to have:
  • Experience with PyTorch, TensorFlow
  • CUDA, OpenMP, OpenCL programming
  • MLIR, LLVM, IREE experience
  • System performance optimization
Perks:
  • Bonus
  • Equity
  • Benefits

Job Details

In this role, you will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. MTIA Software Team has been developing a comprehensive AI Compiler strategy that delivers a highly flexible platform to train & serve new DL/ML model architectures, combined with auto-tuned high performance for production environments across specialized hardware architectures. The compiler stack, DL graph optimizations, and kernel authoring for specific hardware, directly impacts performance and deployment velocity of both AI training and inference platforms at Meta. You will be working on one of the core areas such as PyTorch framework components, AI compiler and runtime, high-performance kernels and tooling to accelerate machine learning workloads on the current & next generation of MTIA AI hardware platforms. You will work closely with AI researchers to analyze deep learning models and lower them efficiently on MTIA hardware. You will also partner with hardware design teams to develop compiler optimizations for high performance. You will apply software development best practices to design features, optimization, and performance tuning techniques. You will gain valuable experience in developing machine learning compiler frameworks and will help in driving next generation hardware software codesign for AI domain specific problems.
Software Engineer, Systems ML - Frameworks / Compilers / Kernels Responsibilities
  • Development of SW stack with one of the following core focus areas: AI frameworks, compiler stack, high performance kernel development and acceleration onto next generation of hardware architectures.
  • Contribute to the development of the industry-leading PyTorch AI framework core compilers to support new state of the art inference and training AI hardware accelerators and optimize their performance.
  • Analyze deep learning networks, develop & implement compiler optimization algorithms.
  • Collaborating with AI research scientists to accelerate the next generation of deep learning models such as Recommendation systems, Generative AI, Computer vision, NLP etc.
  • Performance tuning and optimizations of deep learning framework & software components.
Minimum Qualifications
  • Proven C/C++ programming skills
  • Experience in AI framework development or accelerating deep learning models on hardware architectures.
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
Preferred Qualifications
  • A Bachelor's degree in Computer Science, Computer Engineering, relevant technical field and 7+ years of experience in AI framework development or accelerating deep learning models on hardware architectures OR a Master's degree in Computer Science, Computer Engineering, relevant technical field and 4+ years of experience in AI framework development or accelerating deep learning models on hardware architectures OR a PhD in Computer Science Computer Engineering, or relevant technical field and 3+ years of experience in AI framework development or accelerating deep learning models on hardware architectures.
  • Knowledge of GPU, CPU, or AI hardware accelerator architectures.
  • Experience working with frameworks like PyTorch, Caffe2, TensorFlow, ONNX, TensorRT
  • OR AI high performance kernels: Experience with CUDA programming, OpenMP / OpenCL programming or AI hardware accelerator kernel programming. Experience in accelerating libraries on AI hardware, similar to cuBLAS, cuDNN, CUTLASS, HIP, ROCm etc.
  • OR AI Compiler: Experience with compiler optimizations such as loop optimizations, vectorization, parallelization, hardware specific optimizations such as SIMD. Experience with MLIR, LLVM, IREE, XLA, TVM, Halide is a plus.
  • OR AI frameworks: Experience in developing training and inference framework components. Experience in system performance optimizations such as runtime analysis of latency, memory bandwidth, I/O access, compute utilization analysis and associated tooling development.
For those who live in or expect to work from California if hired for this position, please click for additional information.
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$70.67/hour to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about at Meta.


Equal Employment Opportunity
Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the .

Similar Jobs

Games For Love - Mobile Game Production Mentor

Games For Love

Washington, United States (Remote)
2 Months ago
Meta - Software Engineer, Product

Meta

Redmond, Washington, United States (Remote)
6 Months ago
Capgemini - Network Voice

Capgemini

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
Netflix - Character FX Artist

Netflix

Vancouver, British Columbia, Canada (Hybrid)
3 Months ago
IMC - Business Strategist

IMC

Chicago, Illinois, United States (On-Site)
1 Month ago
Google - Senior Staff Research Scientist, Google Cloud AI

Google

San Francisco, California, United States (On-Site)
1 Month ago
Google - Software Engineer III, AI/ML GenAI, Google Cloud Data Management

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
NVIDIA - Senior Software Engineer, TensorRT-LLM

NVIDIA

California, United States (Hybrid)
2 Months ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
9 Months ago
Google - Senior Software Engineer, Distributed Machine Learning

Google

Mountain View, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ubisoft - Technical Art Director

Ubisoft

Montreal, Quebec, Canada (Hybrid)
1 Month ago
Playrix - Lead 2D Animator

Playrix

Ireland (Remote)
3 Months ago
Zynga - Marketing Art Lead

Zynga

London, England, United Kingdom (Hybrid)
1 Month ago
ByteDance - AR Optics Architect - Pico- San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Vigaet - Internship - Computer Graphics Programmer

Vigaet

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Kojima - Level Designer

Kojima

Tokyo, Japan (On-Site)
1 Month ago
Playrix - Lead Unity Software Engineer (Gameplay)

Playrix

Portugal (Remote)
7 Months ago
q games - Programmer

q games

Kyoto, Kyoto, Japan (On-Site)
3 Weeks ago
Fugo Games - 3D Animator

Fugo Games

İstanbul, Türkiye (On-Site)
1 Month ago
Techland - Junior Programmer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Bellevue, Washington, United States

Zoox - Strategic Sourcing Manager - Electrical Components

Zoox

Foster City, California, United States (Hybrid)
7 Months ago
Next Level Business Services - Full Stack Developer

Next Level Business Services

Jersey City, New Jersey, United States (On-Site)
7 Months ago
Hudl - Account Manager

Hudl

Lincoln, Nebraska, United States (On-Site)
2 Weeks ago
Next Level Business Services - Cloud Architect

Next Level Business Services

Jersey City, New Jersey, United States (On-Site)
7 Months ago
Trek - Seasonal Service Technician/Builder

Trek

Columbus, Ohio, United States (On-Site)
4 Months ago
Redhorse Corp - Mid-Level Scrum Master

Redhorse Corp

Falls Church, Virginia, United States (On-Site)
5 Months ago
MIQ Digital - Senior Vice President (SVP) of Product

MIQ Digital

New York, New York, United States (Hybrid)
4 Weeks ago
Crowd Strick - Sr. Financial Analyst

Crowd Strick

Sunnyvale, California, United States (On-Site)
1 Month ago
Kavalirio - EH&S Engineer

Kavalirio

Toney, Alabama, United States (On-Site)
1 Month ago
Adyen - Finance Support Specialist

Adyen

Chicago, Illinois, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

NVIDIA - Senior Solutions Architect, OEM AI

NVIDIA

Texas, United States (Remote)
1 Month ago
Google - Customer Engineer, Applied and Generative AI

Google

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
2 Months ago
Equivalent Jobs - MLOPS ENGINEER

Equivalent Jobs

(Remote)
6 Months ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Vancouver, British Columbia, Canada (Remote)
2 Months ago
Egnyte - Machine Learning Engineer - AI

Egnyte

India (Remote)
2 Months ago
Google - Lead Group Product Manager, Vertex AI Platform Development

Google

Kirkland, Washington, United States (On-Site)
1 Month ago
DraftKings - Technical Business Analyst

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
Zoox - Senior/Staff Software Engineer - Simulation Traffic & Behavior Modeling

Zoox

Seattle, Washington, United States (Hybrid)
7 Months ago
Eleven Labs - Machine Learning Researcher

Eleven Labs

Germany (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.


We want to give people the power to build community and bring the world closer together. To do that, we ask that you help create a safe and respectful online space. These community values encourage constructive conversations on this page:


• Start with an open mind. Whether you agree or disagree, engage with empathy.

• Comments violating our Community Standards will be removed or hidden. So please treat everybody with respect.

• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.

• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.

• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).


For a full listing of our jobs, visit https://www.metacareers.com

Seattle, Washington, United States (On-Site)

Menlo Park, California, United States (On-Site)

Burlingame, California, United States (On-Site)

San Diego, California, United States (Remote)

Burlingame, California, United States (Remote)

United States (Remote)

Washington, District Of Columbia, United States (On-Site)

Los Angeles, California, United States (Remote)

View All Jobs

Get notified when new jobs are added by Meta

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug