Applied ML Engineer - Inference

2 Months ago • 6 Years + • Research Development • $325,000 PA - $490,000 PA

Job Summary

Job Description

Lambda is seeking an Applied ML Engineer - Inference to join their team. This role involves working on Lambda's Inference service, a large-scale platform for running AI models across thousands of GPUs. Responsibilities include developing new components, integrating with open-source inference platforms like vLLM and sglang, and taking cutting-edge concepts from theory to production. The engineer will collaborate with software and system reliability engineers, as well as the Machine Learning team, to develop innovative offerings and adapt to new models and architectures. The goal is to build a high-throughput, low-latency, globally distributed inference system. The role requires a strong software engineering background with experience in production systems and machine learning inference at scale.
Must have:
  • 6+ years in software engineering, some production systems experience
  • 3+ years in machine learning, inference at scale
  • Familiarity with popular ML models (LLMs, diffusion)
  • Strong Python skills
  • Experience with Go or Rust
  • Desire to move concepts from theory to production
Good to have:
  • Published papers in relevant ML fields
  • Presented talks at ML conferences
  • Hands-on experience with live, streaming inference at scale
Perks:
  • Generous cash & equity compensation
  • Health, dental, and vision coverage
  • Wellness and Commuter stipends
  • 401k Plan with 2% company match
  • Flexible Paid Time Off Plan

Job Details

Lambda is the #1 GPU Cloud for ML/AI teams training, fine-tuning and inferencing AI models, where engineers can easily, securely and affordably build, test and deploy AI products at scale. Lambda’s product portfolio includes on-prem GPU systems, hosted GPUs across public & private clouds and managed inference services – servicing government, researchers, startups and Enterprises world-wide.


If you'd like to build the world's best deep learning cloud, join us. 

*Note: This position requires presence in our San Francisco office location 4 days per week; Lambda’s designated work from home day is currently Tuesday.

What You’ll Do

  • Work on our Inference service, helping us to develop our large-scale platform for running new, cutting-edge models across tens of thousands of GPUs

  • Work with both existing, open-source inference platforms and engines (such as vLLM, sglang, and Dynamo) and also developing new, Lambda-specific components

  • Work with the software and system reliability engineers on our Inference team to take cutting-edge concepts from theory to ultra-reliable production environments

  • Work with our Machine Learning team to bring across research concepts and help develop exciting new offerings and products.

  • Adapt to new models and architectures and help keep Lambda at the forefront of this rapidly-changing part of the industry

  • Help us build a high-throughput, low-latency, all-modes inference system running at globally-distributed scale

You

  • 6+ years experience in software engineering, including at least some experience running public, production systems.

  • 3+ years experience with machine learning, especially of running inference against models at scale (experience in other areas, such as training, is also valuable)

  • Deep familiarity with current popular machine learning models and paradigms, including large language models, diffusion models, and mixture-of-experts architectures.

  • Strong Python programming skills, and experience with either Go or Rust.

  • A strong desire to rapidly take concepts from theory into production 

Nice to Have

  • Have published papers in relevant machine learning fields

  • Have presented talks or posters at machine learning conferences

  • Hands-on experience with running live, streaming inference at scale

Salary Range Information 

Based on market data and other factors, the annual salary range for this position is $325,000-$490,000. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

  • Founded in 2012, ~350 employees (2024) and growing fast

  • We offer generous cash & equity compensation

  • Our investors include Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, US Innovative Technology, Gradient Ventures, Mercato Partners, SVB, 1517, Crescent Cove.

  • We are experiencing extremely high demand for our systems, with quarter over quarter, year over year profitability

  • Our research papers have been accepted into top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG

  • Health, dental, and vision coverage for you and your dependents

  • Wellness and Commuter stipends for select roles

  • 401k Plan with 2% company match (USA employees)

  • Flexible Paid Time Off Plan that we all actually use

A Final Note:

You do not need to match all of the listed expectations to apply for this position. We are committed to building a team with a variety of backgrounds, experiences, and skills.

Equal Opportunity Employer

Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Similar Jobs

Drive mode - Senior DevOps Engineer

Drive mode

Mountain View, California, United States (Hybrid)
3 Months ago
Autodesk - Distinguished Research Scientist, Physics Informed AI

Autodesk

Toronto, Ontario, Canada (On-Site)
2 Months ago
Moloco - Machine Learning Infrastructure Engineer

Moloco

Redwood City, California, United States (On-Site)
1 Month ago
dbt Labs - Staff Software Engineer

dbt Labs

United States (Remote)
1 Month ago
Mozilla - Staff Software Engineer, Desktop Integration

Mozilla

(Remote)
3 Weeks ago
Dentsu - AI Engineer

Dentsu

Maryland, United States (Remote)
2 Months ago
Ansys - Senior R&D Engineer (C++, Qt)

Ansys

Athens, Greece (Hybrid)
3 Months ago
Brillio - Associate Consulting Director — AI

Brillio

Jersey City, New Jersey, United States (On-Site)
3 Weeks ago
GoMotive - Engineering Manager, AI Reliability

GoMotive

Pakistan (Remote)
1 Month ago
Deepgram - Research Scientist - Voice AI Foundations

Deepgram

(Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

dbt Labs - Senior Software Engineer

dbt Labs

Ireland (Remote)
1 Month ago
Marvell - Firmware Developer (Linux, Security, Crypto, HSM, AI)

Marvell

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
rivos - Accelerator DV Testgen

rivos

Santa Clara, California, United States (Hybrid)
1 Year ago
Veeam Software - Backend Engineer

Veeam Software

Seattle, Washington, United States (Remote)
3 Months ago
Mozilla - Senior Software Engineer

Mozilla

Netherlands (Remote)
2 Months ago
LLNL - Operations Research Engineer

LLNL

Livermore, California, United States (On-Site)
1 Month ago
The Walt Disney Company - Sr Software Engineer (Rust Developer)

The Walt Disney Company

New York, New York, United States (On-Site)
9 Months ago
bytedance - Research Scientist Graduate, (AI-Native database systems)- 2026 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
3 Weeks ago
Canonical - Embedded Linux Field Engineering Manager

Canonical

(Remote)
3 Months ago
Zscaler - Director, Software Engineering (Dev/Internal Security/IAM)

Zscaler

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

CGS Carrers - Business Development Associate - Healthcare

CGS Carrers

United States (Remote)
2 Weeks ago
GameChanger - Senior Full Stack Software Engineer, Video Platform

GameChanger

New York, United States (Remote)
2 Months ago
Enverus - Territory Manager

Enverus

Austin, Texas, United States (On-Site)
3 Months ago
Apple - Senior Software Development Engineer in Test (Software Updates)

Apple

San Diego, California, United States (On-Site)
1 Month ago
WebFX - Lead Sales Development Representative (SDR) (Open to Remote or On-Site)

WebFX

Harrisburg, Pennsylvania, United States (Remote)
10 Months ago
zoox - Test Engineer, Manufacturing Test & Diagnostics

zoox

San Carlos, California, United States (On-Site)
2 Weeks ago
Canva - Revenue Accounting Manager, Online Sales

Canva

Los Angeles, California, United States (Remote)
5 Months ago
Toast - Talent Acquisition Partner, Contractor

Toast

United States (Remote)
2 Months ago
Sonar Source - Developer Advocate

Sonar Source

Austin, Texas, United States (Remote)
11 Months ago
Trend Micro - Regional Account Manager

Trend Micro

Houston, Texas, United States (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

ISS Stoxx - Index Specialist – ESG/Sustainability – Research & Development

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
2 Months ago
HP - Senior Machine Learning Researcher, On-Device Optimization

HP

Palo Alto, California, United States (On-Site)
1 Month ago
FICO - Director, Responsible AI Program Governance and Compliance

FICO

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Game freak - R&D Programmer: System [Junior Class]

Game freak

Chiyoda City, Tokyo, Japan (On-Site)
3 Months ago
Cadence - Lead Software Engineer (Agentic AI)

Cadence

Cambridge, England, United Kingdom (Hybrid)
4 Weeks ago
Ion - AI Engineer - Graduate Development Program

Ion

Pisa, Tuscany, Italy (On-Site)
10 Months ago
EMA - Staff Machine Learning Engineer

EMA

Bengaluru, Karnataka, India (On-Site)
2 Months ago
upwork - AI Solutions Builder

upwork

United States (Remote)
3 Weeks ago
Tencent - Research Intern

Tencent

Seoul, South Korea (On-Site)
7 Months ago
broadcom - Principal R&D Engineer, Software

broadcom

Palo Alto, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Lambda

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug