Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

6 Months ago • All levels • Artificial Intelligence • $100,000 PA - $720,000 PA

Job Summary

Job Description

Netflix seeks a Software Engineer to build scalable ML model serving systems for personalization, search, and recommendation experiences. Must have experience with distributed services, online ML inference, and supporting large-scale models. Experience with generative models and LLMs is a plus.
Must have:
  • Distributed Services
  • Online ML Inference
  • Large-scale Models
  • Object-oriented Programming
Good to have:
  • Generative Models
  • LLMs
  • Triton Inference Server
  • TensorRT
Perks:
  • Stock Option Program
  • Flexible Time Off

Job Details

Netflix is one of the world’s leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Role

Machine Learning/Artificial Intelligence powers innovation in all areas of the business, from helping members choose the right title for them through personalization, to better understanding our audience and our content slate, to optimizing our payment processing and other revenue-focused initiatives. Building highly scalable and differentiated ML infrastructure is key to accelerating this innovation.

More recently, fast-paced innovation in large language models (LLMs) has greatly helped advance state-of-the-art technology in many areas of personalization, including search and recommendation experiences. 

The Opportunity

The Model Serving Systems team provides the computational platform on which we build nearly all our consumer and studio-facing ML/AI applications. We provide all the building blocks to serve ML models at scale, including a real-time model inference and serving platform, foundational abstractions that ensure consistency between online and offline systems, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization, we’re building model serving infrastructure for LLMs and other large foundation models. 

We're expanding our model serving systems to meet the evolving needs of the evolving AI landscape. ​​We are looking for strong engineers to develop and expand our compute infrastructure to support the growing AI needs, enable the application of ML in new business areas, and drive ML/AI innovation across Netflix. Our systems power some of Netflix's most business-critical models, and we need you to take our ML/AI initiatives to the next level. You will play a highly cross-functional role, partnering with other engineers, product managers, machine learning engineers, and data/research scientists.

If you have a passion for building scalable, robust systems, are interested in pushing the envelope in applying ML algorithms, and operate in a critical part of the stack that strongly influences what our customers see on their screens, then we want to talk to you.

You may enjoy working with us if:

  • You strive to embrace best practices and are curious about discovering new and better ways to solve problems.

  • You are self-driven and highly motivated to deliver top-tier solutions while learning from and collaborating with Stunning Colleagues.

  • You are strongly motivated to pick up new domains and ship high-quality, extensible code.

  • You are excited to work in a multidisciplinary environment (engineering, algorithms, data engineering/science, product experimentation).

  • You are comfortable working in a team with peers and partners distributed across (US) geographies & time zones.

We would love to work with you if:

  • You have experience building high-traffic distributed services and infrastructure for online ML model inference and are familiar with supporting large-scale ML models focusing on high availability and performance.

  • You understand scalable model-serving solutions for generative models and LLMs, with skills in reducing latency and costs, and can solve bottlenecks to streamline research-to-production workflows.

  • You are proficient in object-oriented programming (preferably Java) and demonstrate engineering excellence in production hosting, including performance tuning, deployment management, and capacity planning.

  • You are familiar with deploying ML models using tools like Triton Inference Server, TensorRT, Docker.

  • You are experienced working with the public cloud like AWS, Azure, or GCP.

  • You are a proactive communicator who promotes best practices in observability and logging. 

  • You have a BS/MS in Computer Science, Applied Math, Engineering, or a related field.

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top-of-market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $100,000 - $720,000K

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs.  Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits .

Netflix has a unique culture and environment.  Learn more

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.

Similar Jobs

Postman - Staff Engineer, Developer Tooling

Postman

Boston, Massachusetts, United States (Hybrid)
1 Day ago
ByteDance - Relational Database Intern

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Next Level Business Services - Angular JS Developer

Next Level Business Services

Milwaukee, Wisconsin, United States (On-Site)
6 Months ago
Trueplay - Java Tech Lead

Trueplay

(Remote)
20 Hours ago
Ness Digital - Kubernetes Architect

Ness Digital

United States (Remote)
3 Weeks ago
NVIDIA - AI Digital Human Development Intern - 2025

NVIDIA

(On-Site)
2 Months ago
Keywords Studios - AI Prompt & Language Specialist (Italian)

Keywords Studios

Quebec, Canada (Remote)
1 Month ago
NVIDIA - Senior Software Engineer - XR

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
Airlab Inc  - C++ & Python Programmer

Airlab Inc

Montreal, Quebec, Canada (On-Site)
9 Months ago
Rackspace Technology - Practice Manager, Data Science, AI and ML

Rackspace Technology

(Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Casumo - Quality Assurance Specialist

Casumo

(Hybrid)
1 Month ago
Google - Software Engineer III, Full Stack, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Glean - Solutions Engineer - East

Glean

(Remote)
5 Months ago
Barracuda Networks  Inc  - Senior Software Engineer

Barracuda Networks Inc

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Software Engineer, Cloud AI, Early Careers

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Tekion Corp - Manager, Machine Learning

Tekion Corp

Bengaluru, Karnataka, India (On-Site)
19 Hours ago
Assystems - Backend Developer – ETL Integration

Assystems

Gurugram, Haryana, India (On-Site)
6 Months ago
Saama Technologies,  Inc  - Senior Software Engineer 1

Saama Technologies, Inc

Chennai, Tamil Nadu, India (On-Site)
4 Months ago
Luxoft - Business Analyst - ION

Luxoft

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ByteDance - Tech Lead Software Engineer- Programming Language (San Jose, CA)

ByteDance

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Trek - Sales Associate

Trek

The Woodlands, Texas, United States (On-Site)
2 Months ago
ByteDance - Senior Innovation UI/UX Designer

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
FORTUNE - Sales Development Representative

FORTUNE

New York, New York, United States (On-Site)
1 Day ago
Blinkhealth - Strategic Operations Manager, Operational Excellence

Blinkhealth

New York, New York, United States (Hybrid)
19 Hours ago
ByteDance - Software Engineer, ML System Scheduling

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Meta - Software Engineer, iOS

Meta

San Francisco, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Lead Software Engineer - Applied AI & Machine Learning

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Weeks ago
Whoop - Staff Electrical Engineer

Whoop

Boston, Massachusetts, United States (On-Site)
1 Month ago
Hawk Eye Innovations - College Sports Systems Technician

Hawk Eye Innovations

Iowa, United States (On-Site)
3 Weeks ago
Anzuio - Account Manager

Anzuio

New York, New York, United States (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Google - Software Engineer III, XBorg, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Days ago
Google - Software Engineer III, Generative AI

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Interface AI - Staff Software Engineer, Backend

Interface AI

United States (Remote)
2 Months ago
Google - Customer Engineer IV, Field CTO

Google

Austin, Texas, United States (On-Site)
1 Week ago
Inworld AI - Product Manager (Technical)

Inworld AI

Mountain View, California, United States (On-Site)
1 Month ago
Meta - Software Engineer, Machine Learning

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
5 Months ago
Google - Senior Staff Software Engineer, BigQuery Generative AI

Google

Kirkland, Washington, United States (On-Site)
2 Days ago
NVIDIA - Engineering Manager, AI Developer Technology

NVIDIA

Austin, Texas, United States (On-Site)
1 Month ago
Google - Lead Group Product Manager, Vertex AI Platform Development

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
HP - AI Lab – ML Engineer, Model Optimization

HP

Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Netflix is one of the world's leading entertainment services with over 247 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

London, England, United Kingdom (On-Site)

Berlin, Berlin, Germany (On-Site)

Milan, Lombardy, Italy (On-Site)

Paris, Île-de-France, France (On-Site)

Seoul, South Korea (On-Site)

Los Angeles, California, United States (On-Site)

Los Gatos, California, United States (On-Site)

Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Netflix

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug