Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

5 Months ago • All levels • Artificial Intelligence • $100,000 PA - $720,000 PA

Job Summary

Job Description

Netflix seeks a Software Engineer to build scalable ML model serving systems for personalization, search, and recommendation experiences. Must have experience with distributed services, online ML inference, and supporting large-scale models. Experience with generative models and LLMs is a plus.
Must have:
  • Distributed Services
  • Online ML Inference
  • Large-scale Models
  • Object-oriented Programming
Good to have:
  • Generative Models
  • LLMs
  • Triton Inference Server
  • TensorRT
Perks:
  • Stock Option Program
  • Flexible Time Off

Job Details

Netflix is one of the world’s leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Role

Machine Learning/Artificial Intelligence powers innovation in all areas of the business, from helping members choose the right title for them through personalization, to better understanding our audience and our content slate, to optimizing our payment processing and other revenue-focused initiatives. Building highly scalable and differentiated ML infrastructure is key to accelerating this innovation.

More recently, fast-paced innovation in large language models (LLMs) has greatly helped advance state-of-the-art technology in many areas of personalization, including search and recommendation experiences. 

The Opportunity

The Model Serving Systems team provides the computational platform on which we build nearly all our consumer and studio-facing ML/AI applications. We provide all the building blocks to serve ML models at scale, including a real-time model inference and serving platform, foundational abstractions that ensure consistency between online and offline systems, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization, we’re building model serving infrastructure for LLMs and other large foundation models. 

We're expanding our model serving systems to meet the evolving needs of the evolving AI landscape. ​​We are looking for strong engineers to develop and expand our compute infrastructure to support the growing AI needs, enable the application of ML in new business areas, and drive ML/AI innovation across Netflix. Our systems power some of Netflix's most business-critical models, and we need you to take our ML/AI initiatives to the next level. You will play a highly cross-functional role, partnering with other engineers, product managers, machine learning engineers, and data/research scientists.

If you have a passion for building scalable, robust systems, are interested in pushing the envelope in applying ML algorithms, and operate in a critical part of the stack that strongly influences what our customers see on their screens, then we want to talk to you.

You may enjoy working with us if:

  • You strive to embrace best practices and are curious about discovering new and better ways to solve problems.

  • You are self-driven and highly motivated to deliver top-tier solutions while learning from and collaborating with Stunning Colleagues.

  • You are strongly motivated to pick up new domains and ship high-quality, extensible code.

  • You are excited to work in a multidisciplinary environment (engineering, algorithms, data engineering/science, product experimentation).

  • You are comfortable working in a team with peers and partners distributed across (US) geographies & time zones.

We would love to work with you if:

  • You have experience building high-traffic distributed services and infrastructure for online ML model inference and are familiar with supporting large-scale ML models focusing on high availability and performance.

  • You understand scalable model-serving solutions for generative models and LLMs, with skills in reducing latency and costs, and can solve bottlenecks to streamline research-to-production workflows.

  • You are proficient in object-oriented programming (preferably Java) and demonstrate engineering excellence in production hosting, including performance tuning, deployment management, and capacity planning.

  • You are familiar with deploying ML models using tools like Triton Inference Server, TensorRT, Docker.

  • You are experienced working with the public cloud like AWS, Azure, or GCP.

  • You are a proactive communicator who promotes best practices in observability and logging. 

  • You have a BS/MS in Computer Science, Applied Math, Engineering, or a related field.

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top-of-market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $100,000 - $720,000K

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs.  Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits .

Netflix has a unique culture and environment.  Learn more

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.

Similar Jobs

ByteDance - Student Researcher (Doubao (Seed) - Music Foundation Model) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Canva - Software Engineer (Java), Organising Content, Teams & Education

Canva

Sydney, New South Wales, Australia (Remote)
4 Weeks ago
Hawk Eye Innovations - Mid-Level Java Engineer

Hawk Eye Innovations

Budapest, Hungary (Hybrid)
4 Weeks ago
Netflix - Full-Stack Engineer (L5)

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Passive Logic - Computational Physics Software Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
5 Months ago
Google - Software Engineering Manager, TPU Systems, Platforms Infrastructure

Google

Taipei City, Taiwan (On-Site)
6 Days ago
Microsoft - Research Scientist

Microsoft

Zürich, Zurich, Switzerland (On-Site)
2 Days ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
Keywords Studios - Research Associate - Fresher

Keywords Studios

Karnataka, India (On-Site)
2 Weeks ago
NVIDIA - Principal Technical Program Manager, AI and Enterprise Apps

NVIDIA

Santa Clara, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer III, Authentication and Autofill, Android

Google

Beijing, Beijing, China (On-Site)
1 Week ago
Meta - Research Scientist Intern, Language and Multimodal Research for MetaAI (PhD)

Meta

Menlo Park, California, United States (On-Site)
5 Months ago
Microsoft - Software Engineer II

Microsoft

Reston, Virginia, United States (On-Site)
1 Week ago
Google - Senior Software Engineer, Core, Education and Activation

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Week ago
ByteDance - Software Development Engineer Graduate (Distributed NoSQL Database Systems)

ByteDance

Seattle, Washington, United States (On-Site)
1 Week ago
Thatgamecompany - Product Data Scientist

Thatgamecompany

United States (Remote)
4 Weeks ago
Saviynt - Senior Engineer SDET, Quality Engineering

Saviynt

El Segundo, California, United States (Hybrid)
6 Months ago
ByteDance - Software Engineer Intern (CDN/Edge/Traffic Platform)

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Google - Senior Software Engineer, Google Cloud Dataproc

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Google - Senior Software Engineer, Full Stack, Google Cloud - India

Google

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

ByteDance - Senior Software Engineer - Serverless Compute Infrastructure

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Light Speed Studios - Production Assistant

Light Speed Studios

California, United States (On-Site)
1 Month ago
ByteDance - Senior Visual Designer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
ByteDance - Linux Kernel Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
NVIDIA - Senior Product Marketing Manager

NVIDIA

Santa Clara, California, United States (On-Site)
2 Weeks ago
Corsair - Computer Packer

Corsair

Duluth, Georgia, United States (On-Site)
1 Day ago
Sphere Entertainment Co - Marketing Coordinator, Consumer Marketing

Sphere Entertainment Co

Las Vegas, Nevada, United States (On-Site)
1 Week ago
Valve corporation - Steam Software Engineer

Valve corporation

Bellevue, Washington, United States (On-Site)
5 Months ago
The Walt Disney Company - Sr Machine Learning Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
5 Months ago
ByteDance - Research Scientist, Data Management and Security - Infrastructure System Lab

ByteDance

San Jose, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

ByteDance - Cloud Native Engineer, ARK Large Model Platform (Singapore)

ByteDance

Singapore (On-Site)
5 Months ago
Rackspace Technology - Principal MLOps Engineer

Rackspace Technology

Toronto, Ontario, Canada (Remote)
4 Weeks ago
ASSIST Software - Other Positions

ASSIST Software

Suceava, Suceava County, Romania (Remote)
5 Months ago
Google - Senior Software Engineer, SDLC, Gemini Code Assist

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Appier - Software Engineer, Machine Learning Platform

Appier

Taipei City, Taiwan (On-Site)
5 Months ago
Microsoft - Member of Technical Staff, AI - Reinforcement Systems

Microsoft

London, England, United Kingdom (On-Site)
1 Month ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Senior Photonics Engineer, Platforms Infrastructure

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
ByteDance - Research Scientist- Foundation Model, Video Generation

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Google - Staff Software Engineer, Large Language Model and GenAI

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Netflix is one of the world's leading entertainment services with over 247 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

London, England, United Kingdom (On-Site)

Berlin, Berlin, Germany (On-Site)

Milan, Lombardy, Italy (On-Site)

Paris, Île-de-France, France (On-Site)

Seoul, South Korea (On-Site)

Los Angeles, California, United States (On-Site)

Los Gatos, California, United States (On-Site)

Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Netflix

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug