Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

8 Months ago • All levels • Devops • $100,000 PA - $720,000 PA

Job Summary

Job Description

Netflix seeks a Software Engineer to build scalable ML model serving systems for personalization, search, and recommendation experiences. Must have experience with distributed services, online ML inference, and supporting large-scale models. Experience with generative models and LLMs is a plus.
Must have:
  • Distributed Services
  • Online ML Inference
  • Large-scale Models
  • Object-oriented Programming
Good to have:
  • Generative Models
  • LLMs
  • Triton Inference Server
  • TensorRT
Perks:
  • Stock Option Program
  • Flexible Time Off

Job Details

Netflix is one of the world’s leading entertainment services with 278 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time.

The Role

Machine Learning/Artificial Intelligence powers innovation in all areas of the business, from helping members choose the right title for them through personalization, to better understanding our audience and our content slate, to optimizing our payment processing and other revenue-focused initiatives. Building highly scalable and differentiated ML infrastructure is key to accelerating this innovation.

More recently, fast-paced innovation in large language models (LLMs) has greatly helped advance state-of-the-art technology in many areas of personalization, including search and recommendation experiences. 

The Opportunity

The Model Serving Systems team provides the computational platform on which we build nearly all our consumer and studio-facing ML/AI applications. We provide all the building blocks to serve ML models at scale, including a real-time model inference and serving platform, foundational abstractions that ensure consistency between online and offline systems, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization, we’re building model serving infrastructure for LLMs and other large foundation models. 

We're expanding our model serving systems to meet the evolving needs of the evolving AI landscape. ​​We are looking for strong engineers to develop and expand our compute infrastructure to support the growing AI needs, enable the application of ML in new business areas, and drive ML/AI innovation across Netflix. Our systems power some of Netflix's most business-critical models, and we need you to take our ML/AI initiatives to the next level. You will play a highly cross-functional role, partnering with other engineers, product managers, machine learning engineers, and data/research scientists.

If you have a passion for building scalable, robust systems, are interested in pushing the envelope in applying ML algorithms, and operate in a critical part of the stack that strongly influences what our customers see on their screens, then we want to talk to you.

You may enjoy working with us if:

  • You strive to embrace best practices and are curious about discovering new and better ways to solve problems.

  • You are self-driven and highly motivated to deliver top-tier solutions while learning from and collaborating with Stunning Colleagues.

  • You are strongly motivated to pick up new domains and ship high-quality, extensible code.

  • You are excited to work in a multidisciplinary environment (engineering, algorithms, data engineering/science, product experimentation).

  • You are comfortable working in a team with peers and partners distributed across (US) geographies & time zones.

We would love to work with you if:

  • You have experience building high-traffic distributed services and infrastructure for online ML model inference and are familiar with supporting large-scale ML models focusing on high availability and performance.

  • You understand scalable model-serving solutions for generative models and LLMs, with skills in reducing latency and costs, and can solve bottlenecks to streamline research-to-production workflows.

  • You are proficient in object-oriented programming (preferably Java) and demonstrate engineering excellence in production hosting, including performance tuning, deployment management, and capacity planning.

  • You are familiar with deploying ML models using tools like Triton Inference Server, TensorRT, Docker.

  • You are experienced working with the public cloud like AWS, Azure, or GCP.

  • You are a proactive communicator who promotes best practices in observability and logging. 

  • You have a BS/MS in Computer Science, Applied Math, Engineering, or a related field.

Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top-of-market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $100,000 - $720,000K

Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs.  Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits .

Netflix has a unique culture and environment.  Learn more

We are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Job is open for no less than 7 days and will be removed when the position is filled.

Similar Jobs

Adyen - Operations Manager, Commercial

Adyen

New York, United States (On-Site)
2 Weeks ago
Realworld one - Associate, Commercial Strategy & Operations

Realworld one

Germany (Hybrid)
3 Months ago
Qualcomm - CPU Performance Modeling Engineer

Qualcomm

Santa Clara, California, United States (On-Site)
1 Month ago
Glean - Lead Software Engineer, Data Foundations

Glean

Palo Alto, California, United States (On-Site)
1 Month ago
London stock Exchange - Lead Engineer - Solution Architect - Analytics

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
CyberArk - Solutions Engineer

CyberArk

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
bytedance - Infrastructure Software Engineer in Edge Cloud

bytedance

San Jose, California, United States (On-Site)
2 Months ago
PwC - DevOps Engineer

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Weeks ago
GoTo Group - Senior Software Engineer - Event Platform

GoTo Group

Gurugram, Haryana, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

JDA - Software Engineer -I (Gen AI)

JDA

Dallas, Texas, United States (Hybrid)
2 Weeks ago
Reddit - Senior Backend Software Engineer

Reddit

United States (Remote)
1 Month ago
Expedia - Senior Mobile Engineer, iOS

Expedia

Seattle, Washington, United States (On-Site)
3 Weeks ago
Penrose studios - Business Development Manager

Penrose studios

San Francisco, California, United States (On-Site)
4 Years ago
Thousand Eyes - Scale Customer Success Manager

Thousand Eyes

Lisbon, Lisbon, Portugal (On-Site)
2 Weeks ago
seedify - Sales Onboarding Lead

seedify

(Remote)
1 Month ago
Team Liquid - Influencer Sales Manager

Team Liquid

Santa Monica, California, United States (On-Site)
2 Months ago
Sporty - Strategy and Planning Coordinator

Sporty

São Paulo, Brazil (Hybrid)
3 Weeks ago
Tesla - Business Operations Analyst

Tesla

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Meta - Graphics Software Engineer, Rendering

Meta

Burlingame, California, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Rolls-Royce - Component Design Engineer

Rolls-Royce

Indianapolis, Indiana, United States (Hybrid)
1 Month ago
Nintendo - Manager, Software Engineering

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
PayPal - Staff Data Scientist

PayPal

San Jose, California, United States (Hybrid)
3 Weeks ago
Apple - Hardware System Electrical Engineer - Beats

Apple

Los Angeles, California, United States (On-Site)
4 Days ago
Toast - Retail Account Executive

Toast

Peoria, Illinois, United States (Hybrid)
2 Weeks ago
Scale AI - AI Product Manager - Public Sector

Scale AI

Washington, District Of Columbia, United States (On-Site)
1 Month ago
BioFire - Inventory Manager 2

BioFire

Durham, North Carolina, United States (On-Site)
3 Weeks ago
zoox - Staff/Senior Staff Software Engineer - Full Stack Operational Tools

zoox

Foster City, California, United States (Hybrid)
2 Months ago
Open Systems Technologies - Customer Service Representative

Open Systems Technologies

Tampa, Florida, United States (On-Site)
1 Week ago
Patreon - Brand Director

Patreon

San Francisco, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Devops Jobs

Diligent Corporation - Salesforce Solutions Architect

Diligent Corporation

New York, United States (On-Site)
1 Month ago
Rippling - Senior Software Engineer, Identity Platform

Rippling

San Francisco, California, United States (On-Site)
1 Month ago
Veeam Software - Cloud Platform Engineer

Veeam Software

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Garena - Site Reliability Engineer/Senior Site Reliability Engineer

Garena

Singapore (On-Site)
2 Months ago
Toast - Senior DevOps Engineer

Toast

Dublin, County Dublin, Ireland (Hybrid)
2 Weeks ago
Penn Interactive - Senior Machine Learning Engineer, Platform

Penn Interactive

Philadelphia, Pennsylvania, United States (On-Site)
1 Month ago
Sailpoint - Senior Staff DevOps Engineer

Sailpoint

Austin, Texas, United States (On-Site)
1 Month ago
Nightfall AI - Senior ML Platform Backend Engineer

Nightfall AI

San Francisco, California, United States (Hybrid)
1 Month ago
Nagarro - Senior Cloud Developer/Architect

Nagarro

Germany (Remote)
4 Months ago
Sailpoint - Senior SRE (Site Reliability Engineer)

Sailpoint

Mexico (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Seoul, South Korea (On-Site)

Bogota, Colombia (On-Site)

Los Angeles, California, United States (On-Site)

Seoul, South Korea (On-Site)

Los Gatos, California, United States (On-Site)

Los Angeles, California, United States (On-Site)

Sydney, New South Wales, Australia (Hybrid)

View All Jobs

Get notified when new jobs are added by Netflix

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug