Staff Software Engineer, AI Serving Infrastructure

1 Week ago • 8 Years + • $230,000 PA - $322,000 PA

Job Summary

Job Description

The AI Serving Infrastructure team develops and maintains Reddit's high-performance model serving infrastructure, generating millions of model predictions per second with low latency, with a focus on GPU optimization. The role involves designing, building, and maintaining the infrastructure and platform that powers search capabilities. This includes collaborating with Backend Architects and Product ML teams to shape the roadmap for ML infrastructure and platforms. The responsibilities include leading the building, testing, and maintenance of ML infrastructure, proposing and implementing high-performance ML Infra solutions, collaborating with partner teams, and mentoring team members. The goal is to enable machine learning engineers and data scientists and continuously improve the ML software development lifecycle.
Must have:
  • 8+ years of work experience in a production software development environment.
  • Experience working on large-scale ML Systems.
  • Experience building production-quality code using object-oriented programming.
  • Experience with Kubernetes.
  • Knowledge of maintaining applications using large-scale data stack.
  • Comfortable with distributed systems and data-intensive systems.
  • Strong organizational and communication skills.
Perks:
  • Comprehensive Healthcare Benefits
  • 401k Matching
  • Workspace benefits for your home office
  • Personal & Professional development funds
  • Family Planning Support
  • Flexible Vacation & Reddit Global Wellness Days
  • 4+ months paid Parental Leave
  • Paid Volunteer time off

Job Details

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

Location:
This role is completely remote-friendly. If you happen to live close to one of our physical office locations, our doors are open for you to come into the office as often as you'd like. 

Team:
The AI Serving Infrastructure team develops and maintains Reddit's high-performance model serving infrastructure, generating millions of model predictions per second with low latency, with a focus on GPU optimization. We collaborate closely with machine learning engineers to support a diverse range of models and partner with training and feature teams to deliver a seamless train-to-serve experience for efficient and reliable model deployment

As a Staff ML Infrastructure Engineer, AI Serving, you will be responsible for designing, building, and maintaining the infrastructure and platform that powers our search capabilities. You will collaborate with Backend Architects and Product ML teams to shape the roadmap for ML infrastructure and platforms, while providing ongoing support to scale the platform and meet evolving needs for state-of-the-art models.

How You'll Have Impact
You will build systems and tools that enable machine learning engineers (MLEs) and data scientists (DSs) and continuously improve the ML software development lifecycle, enabling the continuous iteration and improvement of systems that use ML techniques, including Deep Learning, Natural Language Processing, Recommendation Systems, Representation Learning, and Computer Vision.

  • Lead the building, testing, and maintenance of ML infrastructure at Reddit
  • Propose, design, and implement high-performance ML Infra solutions that significantly advance the deployment of models that serve millions of redditors a seamless experience for MLEs
  • Design and implement solutions that significantly advance the ML Infrastructure
  • Collaborate closely with XFN partner teams/internal customers.
  • Work with management on team goal setting, planning, and de-risk project execution
  • Mentor other team members in adopting a rigorous DevOps approach to maintain and/or improve ML infra components and services health and quality

Who You Might Be:

  • 8+ years of work experience in a production software development environment
  • Experience working on large-scale ML Systems
  • Experience building production-quality code incorporating testing, evaluation, and monitoring using object-oriented programming, including experience in golang, Python and Scala.
  • Experience with Kubernetes
  • Knowledge of maintaining or developing applications using large-scale data stack, e.g, BigQuery, GraphQL, Kafka, Flink, Cassandra, Redis, Search Databases 
  • Comfortable with distributed systems, big data (Petabyte scale) and data-intensive systems
  • Strong organizational & communication skills

Benefits:

  • Comprehensive Healthcare Benefits
  • 401k Matching
  • Workspace benefits for your home office
  • Personal & Professional development funds
  • Family Planning Support
  • Flexible Vacation (please use them!) & Reddit Global Wellness Days
  • 4+ months paid Parental Leave
  • Paid Volunteer time off

#LI-DB1 #LI-Remote

Similar Jobs

Epic Games - Marketing Performance Manager

Epic Games

(On-Site)
4 Months ago
Nubank - ALM Analyst

Nubank

Mexico City, Mexico (On-Site)
1 Week ago
Calix - Distinguished Data Architect

Calix

(Remote)
2 Weeks ago
ByteDance - Backend Software Engineer Intern (Product RD and Infrastructure-Global E-Commerce)- 2025 Summer (BS/MS)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playrix - Technical Director (Game Project)

Playrix

Portugal (Remote)
6 Months ago
Next Level Business Services - Sr. Big Data Engineer in San Francisco, CA  / McLean, VA

Next Level Business Services

San Francisco, California, United States (On-Site)
6 Months ago
Tala - Senior Software Engineer

Tala

(Remote)
2 Months ago
sandsoft - Director of Data Science and Engineering

sandsoft

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
3 Months ago
Crowd Strick - Engineer III - Reliability

Crowd Strick

(Remote)
1 Day ago
Epic Games - Senior Data Analyst, Game Platform

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
Index Exchange - Software Development Engineer in Test (SDET)

Index Exchange

Bengaluru, Karnataka, India (Remote)
7 Months ago
Globalization Partners - Staff Data Engineer

Globalization Partners

(Remote)
2 Weeks ago
Rackspace Technology - Data Engineer III

Rackspace Technology

Vietnam (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!