Senior Software Engineer, ML Infrastructure

2 Months ago • 5 Years + • Devops • $200,000 PA - $300,000 PA

Job Summary

Job Description

LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. The role involves architecting systems that capture and process large volumes of serving requests in real time, powering insights for AI and its applications. This foundational work ensures the platform surfaces trustworthy, transparent, and timely evaluation signals. The ideal candidate thrives in fast-moving environments, prioritizes performance and reliability, and aims to build systems that aid the AI community in understanding optimal models for their use cases. The position is based in the SF Bay Area or remote.
Must have:
  • Architect and scale high-performance, real-time API and data systems
  • Design and implement low-latency pipelines for event streams
  • Ensure reliability through data integrity and availability
  • Mentor engineers on infrastructure best practices
  • Collaborate with AI researchers and product leaders
  • 5+ years of experience in software engineering
  • Expertise in distributed systems and stream processing
  • Experience with scalable backend architecture
  • Proven ability to design fault-tolerant systems
  • Strong foundation in systems design and performance tuning
Perks:
  • Cash compensation: $200K-$300K
  • Competitive salary and meaningful equity
  • Comprehensive healthcare coverage (medical, dental, vision)
  • Opportunity to work on cutting-edge AI
  • Work with a small, mission-driven team
  • Culture values transparency, trust, and community impact

Job Details

Senior Software Engineer, ML Infrastructure

Location: SF Bay Area/Remote

Type: Full-Time

About the Role:

LMArena is seeking a Senior Software Engineer (Infrastructure) to lead the design and development of scalable, high-performance real-time data and API infrastructure. In this role, you’ll architect systems that capture and process large volumes of serving requests in real time, powering the insights that help researchers and developers build the world’s most advanced AI and its applications. Your work will be foundational to how we surface trustworthy, transparent, and timely evaluation signals across the platform. This role is ideal for someone who thrives in fast-moving environments, cares deeply about performance and reliability, and wants to build systems that help the AI community better understand what models are the best for their real-world use cases.

Responsibilities:

  • Architect and scale high-performance, real-time API and data systems

  • Design and implement low-latency pipelines to process and analyze large-scale event streams

  • Ensure reliability through robust data integrity, availability, and consistency mechanisms

  • Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning

  • Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems

Who is LMArena?

Created by researchers from UC Berkeley’s SkyLab, LMArena is an open platform where everyone can easily access, explore and interact with the world’s leading AI models. By comparing them side by side and casting votes for the better response, the community helps shape a public leaderboard, making AI progress more transparent, and grounded in real-world usage.

Why Join Us?

Trusted by organizations like Google, OpenAI, Meta, xAI, and more, LMArena is rapidly becoming essential infrastructure for transparent, human-centered AI evaluation at scale. With over one million monthly users and growing developer adoption, our impact is helping guide the next generation of safe, aligned AI systems—grounded in open access and collective feedback.

Our work is regularly referenced by industry leaders pushing the frontier of safe and reliable AI. Sundar Pichai, Jeff Dean, Elon Musk, and Sam Altman.

  • High Impact: Your work will be used daily by the world’s most advanced AI labs.

  • Global Reach: Develop data infrastructure powering millions of real-world evaluations, influencing AI reliability across industries at the top-tier

  • Exceptional Team: We are a small team of top talent from Google, DeepMind, Discord, Vercel, UC Berkeley, and Stanford.

Requirements:

  • 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems

  • Deep expertise in distributed systems, stream processing, and scalable backend architecture

  • Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems

  • Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services

  • Comfortable in a dynamic, high-ownership, fast-growth environment

What we offer:

  • The cash compensation for this position in the market is $200K-$300K.

  • Actual compensation will depend on job-related knowledge, skills, experience, and candidate location. 

  • Competitive salary and meaningful equity

  • Comprehensive healthcare coverage (medical, dental, vision)

  • The opportunity to work on cutting-edge AI with a small, mission-driven team

  • A culture that values transparency, trust, and community impact

Come help build the space where anyone can explore and help shape the future of AI.

Similar Jobs

ShyftLabs - Senior Backend Developer

ShyftLabs

Noida, Uttar Pradesh, India (On-Site)
9 Months ago
Eline Media - Game Design Director

Eline Media

Abu Dhabi, Abu Dhabi, United Arab Emirates (Hybrid)
2 Months ago
playrix  - Game Designer Playables

playrix

Ireland (Remote)
4 Months ago
Sprinkler - Technical Support Account Manager

Sprinkler

Gurugram, Haryana, India (On-Site)
2 Weeks ago
Super.com - Senior Software Engineer, Payments

Super.com

Canada (Remote)
9 Months ago
Rippling - Senior Software Engineer (Backend) - HRIS Platform

Rippling

San Francisco, California, United States (On-Site)
3 Months ago
Palo Alto Networks - Senior Consulting Director, Cloud Security, Proactive Services (Unit 42)

Palo Alto Networks

Chicago, Illinois, United States (Remote)
1 Month ago
Perplexity - Infrastructure Capacity Engineer

Perplexity

Palo Alto, California, United States (On-Site)
2 Weeks ago
miniclip - Senior Cloud Infrastructure Engineer

miniclip

Lisbon, Lisbon, Portugal (On-Site)
3 Weeks ago
AeroSpike - Senior Software Engineer, Cloud

AeroSpike

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

IGG - Game System Designer (Mobile Game)

IGG

Vancouver, British Columbia, Canada (On-Site)
2 Weeks ago
Epic Games - Senior AI Designer

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
eBay - Senior Staff Software Engineer, CLIP

eBay

United States (Remote)
2 Months ago
Workato - Senior UX Designer (Builder Experience)

Workato

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
eBay - Staff Product Designer - Design Systems

eBay

Portland, Oregon, United States (Hybrid)
2 Months ago
Apple - AI/ML Wireless Systems Engineer

Apple

Sunnyvale, California, United States (On-Site)
2 Months ago
Applied materials  - Reliability Engineer

Applied materials

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
bytedance - Software Engineer Graduate (Multi Cloud CDN) - 2025 Start (BS/MS)

bytedance

San Jose, California, United States (On-Site)
9 Months ago
playrix  - Game Designer Playables

playrix

Ireland (Remote)
4 Months ago
Ansys - R&D Engineer - DevSecOps

Ansys

Exton, Pennsylvania, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in California, United States

Pattern - Financial Analyst - Pricing

Pattern

Lehi, Utah, United States (Hybrid)
2 Months ago
bytedance - Optical Scientist - Display Optics System

bytedance

San Jose, California, United States (On-Site)
5 Months ago
The E.W. Scripps Company - Sr. Director of Sales

The E.W. Scripps Company

Billings, Montana, United States (On-Site)
3 Months ago
Sunblink - Senior QA Analyst

Sunblink

Boulder, Colorado, United States (Remote)
2 Months ago
DraftKings - VIP Host, St. Louis

DraftKings

St. Louis, Missouri, United States (Remote)
3 Weeks ago
belka games - Games

belka games

Palo Alto, California, United States (On-Site)
1 Month ago
Duolingo - Senior Psychometrician

Duolingo

New York, United States (On-Site)
3 Weeks ago
krea.ai - Backend Engineer

krea.ai

San Francisco, California, United States (On-Site)
3 Weeks ago
Sierra - Sales Engineer

Sierra

New York, United States (On-Site)
3 Months ago
Temporal Technologies - Senior Developer Advocate

Temporal Technologies

New York, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Devops Jobs

FlockSafety - Enterprise Solutions Engineer

FlockSafety

United States (Remote)
5 Months ago
Ajmera Infotech - Android Developer II– Build Mission-Critical Health-Tech Apps

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
2 Months ago
Apple - AIML - Sr./Staff ML Engineer, Machine Learning Platform & Intelligence

Apple

Seattle, Washington, United States (On-Site)
3 Months ago
Scopely - Principal DevOps Engineer - Star Trek Fleet Command

Scopely

Dublin, County Dublin, Ireland (Hybrid)
5 Months ago
dbt Labs - Customer Solutions Architect

dbt Labs

Dublin, County Dublin, Ireland (Hybrid)
4 Weeks ago
Ion - Senior DevSecOps Engineer, Italy

Ion

Collecchio, Emilia-Romagna, Italy (On-Site)
10 Months ago
dbt Labs - Senior Platform Software Engineer

dbt Labs

United States (Remote)
1 Month ago
Sailpoint - Senior DevOps Engineer

Sailpoint

Pune, Maharashtra, India (Remote)
4 Weeks ago
Jam City - DevOps Engineer

Jam City

Montevideo, Montevideo Department, Uruguay (Hybrid)
2 Months ago
Google - Software Developer III, Google Cloud Platforms

Google

Waterloo, Ontario, Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

California, United States (Hybrid)

United States (Remote)

California, United States (Hybrid)

United States (Remote)

California, United States (Hybrid)

California, United States (Hybrid)

California, United States (Hybrid)

California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by LMArena

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug