AI Systems Engineer

10 Hours ago • All levels • $190,000 PA - $250,000 PA

Job Summary

Job Description

This AI Systems Engineer role involves building large-scale deployment of machine learning models. Responsibilities include developing APIs for AI inference, setting up and deploying infrastructure, benchmarking to reduce bottlenecks, improving system reliability, and responding to outages. The role requires experience with ML systems and deep learning frameworks, familiarity with LLM architecture, and experience with deploying reliable, distributed, real-time systems at scale. The company has seen significant growth and offers competitive benefits including health, dental, vision insurance and a 401(k) plan.
Must have:
  • Experience with ML systems and deep learning frameworks.
  • Familiarity with LLM architecture.
  • Experience with deploying real-time systems at scale.
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan
  • Equity may be part of the total compensation package.

Job Details

You will help build large-scale deployment of machine learning models for both research and inference.

Our current stack is Python, C++, TensorRT-LLM, Kubernetes.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Help set up our infrastructure and deploy efficiently and reliably.
  • Benchmark and reduce bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages

Qualifications

  • Experience with ML systems and some deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • High level familiarity with LLM architecture, and the key pieces (Multi-Head, Multi/Grouped-Query, as well as common Layers)
  • Experience with deploying reliable, distributed, real-time systems at scale

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

Flip Fit - Senior Machine Learning Engineer

Flip Fit

(Remote)
1 Month ago
Snail Games - Software Engineer - AI/Machine Translation

Snail Games

Beverly Hills, California, United States (Remote)
2 Months ago
Netflix - Machine Learning Intern - Spring or Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
6 Months ago
ByteDance - Software Engineer - Machine Learning Training

ByteDance

Singapore (On-Site)
2 Weeks ago
Cerence - Senior Machine Learning Operations Developer

Cerence

Montreal, Quebec, Canada (Hybrid)
1 Day ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

Seattle, Washington, United States (On-Site)
5 Months ago
Scale AI - Head of Frontier Data Operations

Scale AI

San Francisco, California, United States (On-Site)
1 Day ago
Google - Customer Engineer II, AI/ML, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
ByteDance - Backend Engineer (Model Inference), Machine Learning Systems

ByteDance

Singapore (On-Site)
6 Months ago
Google - Software Engineer III, Audio Machine Learning, Pixel

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Staff Software Engineer, Machine Learning

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
SymphonyAI - Data Scientist

SymphonyAI

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Netflix - Machine Learning Scientist (L5)

Netflix

United States (Remote)
3 Months ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ByteDance - Software Engineer, Model Inference

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Google - Senior Software Engineer, AI/ML, Google Ads

Google

Mountain View, California, United States (On-Site)
3 Days ago
Epic Games - Senior Console Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
2 Weeks ago
NVIDIA - Manager, Digital Design - Mixed-Signal High-Speed I/O SerDes

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Daybreak Game Company LLC - Senior Accountant, Finance

Daybreak Game Company LLC

San Diego, California, United States (Hybrid)
2 Weeks ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
5 Months ago
DraftKings - Senior Analyst, Marketing Analytics

DraftKings

Boston, Massachusetts, United States (On-Site)
1 Month ago
NVIDIA - Senior Thermal Solutions Design Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
The Walt Disney Company - Guest Experience Manager - Housekeeping

The Walt Disney Company

Anaheim, California, United States (On-Site)
3 Days ago
ByteDance - Research Scientist Intern (Traffic Infrastructure Global Engineering)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Nintendo - Contract - Associate Designer (NST)

Nintendo

Redmond, Washington, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug