AI Systems Engineer

2 Months ago • All levels • System Design • $190,000 PA - $250,000 PA

Job Summary

Job Description

This AI Systems Engineer role at Perplexity involves developing robust APIs for AI inference, designing and maintaining scalable infrastructure for machine learning model deployment, and improving system performance. Responsibilities include benchmarking, diagnosing bottlenecks, and integrating monitoring tools. The engineer will also respond to system outages. The company has experienced significant growth since its launch in 2022. They offer Perplexity Enterprise Pro and have raised significant funding. The role provides a chance to work on large-scale deployment of machine learning models for real-time inference.
Must have:
  • Develop APIs for AI inference for internal and external use.
  • Strong understanding of Kubernetes and container orchestration.
  • Experience deploying reliable, distributed, real-time systems.
  • Familiarity with LLM architecture and key components.
Perks:
  • Comprehensive health, dental, and vision insurance.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

We are looking for an AI Systems Engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop robust APIs for AI inference used by both internal and external customers
  • Design, deploy, and maintain scalable, reliable infrastructure for deploying machine learning models
  • Benchmark system performance, diagnose bottlenecks, and implement improvements across the inference stack
  • Enhance system reliability and observability by integrating modern monitoring and alerting tools
  • Respond swiftly to system outages and collaborate across teams to maintain high uptime and performance 

Qualifications

  • Experience in developing APIs and managing distributed systems
  • Strong understanding of Kubernetes and container orchestration
  • Experience with deploying reliable, distributed, real-time systems at scale
  • High level familiarity with LLM architecture, and the key pieces (Multi-Head, Multi/Grouped-Query, as well as common Layers)

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

Epic Games - Gameplay Systems Programmer

Epic Games

Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
5 Months ago
Blockville - AI Technology Specialist for Game Development

Blockville

İstanbul, Türkiye (On-Site)
1 Year ago
super78 - Unreal Developer

super78

Los Angeles, California, United States (On-Site)
2 Weeks ago
Bloober Team - Senior Animation Programmer

Bloober Team

Lesser Poland Voivodeship, Poland (Remote)
6 Months ago
Rockstar Games - Senior Software Development Engineer In Test (C#)

Rockstar Games

New York, United States (On-Site)
1 Month ago
bytedance - Senior Software Engineer, Distributed Storage System

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Forescout Technologies  Inc  - Inside Systems Engineer

Forescout Technologies Inc

Dallas, Texas, United States (Hybrid)
3 Months ago
FalconX - Senior Frontend Engineer (Trading Systems)

FalconX

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Rolls-Royce - Control System Senior Software Engineer

Rolls-Royce

Indianapolis, Indiana, United States (Hybrid)
1 Month ago
Morning Star - Senior Application Security Architect

Morning Star

Chicago, Illinois, United States (Hybrid)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

binance - Data Scientist - Large Language Model

binance

Taipei City, Taiwan (Hybrid)
3 Months ago
Virtuos - Senior/Lead Software Engineer

Virtuos

China (On-Site)
3 Months ago
Rocket Science - Network Engineer C++

Rocket Science

Cardiff, Wales, United Kingdom (Hybrid)
1 Week ago
Hawkeye Innovations - Computer Vision Engineer - Level 2

Hawkeye Innovations

Budapest, Hungary (Hybrid)
3 Months ago
supercell - Senior Client Programmer, Project R.I.S.E

supercell

Shanghai, Shanghai, China (On-Site)
9 Months ago
Canonical - Embedded Linux Field Engineering Manager

Canonical

(Remote)
2 Months ago
GameJobs - Senior Gameplay Programmer

GameJobs

London, England, United Kingdom (On-Site)
2 Months ago
Apple - System Software Engineer - Human Interface Devices

Apple

Cupertino, California, United States (On-Site)
2 Weeks ago
Riot Games - Principal Software Engineer, Services

Riot Games

Shanghai, China (On-Site)
2 Months ago
Rockstar Games - Senior Animation R&D Programmer: Retargeting

Rockstar Games

Oakville, Ontario, Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Christ Fellowship - Everywhere Coordinator

Christ Fellowship

Palm Beach Gardens, Florida, United States (On-Site)
1 Month ago
Ziff Davis - Principal Software Engineer, Android

Ziff Davis

Boston, Massachusetts, United States (Remote)
2 Months ago
Linden lab - Senior Growth Marketing Manager

Linden lab

San Francisco, California, United States (Hybrid)
2 Months ago
Ion - Technical Account Manager

Ion

Jersey City, New Jersey, United States (On-Site)
4 Months ago
Qualcomm - Contracts Specialist

Qualcomm

San Diego, California, United States (On-Site)
2 Weeks ago
cyara - Senior Customer Success Manager

cyara

United States (Remote)
6 Months ago
PlayStation Global - Senior Software Engineer (Back End / Machine Learning)

PlayStation Global

San Mateo, California, United States (On-Site)
3 Months ago
Aerovect - Autonomous GSE Operator

Aerovect

Atlanta, Georgia, United States (On-Site)
1 Month ago
CyberArk - Regional Marketing Manager

CyberArk

United States (On-Site)
2 Months ago
Sonar Source - Product Marketing Manager (Go-To-Market, Content Creation, & Partnerships)

Sonar Source

Austin, Texas, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

System Design Jobs

Loft Orbital - Electrical Systems Engineer

Loft Orbital

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
2 Months ago
Nahc.io - Software Engineer (Embedded Systems / Firmware)

Nahc.io

Hong Kong (On-Site)
9 Months ago
Scout - Engineer, Brake Systems

Scout

Novi, Michigan, United States (On-Site)
3 Weeks ago
Thales - Telecom End-to-End System Architect

Thales

Rome, Lazio, Italy (Hybrid)
1 Month ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
3 Months ago
Forescout Technologies  Inc  - Pre-Sales System Engineer

Forescout Technologies Inc

Sydney, New South Wales, Australia (On-Site)
3 Months ago
Toptracer - System Architect

Toptracer

Danderyd, Stockholm County, Sweden (Hybrid)
1 Month ago
cirrus logic - System Emulation Engineer

cirrus logic

Newbury, England, United Kingdom (On-Site)
2 Months ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Redmond, Washington, United States (On-Site)
8 Months ago
bytedance - Linux System Engineer

bytedance

London, England, United Kingdom (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

New York, New York, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

Palo Alto, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug