AI Systems Engineer

1 Month ago • All levels • System Design

Job Summary

Job Description

The AI Systems Engineer will join a growing team to work on large-scale deployment of machine learning models for real-time inference. The responsibilities include developing APIs for AI inference, designing and maintaining scalable infrastructure, benchmarking system performance, and improving system reliability. The engineer will also respond to system outages. The job description also mentions the company's growth and recent funding rounds, including the investors.
Must have:
  • Develop APIs and manage distributed systems
  • Strong understanding of Kubernetes and container orchestration
  • Experience with deploying reliable, distributed, real-time systems
  • Familiarity with LLM architecture and layers
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan
  • Equity as part of the total compensation package

Job Details

We are looking for an AI Systems Engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop robust APIs for AI inference used by both internal and external customers
  • Design, deploy, and maintain scalable, reliable infrastructure for deploying machine learning models
  • Benchmark system performance, diagnose bottlenecks, and implement improvements across the inference stack
  • Enhance system reliability and observability by integrating modern monitoring and alerting tools
  • Respond swiftly to system outages and collaborate across teams to maintain high uptime and performance 

Qualifications

  • Experience in developing APIs and managing distributed systems
  • Strong understanding of Kubernetes and container orchestration
  • Experience with deploying reliable, distributed, real-time systems at scale
  • High level familiarity with LLM architecture, and the key pieces (Multi-Head, Multi/Grouped-Query, as well as common Layers)
At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

31st Union - Senior Technical UI Artist

31st Union

San Mateo, California, United States (On-Site)
1 Month ago
Sailpoint - Manager, Developer Relations

Sailpoint

United States (On-Site)
1 Month ago
Ansys - R&D Engineer II

Ansys

Atlanta, Georgia, United States (On-Site)
3 Weeks ago
Crunchyroll - Staff Software Engineer - Account Services

Crunchyroll

(Remote)
5 Months ago
Veeam Software - Middle/Senior C# Developer for Azure Backup

Veeam Software

Poland (Remote)
1 Month ago
Intel  - Senior SerDes PHY System Engineer

Intel

Bengaluru, Karnataka, India (On-Site)
12 Months ago
bytedance - Linux System Engineer

bytedance

London, England, United Kingdom (On-Site)
6 Months ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Ion - System Engineer Jr, Italy

Ion

Italy (Hybrid)
9 Months ago
Ion - System Engineer Control Room, Italy

Ion

Parma, Emilia-Romagna, Italy (Hybrid)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

rivos - Application Engineer

rivos

Santa Clara, California, United States (On-Site)
3 Weeks ago
Riot Games - Staff Software Engineer - VALORANT, Foundations, Build Platforms

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Eqvilent - SENIOR С++ SOFTWARE ENGINEER

Eqvilent

(Remote)
8 Months ago
PlayStation Global - Principal Audio Programmer

PlayStation Global

London, England, United Kingdom (On-Site)
2 Months ago
Tencent - Software Engineer

Tencent

(On-Site)
4 Months ago
Catina - Machine Learning Engineer, Memory

Catina

San Francisco, California, United States (On-Site)
5 Months ago
Canonical - Embedded Linux Field Engineering Manager

Canonical

(Remote)
1 Month ago
Ubisoft - Junior R&D Engineer

Ubisoft

Pune, Maharashtra, India (Hybrid)
1 Month ago
Haptic  - Senior UI/UX Designer

Haptic

Sweden (On-Site)
6 Months ago
zoox - Senior/Staff Software Engineer - Simulation Traffic & Behavior Modeling

zoox

Seattle, Washington, United States (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in London, England, United Kingdom

Sabre India - Business Development Manager, Demand - Lodging, Ground & Sea

Sabre India

Richmond, England, United Kingdom (Hybrid)
1 Year ago
London stock Exchange - Data Engineer Team Lead

London stock Exchange

London, England, United Kingdom (On-Site)
4 Weeks ago
Zeeco, Inc. - Proposal Engineer - Combustion Rental and Rapid Response

Zeeco, Inc.

Stamford, England, United Kingdom (On-Site)
10 Months ago
Ion - Implementation Engineer - 9951

Ion

London, England, United Kingdom (On-Site)
9 Months ago
Tesla - Sales Advisor

Tesla

Winchester, England, United Kingdom (On-Site)
5 Months ago
Critical mass - Senior User Experience Designer

Critical mass

London, England, United Kingdom (On-Site)
1 Week ago
Novomatic - Revenue Excellence Analyst

Novomatic

London, England, United Kingdom (On-Site)
2 Weeks ago
Brillio - For testing purpose - R01539561

Brillio

London, England, United Kingdom (Hybrid)
8 Months ago
Lighthouse Games - Senior SDET - C++

Lighthouse Games

Royal Leamington Spa, England, United Kingdom (Hybrid)
3 Months ago
Lockwood - Senior Game Designer

Lockwood

Nottingham, England, United Kingdom (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

System Design Jobs

Rackspace Technology - .NET Application Architect (India Night Shift)

Rackspace Technology

India (Remote)
3 Weeks ago
NVIDIA - Senior System Software Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Loft Orbital - Senior Satellite Systems Engineer

Loft Orbital

Toulouse, Occitanie, France (On-Site)
2 Years ago
bytedance - SOC System Architect

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Accenture - Application Developer

Accenture

Chennai, Tamil Nadu, India (On-Site)
1 Week ago
Regent craft - Thermal Systems Engineer

Regent craft

North Kingstown, Rhode Island, United States (On-Site)
2 Months ago
Visa - Systems Engineer - Sr. Consultant, IaC

Visa

Ashburn, Virginia, United States (Hybrid)
1 Month ago
2K - Principal Systems Engineer

2K

Burnaby, British Columbia, Canada (Hybrid)
2 Months ago
Ion - System Engineer Jr, Italy

Ion

Italy (Hybrid)
9 Months ago
The Mill - Senior Systems Engineer

The Mill

New York, New York, United States (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

About The Company

New York, New York, United States (Remote)

Palo Alto, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

New York, United States (On-Site)

Belgrade, Serbia (Hybrid)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug