AI Inference Engineer

2 Months ago • All levels • Research Development • $190,000 PA - $250,000 PA

Job Summary

Job Description

The AI Inference Engineer will develop APIs for AI inference used by internal and external customers. They will benchmark and address bottlenecks throughout the inference stack, improve system reliability, and explore and implement LLM inference optimizations. The company has experienced significant growth and is backed by notable investors. They are looking for someone who has experience with ML systems and deep learning frameworks.
Must have:
  • Experience with ML systems and deep learning frameworks (e.g. PyTorch)
  • Familiarity with LLM architectures and inference optimization techniques
  • Understanding of GPU architectures or CUDA experience
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

Rockstar Games - Graphics Programmer

Rockstar Games

Oakville, Ontario, Canada (On-Site)
3 Months ago
bytedance - Senior Software Development Engineer, SDN-Traffic Intelligence & Control

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
zoox - Software Engineer - Mission Planning

zoox

Foster City, California, United States (Hybrid)
2 Years ago
Qualcomm - CPU Performance & Power Analyst/Staff Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
seedify - Senior/Middle Technical Artist

seedify

(Remote)
2 Months ago
HP - Senior Machine Learning Researcher, On-Device Optimization

HP

Palo Alto, California, United States (On-Site)
4 Days ago
Apple - Machine Learning Engineer, Large Visual Generative Model Optimization

Apple

Seattle, Washington, United States (On-Site)
1 Month ago
Perplexity - AI Machine Learning Engineer - Personalization

Perplexity

New York, New York, United States (On-Site)
1 Day ago
Capgemini - GEN AI Developer

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
bytedance - Machine Learning Engineer - Pico Perception

bytedance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Loft Orbital - Senior Backend Engineer

Loft Orbital

Toulouse, Occitanie, France (On-Site)
2 Years ago
Nintendo - Sr Software Engineer - Gameplay

Nintendo

Redmond, Washington, United States (Hybrid)
3 Months ago
Netflix - Pre-Production Technical Director

Netflix

Vancouver, British Columbia, Canada (Hybrid)
3 Months ago
Ansys - Senior R&D Engineer Full Stack - Simulation - Auto/Aero

Ansys

Ismaning, Bavaria, Germany (Hybrid)
2 Months ago
Epic Games - Software Engineer, Developer Relations

Epic Games

Seoul, South Korea (On-Site)
5 Months ago
Room 8 Group - C++ Engine Engineer (Mobile)

Room 8 Group

(Remote)
2 Months ago
Behaviour Interactive - Senior AI Programmer

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
1 Week ago
Qualcomm - Linux BSP / QNX Platform Staff Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
facepunch - Gameplay Programmer

facepunch

(Remote)
2 Months ago
Qualcomm - UWB Software Customer Engineer

Qualcomm

Suwon-si, Gyeonggi-do, South Korea (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

WebTech Corporation - Assembler

WebTech Corporation

Milwaukee, Wisconsin, United States (On-Site)
1 Month ago
Barracuda - Vulnerability Assessment Manager

Barracuda

Chelmsford, Massachusetts, United States (On-Site)
2 Months ago
extreme network - Manager, QA Engineering

extreme network

San Jose, California, United States (On-Site)
4 Months ago
Egnyte - Staff Software Engineer

Egnyte

Mountain View, California, United States (Hybrid)
8 Months ago
JMA - Regional Sales Director - DAS - Pacific Northwest

JMA

United States (Remote)
9 Months ago
zoox - Senior Software Engineer - Motion Planning Collision Avoidance

zoox

Foster City, California, United States (Hybrid)
4 Weeks ago
Nintendo - Associate Concept Artist (NST)

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
Decagon - Strategic Account Manager

Decagon

San Francisco, California, United States (On-Site)
3 Months ago
Apple - iOS Engineer, Apple Pay Security

Apple

New York, New York, United States (On-Site)
2 Months ago
Apple - Administrative Assistant - Hardware Engineering

Apple

Cupertino, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Reddit - Senior Machine Learning Engineer, Conversion Lift

Reddit

United States (Remote)
1 Month ago
Haven Studios  Inc  - Senior User Experience Researcher

Haven Studios Inc

Montreal, Quebec, Canada (On-Site)
3 Weeks ago
Agara labs - Software Development Engineer - R&D

Agara labs

Bengaluru, Karnataka, India (Remote)
2 Months ago
gismart - Machine Learning Engineer

gismart

(On-Site)
1 Week ago
bytedance - Student Researcher (Foundation Models - Reasoning, Planning & Agent) - Doubao (Seed) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Roblox - Senior Talent Research Specialist

Roblox

Gurugram, India (On-Site)
4 Weeks ago
Jane Street - Machine Learning Performance Engineer

Jane Street

London, England, United Kingdom (On-Site)
2 Months ago
Ansys - R&D Engineer - Python, C++

Ansys

Pune, Maharashtra, India (On-Site)
1 Week ago
Genies - Engineering Manager, Machine Learning

Genies

Los Angeles, California, United States (On-Site)
3 Months ago
Alpha Sense - Channel and Customer Research Analyst

Alpha Sense

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

Palo Alto, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug