AI Inference Engineer

3 Hours ago • All levels • $190,000 PA - $250,000 PA

Job Summary

Job Description

The AI Inference Engineer will develop APIs for AI inference used by internal and external customers. They will benchmark and address bottlenecks throughout the inference stack, improve system reliability, and explore and implement LLM inference optimizations. The company has experienced significant growth and is backed by notable investors. They are looking for someone who has experience with ML systems and deep learning frameworks.
Must have:
  • Experience with ML systems and deep learning frameworks (e.g. PyTorch)
  • Familiarity with LLM architectures and inference optimization techniques
  • Understanding of GPU architectures or CUDA experience
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

FICO - Analytic Science — Lead Scientist

FICO

State Of São Paulo, Brazil (On-Site)
1 Week ago
ByteDance - Research Engineer Graduate (Machine Learning Sys-US) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Meta - Research Engineer (Robotics)

Meta

Menlo Park, California, United States (On-Site)
1 Month ago
GameJobs - Machine Learning Security Intern

GameJobs

Los Angeles, California, United States (On-Site)
2 Weeks ago
Whoop - Senior Sensor Algorithm Engineer

Whoop

Boston, Massachusetts, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Qualcomm - Lead Engineer, Senior - Model Orchestration and Accuracy Tools

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Sunnyvale, California, United States (On-Site)
6 Months ago
AI Fund - ML Engineer

AI Fund

San Francisco, California, United States (On-Site)
3 Weeks ago
Attentive - Staff Machine Learning Engineer

Attentive

San Francisco, California, United States (Hybrid)
6 Months ago
Alphasense - Join AlphaSense India Talent Community

Alphasense

Pune, Maharashtra, India (On-Site)
2 Days ago
Netflix - Machine Learning Intern - Spring or Summer 2025

Netflix

Los Gatos, California, United States (On-Site)
6 Months ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
1 Month ago
ASSIST Software - AI Engineer

ASSIST Software

Suceava, Suceava County, Romania (Remote)
6 Months ago
Google - ML Accelerator Architect and Performance Engineer, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
4 Weeks ago
Zazz - Artificial Intelligence Engineer

Zazz

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

quience - Principal Data Scientist, ML - Planning

quience

United States (On-Site)
2 Weeks ago
The New York Times - Senior Recruiter, Advertising & Corporate Functions (Temporary)

The New York Times

New York, United States (Hybrid)
1 Week ago
The Walt Disney Company - KABC Temporary Digital News Producer, Spanish Language

The Walt Disney Company

Glendale, California, United States (On-Site)
5 Months ago
starschema  - Janitorial Maintenance

starschema

Columbus, Ohio, United States (On-Site)
1 Week ago
Jane Street - FPGA Engineer

Jane Street

New York, New York, United States (On-Site)
2 Weeks ago
Second Dinner - Principal Technical Producer, Backend (MARVEL SNAP)

Second Dinner

United States (Remote)
1 Month ago
Genies - Applied Mathematics Intern

Genies

Los Angeles, California, United States (On-Site)
1 Month ago
Google - Software Engineering Manager II

Google

Austin, Texas, United States (On-Site)
2 Weeks ago
UPF Industries  - Truck Driver

UPF Industries

Butner, North Carolina, United States (On-Site)
1 Week ago
Interactive Brokers - Compliance Analyst (Temp)

Interactive Brokers

Chicago, Illinois, United States (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

London, England, United Kingdom (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug