AI Inference Engineer

10 Hours ago • All levels • $190,000 PA - $250,000 PA

Job Summary

Job Description

The AI Inference Engineer will be responsible for developing APIs for AI inference, benchmarking and addressing bottlenecks, improving system reliability and observability, and exploring novel research to implement LLM inference optimizations. This role involves working on large-scale deployment of machine learning models for real-time inference. The current tech stack includes Python, C++, TensorRT-LLM, and Kubernetes. The company has seen significant growth and has raised funding from respected investors.
Must have:
  • Experience with ML systems and deep learning frameworks
  • Familiarity with LLM architectures and inference optimization techniques
  • Understanding of GPU architectures or experience with CUDA
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan
  • Equity may be part of the total compensation package

Job Details

You will work on large-scale deployment of machine learning models for real-time inference.

Our current stack is Python, C++, TensorRT-LLM, Kubernetes.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

Epic Games - Senior Machine Learning Rendering Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Nextbrain - Computer Vision Engineer

Nextbrain

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Canva - Senior Machine Learning Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
3 Months ago
GoDaddy - Senior Machine Learning Scientist

GoDaddy

London, England, United Kingdom (Hybrid)
8 Hours ago
Meta - Research Scientist, Computer Vision for Generative AI (PhD)

Meta

New York, New York, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Research Scientist, Machine Learning (PhD)

Meta

Bellevue, Washington, United States (On-Site)
2 Weeks ago
Google - Research Engineer, Vision Language Models

Google

Zürich, Zurich, Switzerland (On-Site)
2 Weeks ago
The Walt Disney Company - Lead Software Engineer, Machine Learning - Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
5 Months ago
Windranger Labs - Technical AI Researcher

Windranger Labs

Singapore (On-Site)
1 Month ago
Google - App Development Customer Engineer, Global Partnerships Sellside

Google

Dublin, County Dublin, Ireland (On-Site)
2 Weeks ago
Hedra - Applied Research Scientist

Hedra

New York, New York, United States (On-Site)
1 Month ago
Balbix - Staff AI Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Alphasense - Join AlphaSense Helsinki Talent Community!

Alphasense

Helsinki, Uusimaa, Finland (On-Site)
8 Hours ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
7 Months ago
The Walt Disney Company - Lead Applied AI Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Meta - Software Engineer - Datacenter networking

Meta

New York, New York, United States (On-Site)
5 Months ago
ByteDance - Software Engineer, Architecture and Infrastructure

ByteDance

San Jose, California, United States (On-Site)
6 Months ago
Epic Games - Senior Security Engineer - Asset Integrity

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Meta - Production Engineering

Meta

Fremont, California, United States (On-Site)
5 Months ago
Saviynt - Software Architect - Privilege Access Management

Saviynt

United States (Remote)
6 Months ago
WebFX - Jr. Business Data Analyst

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
6 Months ago
Google - Research Manager, Neural Rendering, Project Starline

Google

Seattle, Washington, United States (On-Site)
2 Days ago
spauldingridge - Oracle EPM Solution Architect

spauldingridge

Chicago, Illinois, United States (On-Site)
20 Hours ago
Dave Ramsey - Senior Assistant

Dave Ramsey

Franklin, Tennessee, United States (On-Site)
2 Weeks ago
Biofire DX - Clinical Studies Operations Specialist

Biofire DX

Salt Lake City, Utah, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug