AI Inference Engineer

1 Month ago • All levels • $190,000 PA - $240,000 PA

Job Summary

Job Description

We are looking for an AI Inference Engineer to join our growing team. You will be working with Python, C++, TensorRT-LLM, and Kubernetes on the large-scale deployment of machine learning models for real-time inference. Responsibilities include developing APIs for AI inference, benchmarking and addressing bottlenecks, improving system reliability and observability, and exploring LLM inference optimizations. The company has experienced rapid growth and has raised significant funding from respected investors.
Must have:
  • Develop APIs for AI inference.
  • Benchmark and address bottlenecks in the inference stack.
  • Improve system reliability and observability.
  • Experience with ML systems and deep learning frameworks.
  • Familiarity with common LLM architectures.
Good to have:
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA.
Perks:
  • Comprehensive health, dental, and vision insurance for you and your dependents.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

We are looking for an AI Inference to join our growing team. Our current stack is Python, C++, TensorRT-LLM, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Experience with deploying reliable, distributed, real-time model serving at scale
  • (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $240,000.

 

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
 
 

Similar Jobs

Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Washington, District Of Columbia, United States (On-Site)
6 Months ago
Luxoft - Regular Data Engineer

Luxoft

(Remote)
6 Months ago
Starkflow - Principal Full Stack Developer

Starkflow

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Snail Games - Software Engineer - AI/Machine Translation

Snail Games

Beverly Hills, California, United States (Remote)
3 Months ago
Canva - Staff Machine Learning Engineer - User Voice

Canva

Sydney, New South Wales, Australia (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Performance Engineer - Deep Learning

NVIDIA

Santa Clara, California, United States (On-Site)
1 Month ago
ByteDance - Software Engineer Intern (Machine Learning Platform) - 2024 Summer (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
7 Months ago
matchgroup - Sr. Machine Learning Software Engineer

matchgroup

Seoul, South Korea (Hybrid)
6 Months ago
Thousand Eyes - Lead Software Engineer II, Machine Learning

Thousand Eyes

San Francisco, California, United States (On-Site)
2 Weeks ago
Google - Customer Engineer, Applied and Generative AI

Google

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago
Playrix - Generative AI Engineer

Playrix

Cyprus (Remote)
1 Month ago
Alphasense - Join AlphaSense India Talent Community

Alphasense

Mumbai, Maharashtra, India (On-Site)
2 Weeks ago
PlayStation Global - Machine Learning Engineer for Game Technology

PlayStation Global

Aliso Viejo, California, United States (On-Site)
10 Months ago
Scale AI - Software Engineer Public Sector - New Grad

Scale AI

San Francisco, California, United States (On-Site)
1 Month ago
Xsolla - Machine Learning Engineer

Xsolla

Montreal, Quebec, Canada (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in England, United Kingdom

Minecast - Senior Tax Analyst

Minecast

London, England, United Kingdom (On-Site)
1 Month ago
Hyper Luminal Games - Senior 3D Game Animator

Hyper Luminal Games

Scotland, United Kingdom (Hybrid)
1 Month ago
Tesla - Service Technician / Automotive Mechanic

Tesla

London, England, United Kingdom (On-Site)
3 Months ago
WildBrain - Advertising Sales Executive

WildBrain

London, England, United Kingdom (Hybrid)
2 Months ago
Assystems - EC&I Commissioning Engineer

Assystems

Derby, England, United Kingdom (On-Site)
7 Months ago
Universally Speaking - Korean Games Tester

Universally Speaking

Liverpool, England, United Kingdom (On-Site)
2 Months ago
The Walt Disney Company - Technical Assistant

The Walt Disney Company

London, England, United Kingdom (Hybrid)
1 Month ago
Jam media - 2D Senior Character Animators

Jam media

United Kingdom (Hybrid)
1 Month ago
Whatnot - Workplace Experience Manager

Whatnot

London, England, United Kingdom (On-Site)
1 Month ago
Hawk Eye Innovations - Head of Projects - Growth Sports

Hawk Eye Innovations

Basingstoke, England, United Kingdom (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, United States (Hybrid)

California, United States (On-Site)

San Francisco, California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (Hybrid)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug