AI Inference Engineer

4 Months ago • All levels • $190,000 PA - $250,000 PA
Research Development

Job Description

The AI Inference Engineer will develop APIs for AI inference used by internal and external customers. They will benchmark and address bottlenecks throughout the inference stack, improve system reliability, and explore and implement LLM inference optimizations. The company has experienced significant growth and is backed by notable investors. They are looking for someone who has experience with ML systems and deep learning frameworks.
Must Have:
  • Experience with ML systems and deep learning frameworks (e.g. PyTorch)
  • Familiarity with LLM architectures and inference optimization techniques
  • Understanding of GPU architectures or CUDA experience
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Add these skills to join the top 1% applicants for this job

cpp
cuda
rust
pytorch
deep-learning
kubernetes
python
tensorflow
machine-learning

We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Understanding of GPU architectures or experience with GPU kernel programming using CUDA

The cash compensation range for this role is $190,000 - $250,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Set alerts for more jobs like AI Inference Engineer
Set alerts for new jobs by Perplexity
Set alerts for new Research Development jobs in United States
Set alerts for new jobs in United States
Set alerts for Research Development (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙