AI Training Infrastructure Engineer - Post Training

1 Month ago • 6 Years + • Devops • $220,000 PA - $290,000 PA

Job Summary

Job Description

Perplexity is seeking experienced AI Research Engineers and Scientists to improve their in-house Online LLMs, the Sonar models. The role involves creating a robust and effective training framework, especially for post-training LLMs. Responsibilities include building a post-training framework, implementing necessary infrastructure for the latest models and algorithms, owning the data, training, and evaluation pipelines, and collaborating with engineering teams. The job requires experience with large-scale LLM frameworks, proficiency in Python/Pytorch, and a passion for tackling challenging problems.

Must have:

Experience with large-scale LLMs frameworks.
Strong in Python/Pytorch; C++/CUDA is a plus.
Self-starter with willingness to take ownership.
Passion for tackling challenging problems.

Good to have:

PhD in AI/ML/Systems or related areas.
Experience building LLM training frameworks.

Perks:

Comprehensive health, dental, and vision insurance.
401(k) plan.
Equity may be part of the total compensation package.

5 skills required

5 skills required for this role

Add these skills to join the top 1% applicants for this job

cpp

cuda

pytorch

python

algorithms

Job Details

Perplexity is seeking experienced AI Research Engineers and Scientists to continue to improve our in house Online LLMs, the Sonar models. Your job is to work with team and create a robust and effective training framework (on top of Megatron/PyTorch), especially for post training LLMs.

Responsibilities

Build a post training framework that can run cutting-edge model training jobs in scale
Implement the necessary infra and components to support latest models and algorithms like SFT, RL (DPO/GRPO) and more
Own the full stack data, training, and eval pipelines required to post-train LLM models
Work closing with engineering teams to integrate Sonar models into our product.

Qualifications

Proven experience with large-scale LLMs frameworks building
Strong in Python/Pytorch; C++/CUDA is a plus
Self-starter with a willingness to take ownership of tasks
Passion for tackling challenging problems
Minimum of 6 years of working on relevant projects.

Bonus

PhD in AI/ML/Systems or related areas
Experience building LLM training frameworks, especially post training

The cash compensation range for this role is $220,000 - $290,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.