AI Training Infrastructure Engineer - Post Training

3 Hours ago • 6 Years + • $220,000 PA - $290,000 PA

Job Summary

Job Description

Perplexity is seeking experienced AI Research Engineers and Scientists to improve their in-house Online LLMs, the Sonar models. The role involves creating a robust and effective training framework, especially for post-training LLMs. Responsibilities include building a post-training framework, implementing necessary infrastructure for the latest models and algorithms, owning the data, training, and evaluation pipelines, and collaborating with engineering teams. The job requires experience with large-scale LLM frameworks, proficiency in Python/Pytorch, and a passion for tackling challenging problems.
Must have:
  • Experience with large-scale LLMs frameworks.
  • Strong in Python/Pytorch; C++/CUDA is a plus.
  • Self-starter with willingness to take ownership.
  • Passion for tackling challenging problems.
Good to have:
  • PhD in AI/ML/Systems or related areas.
  • Experience building LLM training frameworks.
Perks:
  • Comprehensive health, dental, and vision insurance.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

Perplexity is seeking experienced AI Research Engineers and Scientists to continue to improve our in house Online LLMs, the Sonar models. Your job is to work with team and create a robust and effective training framework (on top of Megatron/PyTorch), especially for post training LLMs.

Responsibilities

  • Build a post training framework that can run cutting-edge model training jobs in scale
  • Implement the necessary infra and components to support latest models and algorithms like SFT, RL (DPO/GRPO) and more
  • Own the full stack data, training, and eval pipelines required to post-train LLM models
  • Work closing with engineering teams to integrate Sonar models into our product.

Qualifications

  • Proven experience with large-scale LLMs frameworks building
  • Strong in Python/Pytorch; C++/CUDA is a plus
  • Self-starter with a willingness to take ownership of tasks
  • Passion for tackling challenging problems
  • Minimum of 6 years of working on relevant projects.

Bonus

  • PhD in AI/ML/Systems or related areas
  • Experience building LLM training frameworks, especially post training

The cash compensation range for this role is $220,000 - $290,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

ByteDance - Backend Software Engineer

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
4 Months ago
Kalam Labs - Control System Engineer

Kalam Labs

Lucknow, Uttar Pradesh, India (On-Site)
2 Weeks ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Speech & Audio) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ByteDance - Algorithm Engineer - Enterprise Solution RD

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Google - Staff Software Engineer, Host Networking

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer III, Education Scaled Deployments

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Fluxon - Staff Software Engineer

Fluxon

(Remote)
2 Days ago
ByteDance - Student Researcher (Doubao (Seed) - Generative AI)

ByteDance

San Jose, California, United States (Hybrid)
1 Month ago
Crowd Strick - Sr. Engineer, Backend - Ingestion

Crowd Strick

(Remote)
1 Week ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

Fremont, California, United States (Remote)
6 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud Compute Infrastructure

Google

Kirkland, Washington, United States (On-Site)
4 Months ago
Google - Software Developer III, AI/ML, Google Workspace

Google

Waterloo, Ontario, Canada (On-Site)
2 Weeks ago
SingleStore - Software Engineer, Query Performance (C/C++)

SingleStore

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
Epic Games - Senior Software Engineer

Epic Games

Germany (On-Site)
1 Month ago
Workato - Senior Software Engineer (Rust)

Workato

(Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

London stock Exchange - Senior Sales Specialist- Trading Solutions

London stock Exchange

New York, United States (On-Site)
1 Week ago
Sleeper - Backend Engineer

Sleeper

Los Angeles, California, United States (Remote)
1 Month ago
quience - Principal Data Scientist, ML - Planning

quience

United States (On-Site)
2 Weeks ago
Evolution - In-Studio Game Presenter (Live Chat Agent Alternative)

Evolution

Atlantic City, New Jersey, United States (On-Site)
2 Days ago
Motorola Solutions - Channel Account Manager - Video

Motorola Solutions

Utah, United States (On-Site)
2 Weeks ago
WebMD - Marketing Solutions Associate

WebMD

Madison, Wisconsin, United States (On-Site)
3 Months ago
ByteDance - Network Software Development Engineer, Switch

ByteDance

San Jose, California, United States (On-Site)
4 Weeks ago
Interactive Brokers - Senior DevOps/Software Engineer

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
7 Months ago
Life church - Donor Relationship Manager

Life church

Edmond, Oklahoma, United States (On-Site)
7 Months ago
CD PROJEKT RED - UI Designer

CD PROJEKT RED

Boston, Massachusetts, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug