AI Training Infrastructure Engineer - Post Training

2 Months ago • 6 Years + • Devops • $220,000 PA - $290,000 PA

Job Summary

Job Description

Perplexity is seeking experienced AI Research Engineers and Scientists to improve their in-house Online LLMs, the Sonar models. The role involves creating a robust and effective training framework, especially for post-training LLMs. Responsibilities include building a post-training framework, implementing necessary infrastructure for the latest models and algorithms, owning the data, training, and evaluation pipelines, and collaborating with engineering teams. The job requires experience with large-scale LLM frameworks, proficiency in Python/Pytorch, and a passion for tackling challenging problems.
Must have:
  • Experience with large-scale LLMs frameworks.
  • Strong in Python/Pytorch; C++/CUDA is a plus.
  • Self-starter with willingness to take ownership.
  • Passion for tackling challenging problems.
Good to have:
  • PhD in AI/ML/Systems or related areas.
  • Experience building LLM training frameworks.
Perks:
  • Comprehensive health, dental, and vision insurance.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

Perplexity is seeking experienced AI Research Engineers and Scientists to continue to improve our in house Online LLMs, the Sonar models. Your job is to work with team and create a robust and effective training framework (on top of Megatron/PyTorch), especially for post training LLMs.

Responsibilities

  • Build a post training framework that can run cutting-edge model training jobs in scale
  • Implement the necessary infra and components to support latest models and algorithms like SFT, RL (DPO/GRPO) and more
  • Own the full stack data, training, and eval pipelines required to post-train LLM models
  • Work closing with engineering teams to integrate Sonar models into our product.

Qualifications

  • Proven experience with large-scale LLMs frameworks building
  • Strong in Python/Pytorch; C++/CUDA is a plus
  • Self-starter with a willingness to take ownership of tasks
  • Passion for tackling challenging problems
  • Minimum of 6 years of working on relevant projects.

Bonus

  • PhD in AI/ML/Systems or related areas
  • Experience building LLM training frameworks, especially post training

The cash compensation range for this role is $220,000 - $290,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

 

Similar Jobs

Riot Games - Staff Software Engineer - UnEco

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
Mapbox - Software Development Engineer II, 3DLN, C++ Rendering

Mapbox

Germany (Remote)
5 Months ago
playrix  - Senior QA Automation Engineer

playrix

Ireland (Remote)
3 Months ago
Bungie - Destiny Senior UI Engineer

Bungie

(Hybrid)
6 Months ago
Scanline VFX - Release DevOps Engineer

Scanline VFX

Seoul, South Korea (Hybrid)
3 Months ago
Temporal Technologies - Staff Solutions Architect

Temporal Technologies

Seattle, Washington, United States (On-Site)
1 Month ago
N-ix - Principal Engineer/Architect (Software DVR/NVR)

N-ix

Münster, North Rhine-Westphalia, Germany (On-Site)
2 Weeks ago
bytedance - Site Reliability Engineer - AML

bytedance

San Jose, California, United States (On-Site)
8 Months ago
undefined - Senior Front End infrastructure Engineer

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
sitetracker - Salesforce Solution Architect

sitetracker

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

luxsoft - Senior Software Developer C++

luxsoft

Egypt (Remote)
4 Days ago
Perplexity - Senior Machine Learning Engineer - Search

Perplexity

London, England, United Kingdom (On-Site)
2 Months ago
Ansys - Spring 2026 Intern - Meshing (MS/PHD)

Ansys

Evanston, Illinois, United States (On-Site)
2 Months ago
sphere entertainment - Senior Firmware Engineer

sphere entertainment

Bozeman, Montana, United States (On-Site)
1 Week ago
SEGA - Senior Software Engineer (Graphics)

SEGA

England, United Kingdom (Hybrid)
3 Months ago
Nintendo - CONTRACT - Graphics Engineer, SDET (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
1 Year ago
welevel  - Working Student Game Engineering

welevel

Munich, Bavaria, Germany (On-Site)
2 Months ago
Donkey crew - UI Programmer

Donkey crew

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Months ago
Epic Games - Senior UI Programmer

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago
Qualcomm - Kernel Stability Engineer

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Fox Factory - Customer Service Warranty Representative

Fox Factory

Baxter, Minnesota, United States (On-Site)
6 Days ago
Aftershock Media Group - Account Manager, Influencer Marketing - English & Mandarin Fluent

Aftershock Media Group

United States (Remote)
1 Month ago
Apple - Software Image Quality Engineer - Creativity Apps

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Roblox - Principal Software Engineer, 3D Foundation Model Data

Roblox

San Mateo, California, United States (On-Site)
4 Weeks ago
HCL Tech - Product Specialist

HCL Tech

Texas, United States (On-Site)
2 Months ago
Nintendo - Animator (Retro Studios)

Nintendo

Austin, Texas, United States (On-Site)
8 Months ago
bytedance - Cloud Site Reliability Engineer

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Ramboll3 - Senior Project Engineer, Civil (Data Center)

Ramboll3

Albany, New York, United States (Remote)
2 Months ago
Advanced Systems Group, LLC - Post Production Desktop Support Technician

Advanced Systems Group, LLC

Culver City, California, United States (On-Site)
1 Month ago
Fortra - Sr. Director, Security Operations

Fortra

United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Devops Jobs

endava - Senior Cloud Operations Engineer - AWS

endava

Cluj-Napoca, Cluj County, Romania (On-Site)
1 Month ago
Unity - Senior ML Infrastructure Engineer

Unity

San Francisco, California, United States (On-Site)
9 Months ago
Rackner - Cloud Architect

Rackner

Washington, District Of Columbia, United States (Remote)
2 Months ago
FICO - DevOps Engineering-Sr Engineer

FICO

Bengaluru, Karnataka, India (On-Site)
2 Months ago
FitXR - Backend Engineer (DevOps / Cloud)

FitXR

United Kingdom (Remote)
1 Week ago
zoox - Platform Engineer

zoox

Foster City, California, United States (Hybrid)
2 Years ago
binance - Golang Developer, Cloud Native

binance

Taipei City, Taiwan (Remote)
1 Year ago
Behaviour Interactive - Senior Build and Pipeline Programmer

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
2 Months ago
Rippling - Senior Software Engineer - Compute Infrastructure

Rippling

Seattle, Washington, United States (On-Site)
2 Months ago
cirrus logic - DevOps Engineer – CI/CD & Software Automation

cirrus logic

Austin, Texas, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

Palo Alto, California, United States (On-Site)

San Francisco, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

New York, United States (On-Site)

Belgrade, Serbia (Hybrid)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug