AI Software Engineer - Evaluation Platform

3 Months ago • 3 Years + • Devops • $200,000 PA - $270,000 PA

Job Summary

Job Description

This role involves building a full-stack platform for debugging and evaluating LLM outputs. Responsibilities include designing front-end interfaces and back-end systems to monitor AI product performance, collaborating with engineers to deliver solutions, improving existing tools, and ensuring deep insights into Perplexity’s performance. The role requires strong full-stack experience and good quantitative understanding. Bonus experience includes working with generative AI tools or LLMs. The candidate will be a founding engineer for a new team, working on greenfield projects with high ownership.
Must have:
  • Strong experience in full-stack software development
  • Self-motivated with a willingness to take ownership
  • Good quantitative understanding of data
  • Strong communication and collaboration skills
  • 3+ years of industry experience
Good to have:
  • Experience working with generative AI tools or LLMs
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

Perplexity is changing the way people search the internet and we are seeking a founding engineer for a new team that will change how Perplexity employees search through internal data.

Our team behind Deep Research and other cutting edge AI features is looking for a full stack engineer that is passionate about building evaluation platform for LLM answers and Agent behaviors. You will be partnering with AI engineers to redefine the debugging and evaluation of answer quality tooling process to supercharge our AI development. If you value working on greenfield projects and enjoy high levels of ownership, this is the right role for you.

Tech Stack: NextJS | TypeScript | Python | Postgres | Docker | AWS

Responsibilities

  • Building new 0-1 full-stack platform for debugging and evaluating LLM outputs.
  • Design intuitive front-end interfaces and robust back-end systems for monitoring the performance of AI product and AI systems.
  • Collaborate with researchers and engineers to understand their needs and deliver effective full-stack solutions.
  • Continuously improve existing tools and develop new features to meet evolving requirements.
  • Work closely with Engineers, Product, Design, and Data to ensure deep insights into Perplexity’s performance.

Qualifications

  • Strong experience in full-stack software development, with the ability to work across the full-stack necessary to build scientific research platform or production tools.
  • Self-motivated with a willingness to take ownership of tasks
  • Good quantitative understanding of data and visualization
  • Strong communication skills and the ability to work collaboratively in a team environment.
  • 3+ years of industry experience

Bonus

  • Bonus: Experience working with generative AI tools or LLMs.

The cash compensation range for this role is $200,000 - $270,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

Salesforce - Applied AI in Database Systems - PMTS/Architect

Salesforce

Hyderabad, Telangana, India (On-Site)
2 Months ago
Ubisoft - Senior ML Data Scientist

Ubisoft

Montreal, Quebec, Canada (On-Site)
7 Months ago
Qualcomm - Chipset Architect

Qualcomm

Bengaluru, Karnataka, India (On-Site)
3 Months ago
unseen tokyo - Marketing Producer

unseen tokyo

Tokyo, Japan (Hybrid)
1 Month ago
EveryMatrix - QA Tester

EveryMatrix

Bucharest, Romania (Hybrid)
1 Month ago
Vercel - Engineering Manager, SRE

Vercel

New York, New York, United States (Hybrid)
3 Months ago
T systems - SAP Solution Portfolio Architect

T systems

Pune, Maharashtra, India (On-Site)
1 Month ago
NVIDIA - Senior Solutions Architect, Omniverse Platform

NVIDIA

Shanghai, Shanghai, China (On-Site)
7 Months ago
Sword Health - DevOps Engineer

Sword Health

Portugal (Hybrid)
5 Months ago
Sonar Source - Senior Cloud Solutions Engineer

Sonar Source

Austin, Texas, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Thales - Confirmed DevOps Engineer F/M

Thales

Rennes, Brittany, France (Hybrid)
4 Weeks ago
Siemens  - SAP Development Manager

Siemens

Pune, Maharashtra, India (On-Site)
3 Months ago
Newrick Network - Senior Backend Developer - PHP Laravel

Newrick Network

Buenos Aires, Buenos Aires, Argentina (Hybrid)
1 Month ago
Click Therapeutics - Senior Business Development Manager/Associate Business Development Director

Click Therapeutics

New York, United States (Hybrid)
3 Months ago
IGT - Game Mathematician II

IGT

Las Vegas, Nevada, United States (On-Site)
2 Months ago
Square - Senior Cost Manager/Project Quantity Surveyor - Construction

Square

Newcastle Upon Tyne, England, United Kingdom (On-Site)
1 Month ago
Haleon - Network Operations Director, QSC NA

Haleon

Warren, New Jersey, United States (On-Site)
1 Month ago
Ubisoft - UI Programmer

Ubisoft

Shanghai, Shanghai, China (On-Site)
6 Months ago
22squared - Media Coordinator, Finance

22squared

Atlanta, Georgia, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Figma - Software Engineer, AI Product

Figma

San Francisco, California, United States (Remote)
4 Weeks ago
Nintendo - Localization Specialist (Japanese)

Nintendo

Redmond, Washington, United States (Hybrid)
9 Months ago
PayPal - Director, Business Operations

PayPal

San Jose, California, United States (Hybrid)
1 Month ago
Lorikeet - Head of Forward Deployed Engineering

Lorikeet

United States (Remote)
1 Month ago
Qualcomm - SoC Infrastructure IP System HW Architect - RAS

Qualcomm

San Diego, California, United States (On-Site)
2 Months ago
bytedance - Software Engineer Intern (Cloud Native Infrastructure)

bytedance

San Jose, California, United States (On-Site)
4 Months ago
Instawork - Product Operations Intern

Instawork

Chicago, Illinois, United States (Hybrid)
3 Weeks ago
Rippling - Director, SDR Technology & Operations

Rippling

San Francisco, California, United States (Hybrid)
3 Weeks ago
Cambium - Senior AI Engineer

Cambium

San Francisco, California, United States (Hybrid)
1 Month ago
Axon - Senior Mobile Engineer (Vehicle Intelligence)

Axon

Seattle, Washington, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Devops Jobs

Cavnue - Senior Platform Infrastructure Engineer

Cavnue

United States (Remote)
3 Months ago
Palo Alto Networks - Principal Site Reliability Engineer

Palo Alto Networks

Santa Clara, California, United States (On-Site)
1 Month ago
Visa - Sr. Site Reliability Engineer

Visa

Ashburn, Virginia, United States (Hybrid)
3 Months ago
WebMD - Site Reliability Engineer

WebMD

Boise, Idaho, United States (On-Site)
2 Months ago
Granicus - Associate Solution Architect

Granicus

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
JDA - Enterprise Solution Architect - Consulting

JDA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
C3 IoT - AI Solution Architect / Senior AI Solution Architect (Post-Sales)

C3 IoT

New York, New York, United States (On-Site)
1 Month ago
Glean - Solutions Engineer

Glean

Palo Alto, California, United States (On-Site)
3 Months ago
Intel  - Platform Hardware Engineer

Intel

Guadalajara, Jalisco, Mexico (On-Site)
1 Year ago
Nium - Senior DevOps Engineer

Nium

Malta (Hybrid)
1 Year ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

Belgrade, Serbia (Hybrid)

Palo Alto, California, United States (On-Site)

New York, New York, United States (Hybrid)

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug