AI Software Engineer - Evaluation Platform

2 Months ago • 3 Years + • Devops • $200,000 PA - $270,000 PA

Job Summary

Job Description

This role involves building a full-stack platform for debugging and evaluating LLM outputs. Responsibilities include designing front-end interfaces and back-end systems to monitor AI product performance, collaborating with engineers to deliver solutions, improving existing tools, and ensuring deep insights into Perplexity’s performance. The role requires strong full-stack experience and good quantitative understanding. Bonus experience includes working with generative AI tools or LLMs. The candidate will be a founding engineer for a new team, working on greenfield projects with high ownership.
Must have:
  • Strong experience in full-stack software development
  • Self-motivated with a willingness to take ownership
  • Good quantitative understanding of data
  • Strong communication and collaboration skills
  • 3+ years of industry experience
Good to have:
  • Experience working with generative AI tools or LLMs
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

Perplexity is changing the way people search the internet and we are seeking a founding engineer for a new team that will change how Perplexity employees search through internal data.

Our team behind Deep Research and other cutting edge AI features is looking for a full stack engineer that is passionate about building evaluation platform for LLM answers and Agent behaviors. You will be partnering with AI engineers to redefine the debugging and evaluation of answer quality tooling process to supercharge our AI development. If you value working on greenfield projects and enjoy high levels of ownership, this is the right role for you.

Tech Stack: NextJS | TypeScript | Python | Postgres | Docker | AWS

Responsibilities

  • Building new 0-1 full-stack platform for debugging and evaluating LLM outputs.
  • Design intuitive front-end interfaces and robust back-end systems for monitoring the performance of AI product and AI systems.
  • Collaborate with researchers and engineers to understand their needs and deliver effective full-stack solutions.
  • Continuously improve existing tools and develop new features to meet evolving requirements.
  • Work closely with Engineers, Product, Design, and Data to ensure deep insights into Perplexity’s performance.

Qualifications

  • Strong experience in full-stack software development, with the ability to work across the full-stack necessary to build scientific research platform or production tools.
  • Self-motivated with a willingness to take ownership of tasks
  • Good quantitative understanding of data and visualization
  • Strong communication skills and the ability to work collaboratively in a team environment.
  • 3+ years of industry experience

Bonus

  • Bonus: Experience working with generative AI tools or LLMs.

The cash compensation range for this role is $200,000 - $270,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.

Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

Scanline VFX - Senior Compositor

Scanline VFX

Vancouver, British Columbia, Canada (Hybrid)
6 Months ago
Regent craft - Senior Systems Safety Engineer

Regent craft

North Kingstown, Rhode Island, United States (On-Site)
1 Week ago
AI Fund - Founding Product Designer

AI Fund

San Francisco, California, United States (On-Site)
3 Months ago
Jane Street - Data Engineer

Jane Street

New York, United States (On-Site)
2 Months ago
Cloud Imperium Games - Senior AI Programmer

Cloud Imperium Games

Frankfurt Am Main, Hessen, Germany (On-Site)
1 Month ago
Ion - Cloud Engineer Kubernetes

Ion

Italy (Hybrid)
9 Months ago
luxsoft - DevOps Automation Engineer

luxsoft

India (Remote)
1 Month ago
bytedance - Cloud Site Reliability Engineer

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Ion - Cloud Engineer Kubernetes

Ion

Castellazzo Bormida, Piedmont, Italy (Hybrid)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nintendo - Associate Training Specialist

Nintendo

Redmond, Washington, United States (On-Site)
3 Months ago
Canonical - MAAS Data Center Infrastructure Engineer

Canonical

Toronto, Ontario, Canada (Hybrid)
2 Months ago
Bally's Interactive - Sportsbook Retention Coordinator

Bally's Interactive

Jersey City, New Jersey, United States (Hybrid)
1 Month ago
Guru Studio - 3D Groom Consultant

Guru Studio

Toronto, Ontario, Canada (Remote)
2 Weeks ago
Greenworks Sunrise Global Marketing - Senior Product Manager, Accessories

Greenworks Sunrise Global Marketing

Mooresville, North Carolina, United States (On-Site)
2 Months ago
FlyQuest - Facilities Coordinator

FlyQuest

Culver City, California, United States (On-Site)
3 Months ago
NXP - Intern (Engineering & IT)

NXP

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
10 Months ago
Hawkeye Innovations - Network Infrastructure Engineer

Hawkeye Innovations

Basingstoke, England, United Kingdom (Hybrid)
2 Weeks ago
Sprinkler - Senior Software Development Engineer, QA

Sprinkler

Gurugram, Haryana, India (On-Site)
1 Month ago
GLu Mobile - Director of Product Management

GLu Mobile

Redwood City, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Nagarro - Associate Principal Consultant, Business Analyst

Nagarro

New York, New York, United States (On-Site)
9 Months ago
AGBO - Assistant Game Producer

AGBO

Los Angeles, California, United States (On-Site)
1 Month ago
SS8 - Senior Software Engineer, Audio-Video Processing

SS8

Milpitas, California, United States (On-Site)
1 Month ago
bytedance - Student Researcher (Doubao (Seed) - Foundation Model AI Platform) - 2025 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Expedia - Account Manager, Partner Success

Expedia

Austin, Texas, United States (Hybrid)
1 Year ago
zoox - Systems Engineer - Vehicle Controls Functional Safety

zoox

Foster City, California, United States (Hybrid)
1 Month ago
UPF Industries  - TRUCK DRIVER

UPF Industries

Berlin, New Jersey, United States (On-Site)
2 Months ago
NVIDIA - Senior Firmware Bringup Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Deepgram - Director of Community Growth

Deepgram

United States (Remote)
2 Months ago
TAG - Account Director - Fashion & Beauty

TAG

New York, United States (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Devops Jobs

AeroSpike - Solutions Architect

AeroSpike

Singapore (On-Site)
2 Months ago
Vercel - Engineering Manager, SRE

Vercel

New York, New York, United States (Hybrid)
2 Months ago
Ilyon - Backend Engineer – Cloud & AI Focused

Ilyon

Rosh Haayin, Center District, Israel (On-Site)
2 Days ago
Glean - Solutions Architect

Glean

Seattle, Washington, United States (On-Site)
2 Months ago
Qualcomm - Senior Automotive Platform/BSP Application Engineer

Qualcomm

Berlin, Berlin, Germany (On-Site)
1 Month ago
ansira - Site Reliability Engineer

ansira

Noida, Uttar Pradesh, India (On-Site)
2 Weeks ago
Epic Games - Desktop Platform Engineer, Fortnite Tech

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Scopely - Principal DevOps Engineer - Star Trek Fleet Command

Scopely

Dublin, County Dublin, Ireland (Hybrid)
4 Months ago
Roof Stacks - Software Architect

Roof Stacks

Istanbul, İstanbul, Türkiye (On-Site)
4 Months ago
Canva - Staff Frontend Engineer - Apps API Platform

Canva

Brisbane, Queensland, Australia (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug