AI Software Engineer - Data Platform

17 Hours ago • 5 Years + • $200,000 PA - $280,000 PA

Job Summary

Job Description

Perplexity is seeking an experienced Software Engineer to build the next-generation AI Data Platform, which will revolutionize how people search and interact online. The role involves building Perplexity's end-to-end AI data stack, powering AI products, ML use cases, and language models. The data stack supports scalable, personalized, and fast answers for millions of users worldwide. Responsibilities include designing, building, and maintaining scalable data pipelines and data lakes; developing, deploying, and monitoring the entire data lifecycle; implementing tools and abstractions for analytics and AI product use cases; and working with product and AI teams to develop reusable data resources.
Must have:
  • Extensive programming and data engineering skills
  • Familiarity with cloud-based data services
  • Strong quantitative and engineering skills
  • Experience supporting ML/AI engineering teams
  • Self-motivated with a strong sense of ownership

Job Details

Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.

Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | Snowflake 

Responsibilities

  • Collaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakes
  • Developing, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scale
  • Implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use cases
  • Working closely with product and AI teams to develop reusable data resources and design patterns

Qualifications

  • Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC
  • Strong quantitative and engineering skills with experience in estimating performance at high scale
  • Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products
  • Self-motivated with a strong sense of ownership of systems and designs
  • 5+ years of industry experience in distributed systems or AI infrastructure

The cash compensation range for this role is $200,000 - $280,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
 

Similar Jobs

HCL Tech - Solution Director

HCL Tech

Texas, United States (On-Site)
1 Week ago
OLIVER Agency - Senior Designer

OLIVER Agency

Manila, Metro Manila, Philippines (On-Site)
3 Weeks ago
HCL Tech - Senior Tester

HCL Tech

Pennsylvania, United States (On-Site)
3 Weeks ago
Inworld AI - Staff Backend Engineer

Inworld AI

Mountain View, California, United States (Hybrid)
4 Weeks ago
Attentive - Staff Machine Learning Engineer

Attentive

San Francisco, California, United States (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Outbrain - Machine Learning Engineer

Outbrain

Ljubljana, Ljubljana, Slovenia (Hybrid)
3 Weeks ago
buildstsaff - Full Stack Developer

buildstsaff

Irvine, California, United States (On-Site)
7 Years ago
N-iX - Senior .NET Engineer (with ETL Experience)

N-iX

Poland (Remote)
1 Month ago
PwC - Senior Associate_Azure Data Enginer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Fanatee - Data Science Intern

Fanatee

(On-Site)
10 Months ago
HCL Tech - Senior Technical Specialist

HCL Tech

London, England, United Kingdom (On-Site)
2 Weeks ago
Rackspace Technology - Data Science Trainee (US Shift Working)

Rackspace Technology

Vietnam (Remote)
1 Month ago
Netflix - Manager, Publicity - Japan

Netflix

Tokyo, Japan (On-Site)
4 Months ago
IMC - C++ Software Engineer

IMC

Mumbai, Maharashtra, India (On-Site)
3 Weeks ago
Voodoo - Senior Analytics Engineer - Ad-network

Voodoo

Paris, Île-de-France, France (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Absurd Ventures - General Game Development Application

Absurd Ventures

Santa Monica, California, United States (On-Site)
3 Weeks ago
Scientific Games  - General Manager, iLottery

Scientific Games

Pennsylvania, United States (Remote)
3 Months ago
Next Level Business Services - IBM MDM delivery lead

Next Level Business Services

Boston, Massachusetts, United States (On-Site)
7 Months ago
ION - Senior Technical Consultant - Endur

ION

Dallas, Texas, United States (On-Site)
7 Months ago
Philips - Senior Analyst, Sales Compensation Design

Philips

Plymouth, Minnesota, United States (On-Site)
2 Weeks ago
Canva - Revenue Operations Manager, NPI

Canva

Los Angeles, California, United States (Remote)
1 Month ago
Infinity Ward - Senior Lighting Artist

Infinity Ward

Los Angeles, California, United States (On-Site)
1 Week ago
Transformation Church - Youth / Internship Project Manager

Transformation Church

Tulsa, Oklahoma, United States (On-Site)
3 Weeks ago
MRI Software - Project Manager I

MRI Software

Solon, Ohio, United States (Hybrid)
1 Week ago
Riot Games - Staff Software Engineer, Game Build - Teamfight Tactics

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (Hybrid)

New York, United States (On-Site)

New York, United States (Hybrid)

Belgrade, Serbia (Hybrid)

California, United States (On-Site)

San Francisco, California, United States (On-Site)

California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug