AI Software Engineer - Data Platform

2 Months ago • 5 Years + • Data Analysis • $200,000 PA - $280,000 PA

Job Summary

Job Description

Perplexity is seeking an experienced Software Engineer to build the next-generation AI Data Platform, which will revolutionize how people search and interact online. The role involves building Perplexity's end-to-end AI data stack, powering AI products, ML use cases, and language models. The data stack supports scalable, personalized, and fast answers for millions of users worldwide. Responsibilities include designing, building, and maintaining scalable data pipelines and data lakes; developing, deploying, and monitoring the entire data lifecycle; implementing tools and abstractions for analytics and AI product use cases; and working with product and AI teams to develop reusable data resources.
Must have:
  • Extensive programming and data engineering skills
  • Familiarity with cloud-based data services
  • Strong quantitative and engineering skills
  • Experience supporting ML/AI engineering teams
  • Self-motivated with a strong sense of ownership

Job Details

Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.

Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | Snowflake 

Responsibilities

  • Collaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakes
  • Developing, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scale
  • Implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use cases
  • Working closely with product and AI teams to develop reusable data resources and design patterns

Qualifications

  • Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC
  • Strong quantitative and engineering skills with experience in estimating performance at high scale
  • Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products
  • Self-motivated with a strong sense of ownership of systems and designs
  • 5+ years of industry experience in distributed systems or AI infrastructure

The cash compensation range for this role is $200,000 - $280,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
 

Similar Jobs

Infosys - .NET fullstack AWS Developer

Infosys

Juno Beach, Florida, United States (On-Site)
2 Months ago
Motorola solutions - Senior Software Engineer - AI/Computer Vision (Camera Systems)

Motorola solutions

Toronto, Ontario, Canada (Hybrid)
2 Months ago
NXP - Senior Principal Software Architect - Platform and RF Software

NXP

Bucharest, Bucharest, Romania (On-Site)
10 Months ago
Electronic Arts - C++ Software Engineer - Generalist - American Football

Electronic Arts

Madrid, Community Of Madrid, Spain (Hybrid)
6 Months ago
Marsh McLennan - Lead Software Engineer

Marsh McLennan

Dublin, California, United States (Hybrid)
1 Month ago
Trueplay - Data Analyst

Trueplay

(Remote)
2 Months ago
Luxoft - Data Engineer

Luxoft

Mexico City, Mexico City, Mexico (Remote)
8 Months ago
Playtika - Senior DATA/AI SRE Engineer

Playtika

Poland (On-Site)
8 Months ago
London stock Exchange - Data Engineer

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Notion - Data Scientist, GTM

Notion

San Francisco, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Next Level Business Services - Solution Architect

Next Level Business Services

Philadelphia, Pennsylvania, United States (On-Site)
9 Months ago
Trackman - Senior iOS Developer

Trackman

(On-Site)
4 Months ago
binance - Binance Accelerator Program - Blockchain / Smart Contract Security

binance

Taipei City, Taiwan (Remote)
1 Year ago
cirrus logic - Verification Engineer (PS)

cirrus logic

Newbury, England, United Kingdom (Hybrid)
2 Months ago
NopAdvance LLP - : Software Tester

NopAdvance LLP

Surat, Gujarat, India (On-Site)
9 Months ago
Autodesk - Principal Software Engineer, AWS

Autodesk

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Take-Two Interactive - Application Security Architect

Take-Two Interactive

Toronto, Ontario, Canada (On-Site)
2 Months ago
ElevenLabs - Back-End Engineer

ElevenLabs

Bulgaria (Remote)
4 Months ago
Infosys - Lead Java Fullstack Developer

Infosys

Atlanta, Georgia, United States (On-Site)
2 Months ago
Capgemini - C++ & Linux Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

WebFX - Jr. Digital Communications Account Manager

WebFX

Lancaster, Pennsylvania, United States (On-Site)
9 Months ago
AECOM - Senior Project Manager

AECOM

Albany, New York, United States (Hybrid)
1 Month ago
Next Level Business Services - Oracle DBA (With SAP Experience)

Next Level Business Services

Austin, Texas, United States (On-Site)
9 Months ago
Epic Games - Senior C++ Engineer

Epic Games

United States (On-Site)
3 Months ago
sofar sounds - Booker

sofar sounds

Los Angeles, California, United States (On-Site)
1 Month ago
whoop - Senior Hardware Quality Engineer (Accessories)

whoop

Boston, Massachusetts, United States (On-Site)
4 Months ago
Trailer park group - Art Director - Social

Trailer park group

Los Angeles, California, United States (Remote)
2 Months ago
Saviynt - Senior Engineer II, Cloud Operations - Federal Team

Saviynt

Los Angeles, California, United States (Hybrid)
3 Months ago
Philips - Clinical Solutions Implementation Consultant

Philips

United States (On-Site)
1 Month ago
Cadence - Sr Principle Software Engineer

Cadence

Burlington, Massachusetts, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

PwC - Business Analyst Data Modelling-Associate  - Kolkata Y-14 - Technology Consulting

PwC

Kolkata, West Bengal, India (On-Site)
9 Months ago
binance - Data Scientist (LLM)

binance

Taipei City, Taiwan (On-Site)
8 Months ago
Take-Two Interactive - JD Edwards Business Analyst

Take-Two Interactive

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
PayPal - Data Scientist 2

PayPal

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago
PwC - Senior data analyst | Deals (M&A) | CDI | H/F

PwC

Neuilly-sur-Seine, Île-de-France, France (On-Site)
9 Months ago
Kgroup - Business Analyst

Kgroup

Thành Phố Hồ Chí Minh, Vietnam (On-Site)
1 Year ago
Veeam Software - Principal Software Engineer, Data

Veeam Software

Connecticut, United States (Remote)
2 Months ago
Thales - Data Engineer

Thales

Jakarta, Indonesia (On-Site)
2 Months ago
whoop - Senior Data Scientist (Insights)

whoop

Boston, Massachusetts, United States (On-Site)
2 Months ago
Tradu - Data Scientist

Tradu

Chennai, Tamil Nadu, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

About The Company

New York, New York, United States (Hybrid)

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug