AI Software Engineer - Data Platform

8 Months ago • 5 Years + • Data Analysis • $200,000 PA - $280,000 PA

Job Summary

Job Description

Perplexity is an AI-powered answer engine seeking an experienced Software Engineer to build the next-generation AI Data Platform. This role involves developing Perplexity's end-to-end AI data stack and flywheel, powering AI products, ML use cases, and language models. The company is rapidly scaling its user base and use cases. The data stack supports scalable, personalized, and fast answers for millions globally. Responsibilities include collaborating with AI Product, Applied ML, Post-Training, and Data Science teams to design and maintain scalable data pipelines and lakes. You will also develop, deploy, and monitor the entire data lifecycle, and implement tools and abstractions on top of data infrastructure for various analytics and AI product use cases.
Must have:
  • Proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (AWS, RDS, DynamoDB)
  • Experience with containerized infrastructure (EKS, Docker)
  • Knowledge of data streaming (Flink, Spark streaming, CDC)
  • Strong quantitative and engineering skills
  • Experience supporting ML/AI engineering teams
  • Self-motivated with strong ownership of systems
Good to have:
  • Experience in Databricks
  • Experience in Snowflake
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world’s leading AI platforms. Perplexity has raised over $1B in venture investment from some of the world’s most visionary and successful leaders, including Elad Gil, Daniel Gross, Jeff Bezos, Accel, IVP, NEA, NVIDIA, Samsung, and many more. Our objective is to build accurate, trustworthy AI that powers decision-making for people and assistive AI wherever decisions are being made. Throughout human history, change and innovation have always been driven by curious people. Today, curious people use Perplexity to answer more than 780 million queries every month–a number that’s growing rapidly for one simple reason: everyone can be curious. 

Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.

Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | Snowflake 

Responsibilities

  • Collaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakes
  • Developing, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scale
  • Implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use cases
  • Working closely with product and AI teams to develop reusable data resources and design patterns

Qualifications

  • Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC
  • Strong quantitative and engineering skills with experience in estimating performance at high scale
  • Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products
  • Self-motivated with a strong sense of ownership of systems and designs
  • 5+ years of industry experience in distributed systems or AI infrastructure

The cash compensation range for this role is $200,000 - $280,000.


Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
 
 

Similar Jobs

Nintendo - Senior Ambassador - Nintendo San Francisco Store

Nintendo

San Francisco, California, United States (On-Site)
8 Months ago
Alpha Sense - Sr. IT Engineer, Enterprise Systems Technology

Alpha Sense

Vancouver, British Columbia, Canada (Hybrid)
2 Months ago
endava - Senior Angular Developer (SE)

endava

Bogotá, Bogota, Colombia (On-Site)
2 Months ago
London stock Exchange - Tech Lead -Database SRE

London stock Exchange

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Neolytix - Healthcare Data Analytics

Neolytix

Gurugram, Haryana, India (Hybrid)
1 Month ago
Discord - Senior Data Scientist, Analytics

Discord

California, United States (On-Site)
3 Weeks ago
Spyke Games - Data Scientist

Spyke Games

İstanbul, Türkiye (On-Site)
10 Months ago
ShyftLabs - Senior Data Analyst

ShyftLabs

Knoxville, Tennessee, United States (Hybrid)
2 Weeks ago
Rockstar Games - Senior Data Engineer

Rockstar Games

New York, United States (On-Site)
2 Months ago
Crunchyroll - Senior Software Engineer - Data

Crunchyroll

Hyderabad, Telangana, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

frozenbyte games - Support/Community

frozenbyte games

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
Nine - Commercial Brand Executive

Nine

North Sydney, New South Wales, Australia (On-Site)
3 Weeks ago
Brillio - Client Partner - Insurance

Brillio

London, England, United Kingdom (Hybrid)
3 Months ago
Nice - Sales Development Representative

Nice

Sandy, Utah, United States (Hybrid)
1 Month ago
Tesla - Mobile Vehicle Mechatronics Technician/Automotive Mechanic

Tesla

Hamburg, Hamburg, Germany (On-Site)
6 Months ago
PayPal - Cybersecurity Metrics Analyst

PayPal

Chicago, Illinois, United States (Hybrid)
2 Months ago
Rocket Science - Producer (Technical Account Manager)

Rocket Science

Cardiff, Wales, United Kingdom (Hybrid)
4 Months ago
Puzzle Cats - Creative Marketing & User Acquisition Specialist

Puzzle Cats

Toronto, Ontario, Canada (Remote)
3 Months ago
Alpha Sense - Manager, Sales Development - Corporate

Alpha Sense

New York, United States (Hybrid)
1 Month ago
deel. - Senior Backend Engineer, Node.js + AWS

deel.

Georgia (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

bytedance - Software Prototype Engineer - iOS & Android

bytedance

San Jose, California, United States (On-Site)
2 Months ago
AGBO - Senior Level Designer / Art Implementation

AGBO

United States (Remote)
4 Months ago
The Walt Disney Company - Lead Software Engineer - Roku/BrightScript/SceneGraph

The Walt Disney Company

San Francisco, California, United States (On-Site)
3 Months ago
Apple - Senior / Staff Data Infrastructure Engineer for Lakehouse, Apple Data Platform

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Daybreak Game Company LLC - Senior Accountant

Daybreak Game Company LLC

San Diego, California, United States (Hybrid)
4 Months ago
Booming Games - Game Artist

Booming Games

Oregon, United States (Remote)
2 Months ago
Ramp - Senior Product Designer

Ramp

New York, United States (Hybrid)
3 Weeks ago
Payactive - Marketing Copywriter

Payactive

Milpitas, California, United States (Hybrid)
10 Months ago
Everlaw - Senior Technical Program Manager (Revenue & QTC)

Everlaw

Oakland, California, United States (Hybrid)
4 Weeks ago
Pinterest - Director, Product Management - Merchants

Pinterest

San Francisco, California, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

CRB workforce  - Senior Business Analyst

CRB workforce

El Segundo, California, United States (Remote)
3 Months ago
Rockstar Games - Senior Data Engineer

Rockstar Games

New York, United States (On-Site)
2 Months ago
ARHS - Data Engineer

ARHS

Athens, Greece (On-Site)
3 Months ago
Apple - AI Data Scientist

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Diligent Corporation - Product Data Scientist

Diligent Corporation

Budapest, Hungary (On-Site)
3 Months ago
endava - Data Engineer (Azure)

endava

Cali, Valle Del Cauca, Colombia (On-Site)
2 Months ago
Ion - Data Scientist, Data Analyst

Ion

Pisa, Tuscany, Italy (Hybrid)
4 Years ago
EvenUp - Senior Data Engineer - Analytics

EvenUp

San Francisco, California, United States (Hybrid)
1 Month ago
Highspot - Sr. Data Analyst

Highspot

Hyderabad, Telangana, India (Hybrid)
5 Months ago
Jam City - DATA ENGINEER

Jam City

Montevideo, Montevideo Department, Uruguay (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

About The Company

Belgrade, Serbia (Hybrid)

Palo Alto, California, United States (On-Site)

New York, New York, United States (Hybrid)

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity