AI Software Engineer - Data Platform

10 Hours ago • 5 Years + • $200,000 PA - $280,000 PA

Job Summary

Job Description

Perplexity is looking for an experienced Software Engineer to build the next-generation AI Data Platform. You will be responsible for designing, building, and maintaining scalable data pipelines and data lakes, developing, deploying, and monitoring the entire data lifecycle, and implementing tools and abstractions for various analytics and AI product use cases. You will collaborate with different teams to develop reusable data resources and design patterns. This role requires strong programming and data engineering skills, familiarity with cloud-based data services and containerized infrastructure, and experience supporting ML/AI engineering teams.
Must have:
  • Proficiency in open source & distributed data processing (AWS, Spark, etc.)
  • Familiarity with cloud-based data services and containerized infrastructure.
  • Strong quantitative and engineering skills with experience in estimating performance.
Perks:
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan

Job Details

Perplexity is seeking an experienced Software Engineer focusing on building the next-gen AI Data Platform to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity’s end-to-end AI data stack and flywheel which powers all AI products, ML use cases and language models.

Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity’s data stack powers scalable, personalized and fast answers for millions of people worldwide.

Tech Stack: Spark | AWS Data Stack (S3, RDS, DynamoDB, Docker, EKS, Kinesis) | Pytorch | Docker | Databricks | Snowflake 

Responsibilities

  • Collaborating closely with AI Product, Applied ML, Post-Training and Data Science teams to design, build, and maintain scalable data pipelines and data lakes
  • Developing, deploying, and monitoring entire data lifecycle for ingestion, transformation, streaming and storage at high scale
  • Implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, AI product and post-training use cases
  • Working closely with product and AI teams to develop reusable data resources and design patterns

Qualifications

  • Extensive programming and data engineering skills, with proficiency in open source & distributed data processing (AWS, Spark, Flink, Iceberg)
  • Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC
  • Strong quantitative and engineering skills with experience in estimating performance at high scale
  • Experience supporting various ML/AI engineering teams to build scalable platforms to accelerate R&D for frontier models and AI products
  • Self-motivated with a strong sense of ownership of systems and designs
  • 5+ years of industry experience in distributed systems or AI infrastructure

The cash compensation range for this role is $200,000 - $280,000.

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
 
 

Similar Jobs

DEVOTEAM - Azure Data Engineer H/F

DEVOTEAM

Île-de-France, France (Remote)
6 Months ago
Truecaller - Senior Data Scientist

Truecaller

Bengaluru, Karnataka, India (On-Site)
9 Hours ago
Unity - Staff Data Scientist

Unity

Montreal, Quebec, Canada (On-Site)
10 Hours ago
Next Level Business Services - Senior Java, Cloud Foundry Developer (Full Time)

Next Level Business Services

Herndon, Virginia, United States (On-Site)
6 Months ago
Logrhytm - Regional Sales Manager (SE Region)

Logrhytm

United States (On-Site)
10 Hours ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

HCL Tech - Test Lead

HCL Tech

California, United States (On-Site)
1 Day ago
ByteDance - Site Reliability Engineer Intern

ByteDance

San Jose, California, United States (On-Site)
2 Weeks ago
ION - Data Engineer

ION

Budapest, Hungary (On-Site)
6 Months ago
OLIVER+ - Integrated Designer (German Fluent)

OLIVER+

New Delhi, Delhi, India (On-Site)
9 Hours ago
Flexera - Senior UI Engineer

Flexera

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Inworld AI - Staff / Principal AI Researcher - USA

Inworld AI

Mountain View, California, United States (Remote)
4 Months ago
Actian - Engagement Manager

Actian

(Remote)
10 Hours ago
The Workshop - Data Software Engineer

The Workshop

Málaga, Andalusia, Spain (Hybrid)
8 Months ago
Ness - Lead Big Data Engineer

Ness

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Burbank, California, United States (On-Site)
3 Months ago
Activision - Lead Systems Designer

Activision

Wisconsin, United States (Hybrid)
1 Month ago
Meetelise - AI Operations Specialist - Housing

Meetelise

New York, New York, United States (On-Site)
6 Months ago
Visa - Sr. Paralegal, Internal Creative Marketing Services (Ad Hock)

Visa

Atlanta, Georgia, United States (Hybrid)
2 Days ago
Second Dinner - Senior Platform Engineer I - SDK & Game Integration

Second Dinner

United States (Remote)
3 Weeks ago
Sitetracker - IT Administrator

Sitetracker

Montclair, New Jersey, United States (Hybrid)
10 Hours ago
Next Level Business Services - .NET Developer (Full Time)

Next Level Business Services

Sammamish, Washington, United States (On-Site)
6 Months ago
WebFX - Jr. Copy Project Manager

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
6 Months ago
Next Level Business Services - Google Analytics

Next Level Business Services

San Antonio, Texas, United States (On-Site)
6 Months ago
Samsung Semiconductor - Staff Engineer, CPU Microarchitecture

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

Belgrade, Serbia (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug