Search Quality Analyst

1 Month ago • 4 Years +

Job Summary

Job Description

Perplexity is looking for an experienced data analyst to accelerate the development of advanced search technologies. You will identify robust and sensitive signals from user behavior to help us gather insights from A/B experiment data more efficiently. The role involves developing data-driven insights, formulating and validating hypotheses through A/B tests, determining appropriate metrics and visualizations, and designing and implementing data pipelines to improve search quality. The company has experienced tremendous growth with 10 million monthly active users and significant funding from respected investors.

Must have:

4+ years of data analyst experience.
Experience with search-related products.
Strong Python skills for production-grade code.
Proficiency with SQL.
Experience with Business Intelligence tools.
Deep knowledge of statistics.

Good to have:

Proficiency with Apache Spark.
Experience with Databricks.
Experience with development of LLM-as-a-judge systems

7 skills required

7 skills required for this role

Add these skills to join the top 1% applicants for this job

data-analytics

game-texts

quality-control

business-intelligence

spark

python

sql

Job Details

Responsibilities

Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
Design and implement data pipelines that produce datasets to help the ML team improve search quality

Qualifications

4+ years of experience working as a data analyst or in a related role
Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
Strong Python skills (expected to write production-grade code)
Proficiency with SQL
Experience with Business Intelligence (BI) tools
Deep knowledge of statistics

Preferred Qualifications

Proficiency with Apache Spark
Experience with Databricks
Experience with development of LLM-as-a-judge systems

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.

Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.