Model Behavior Architect

2 Months ago • All levels

Job Summary

Job Description

The Model Behavior Architect will be responsible for shaping systems that reliably answer user questions. This involves designing, refining, and implementing prompt engineering strategies across research and general knowledge use cases. The role requires identifying edge cases and inconsistencies in model outputs through structured testing and prompt iteration. The architect will develop automated and semi-automated pipelines for evaluating prompt effectiveness at scale, collaborating with researchers, PMs, and engineers to align model behavior with product goals. They will also collect and synthesize feedback to improve prompt design and contribute to prompt libraries for internal and production systems. Staying up-to-date with the latest techniques in prompt engineering is essential.
Must have:
  • Demonstrated passion for AI and prompt engineering projects.
  • Background in relevant fields like philosophy or data science.
  • Familiarity with Python and running scripts.
  • Understanding of LLMs, training, and RL.
  • Excellent communication skills for teaching complex concepts.
  • Creative problem-solving abilities.
Perks:
  • Comprehensive health, dental, and vision insurance.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

Perplexity is looking for a Model Behavior Architect to help shape systems that reliably answer users' questions.

Responsibilities

  • Design, refine, and implement prompt engineering strategies to guide model behavior across research and general knowledge use cases
  • Identify edge cases and behavioral inconsistencies in model outputs through structured testing and prompt iteration
  • Develop automated and semi-automated pipelines for evaluating prompt effectiveness at scale
  • Work cross-functionally with researchers, PMs, and engineers to align model behavior with product goals
  • Collect and synthesize qualitative and quantitative feedback to inform prompt design improvements
  • Collaborate on prompt libraries and reusable frameworks for internal and production-facing systems
  • Stay current with the latest prompt engineering, alignment, and evaluation techniques from both industry and academia

Qualifications

  • Demonstrated passion for AI and can share specific prompt engineering and chaining projects you're proud of
  • Background in philosophy, psychology, linguistics, data science, or related fields
  • Familiar with Python and running simple scripts
  • High-level understanding of LLMs, training, RL
  • Excellent communication skills, particularly in teaching complex concepts
  • Creative problem-solving abilities with a "hacker spirit" for solving puzzles

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

oportun - Senior Staff AI Software Engineer

oportun

Mexico (Remote)
1 Month ago
Tencent - Consumer Insights Manager

Tencent

London, England, United Kingdom (On-Site)
1 Month ago
Tencent - Senior Technical Artist

Tencent

(On-Site)
4 Months ago
Interactive Brokers - Compliance Analyst

Interactive Brokers

Kowloon, Hong Kong (Hybrid)
2 Months ago
luxsoft - Business Analyst with Custody and Settlements

luxsoft

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Razer - Senior Audio Video (AV) Engineer

Razer

Chengdu, Sichuan, China (On-Site)
1 Month ago
Glean - Commercial Sales Manager

Glean

San Francisco, California, United States (Hybrid)
1 Week ago
Red Games Co - QA Tester - Services

Red Games Co

Salt Lake City, Utah, United States (On-Site)
1 Week ago
whoop - Senior Data Scientist (Insights)

whoop

Boston, Massachusetts, United States (On-Site)
2 Months ago
Sporty - Game Artist/Visualiser

Sporty

India (Remote)
3 Months ago
The Walt Disney Company - Animator

The Walt Disney Company

Vancouver, British Columbia, Canada (Hybrid)
2 Months ago
Trek - Business Analyst (Enterprise Business Application)

Trek

Gurugram, Haryana, India (On-Site)
1 Year ago
CD PROJEKT RED - Quest Designer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Days ago
house of how - Lead Game Engineer - Sweden

house of how

Boden, Norrbotten County, Sweden (On-Site)
8 Months ago
Atari - Senior Creative Designer, Digital Marketing Campaigns

Atari

United States (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Notion - Software Engineer, Native macOS Development

Notion

San Francisco, California, United States (On-Site)
2 Months ago
Penumbrainc - Sr Manager- IT Infrastructure, Ops

Penumbrainc

Alameda, California, United States (On-Site)
2 Months ago
Activision - Expert Animation Engineer

Activision

Los Angeles, California, United States (On-Site)
3 Months ago
bytedance - Software Engineer Intern

bytedance

San Jose, California, United States (On-Site)
1 Month ago
Lionsgate - HR Coordinator (Motion Picture Group + Corporate)

Lionsgate

Santa Monica, California, United States (On-Site)
2 Weeks ago
Apple - Acoustic Integration Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Aerovect - Software Engineer, Localization, Calibration & Mapping

Aerovect

Atlanta, Georgia, United States (Remote)
1 Week ago
Interface AI - Senior Technical & Product Recruiter (Contract)

Interface AI

San Jose, California, United States (On-Site)
6 Days ago
Nintendo - Sr Software Engineer, Display

Nintendo

Redmond, Washington, United States (On-Site)
2 Months ago
bytedance - Creator Partnerships Intern (Lemon8)

bytedance

New York, New York, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Palo Alto, California, United States (On-Site)

Palo Alto, California, United States (On-Site)

London, England, United Kingdom (On-Site)

New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

Palo Alto, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug