Model Behavior Architect

1 Month ago • All levels

Job Summary

Job Description

The Model Behavior Architect will be responsible for shaping systems that reliably answer user questions. This involves designing, refining, and implementing prompt engineering strategies across research and general knowledge use cases. The role requires identifying edge cases and inconsistencies in model outputs through structured testing and prompt iteration. The architect will develop automated and semi-automated pipelines for evaluating prompt effectiveness at scale, collaborating with researchers, PMs, and engineers to align model behavior with product goals. They will also collect and synthesize feedback to improve prompt design and contribute to prompt libraries for internal and production systems. Staying up-to-date with the latest techniques in prompt engineering is essential.
Must have:
  • Demonstrated passion for AI and prompt engineering projects.
  • Background in relevant fields like philosophy or data science.
  • Familiarity with Python and running scripts.
  • Understanding of LLMs, training, and RL.
  • Excellent communication skills for teaching complex concepts.
  • Creative problem-solving abilities.
Perks:
  • Comprehensive health, dental, and vision insurance.
  • 401(k) plan.
  • Equity may be part of the total compensation package.

Job Details

Perplexity is looking for a Model Behavior Architect to help shape systems that reliably answer users' questions.

Responsibilities

  • Design, refine, and implement prompt engineering strategies to guide model behavior across research and general knowledge use cases
  • Identify edge cases and behavioral inconsistencies in model outputs through structured testing and prompt iteration
  • Develop automated and semi-automated pipelines for evaluating prompt effectiveness at scale
  • Work cross-functionally with researchers, PMs, and engineers to align model behavior with product goals
  • Collect and synthesize qualitative and quantitative feedback to inform prompt design improvements
  • Collaborate on prompt libraries and reusable frameworks for internal and production-facing systems
  • Stay current with the latest prompt engineering, alignment, and evaluation techniques from both industry and academia

Qualifications

  • Demonstrated passion for AI and can share specific prompt engineering and chaining projects you're proud of
  • Background in philosophy, psychology, linguistics, data science, or related fields
  • Familiar with Python and running simple scripts
  • High-level understanding of LLMs, training, RL
  • Excellent communication skills, particularly in teaching complex concepts
  • Creative problem-solving abilities with a "hacker spirit" for solving puzzles

At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.

To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.

Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Similar Jobs

Epic Games - Senior Product Counsel, Children's Privacy & Design

Epic Games

(On-Site)
3 Months ago
Ansys - R&D Engineer II (Solid Mechanics/ HPC)

Ansys

Canonsburg, Pennsylvania, United States (On-Site)
1 Week ago
Canonical - Junior Cloud Field Engineer

Canonical

(Remote)
1 Month ago
Humanitarian Operations - Business Planning Intern

Humanitarian Operations

Edinburgh, Scotland, United Kingdom (On-Site)
7 Months ago
design works gaming - Social Gaming Manager

design works gaming

Scottsdale, Arizona, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Marsh McLennan - Senior software engineer (Node.js & Angular)

Marsh McLennan

Cluj-Napoca, Cluj County, Romania (Hybrid)
1 Month ago
Hawkeye Innovations - Match Operations Assistant - Yerevan

Hawkeye Innovations

Yerevan, Yerevan, Armenia (On-Site)
1 Month ago
Inveniolsi - Full Stack Consultant

Inveniolsi

Hyderabad, Telangana, India (On-Site)
1 Month ago
Evolution  - Team Manager

Evolution

Ezeiza, Buenos Aires Province, Argentina (On-Site)
1 Month ago
Sailpoint - Digital Sales Representative

Sailpoint

Mexico City, Mexico (Hybrid)
1 Month ago
FalconX - Senior Finance Controller

FalconX

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Nice - Senior Software Engineer

Nice

Prague, Prague, Czechia (Hybrid)
1 Week ago
Riot Games - Senior Manager, Art Direction - Teamfight Tactics

Riot Games

Singapore (On-Site)
9 Months ago
WebTech Corporation - Production Operator

WebTech Corporation

Wytheville, Virginia, United States (On-Site)
2 Weeks ago
Media ocean - Vice President, Partnerships Business Development

Media ocean

New York, New York, United States (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, United States

Apple - Sr. Applied ML Engineer

Apple

Seattle, Washington, United States (On-Site)
3 Weeks ago
Next Level Business Services - Teradata DBA

Next Level Business Services

San Francisco, California, United States (On-Site)
8 Months ago
Elise AI - Founding Software Engineer - Healthcare

Elise AI

New York, New York, United States (On-Site)
1 Month ago
Lytx,  Inc  - Staff Strategic Sourcing Manager

Lytx, Inc

San Diego, California, United States (On-Site)
4 Days ago
Apple - Software Engineer - System Frameworks & Controls

Apple

San Diego, California, United States (On-Site)
1 Month ago
hogarth - Creative Director/Transcreator

hogarth

Miami, Florida, United States (Hybrid)
1 Month ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
7 Months ago
Alten Technology - Manufacturing Engineer (Composites)

Alten Technology

Lansing, Michigan, United States (On-Site)
1 Week ago
Elise AI - AI Operations Specialist - Healthcare

Elise AI

New York, New York, United States (On-Site)
1 Month ago
Jane Street - Cybersecurity Governance and Risk Specialist

Jane Street

New York, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

Palo Alto, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Perplexity

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug