Research Engineer, Frontier Evals
Job Description
- Prior background / domain expertise in finance, especially investment banking or private equity (e.g., through internships, prior jobs).
- An ability to work cross-functionally.
- Excellent communication skills.
- Identify important model capabilities, skills, and behaviors crucial to financial workflows, and design methods to quantify performance in these areas.
- Own and pursue a research agenda to identify an important model capability (especially as it relates to financial reasoning) and build evaluations to measure it.
- Continuously refine evaluations of frontier AI models to assess the extent of frontier capabilities.
- Strong engineering and statistical analysis skills (with at least 2-3 years of full-time technical experience).
- Passionate about Excel spreadsheets and/or finance.
- Detail-oriented and thorough.
- Team player / willing to do a variety of tasks to move the team forward.
- Passionate and knowledgeable about AGI/ASI measurement.
- Able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end.
- Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
- Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
- 401(k) retirement plan with employer match
- Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
- Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
- 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend to fuel your professional growth
- Daily meals in our offices, and meal delivery credits as eligible
- Relocation support for eligible employees
- Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.
The base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. If the role is non-exempt, overtime pay will be provided consistent with applicable laws. In addition to the salary range listed above, total compensation also includes generous equity, performance-related bonus(es) for eligible employees, and the following benefits.
- Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
- Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
- 401(k) retirement plan with employer match
- Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
- Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
- 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend to fuel your professional growth
- Daily meals in our offices, and meal delivery credits as eligible
- Relocation support for eligible employees
- Additional taxable fringe benefits, such as charitable donation matching and wellness stipends, may also be provided.
More details about our benefits are available to candidates during the hiring process.
This role is at-will and OpenAI reserves the right to modify base pay and other compensation components at any time based on individual performance, team or company results, or market conditions.
About the team
The Frontier Evals team builds north star model evaluations to drive progress towards safe AGI/ASI. This team builds ambitious evaluations to measure and steer our models, and creates self-improvement loops to steer our training, safety, and launch decisions. Some of the team's open-sourced evaluations include SWE-bench Verified, MLE-bench, PaperBench, and SWE-Lancer, and the team built and ran frontier evaluations for GPT4o, o1, o3, GPT 4.5, ChatGPT Agent, and GPT5. If you are interested in feeling firsthand the fast progress of our models, and steering them towards good, this is the team for you.
About you
We are seeking exceptional research engineers that can push the boundaries of our frontier models in the finance domain. We are looking for those who will help shape AI evaluations of financial reasoning and related capabilities, and will own individual threads within this endeavor end-to-end. This role will also involve collaboration with others on the frontier evals team across other domains.
In this role, you'll:
- Identify important model capabilities, skills, and behaviors that are crucial to financial workflows, and design methods to quantify performance in these areas
- Own and pursue a research agenda to identify an important model capability (especially as it relates to financial reasoning) and build evals to measure it
- Continuously refine evaluations of frontier AI models to assess the extent of frontier capabilities
We expect you to be:
- Strong engineering and statistical analysis skills (with at least 2-3 years of full-time technical experience)
- Passionate about Excel spreadsheets and/or finance
- Detail-oriented and thorough
- Team player / willing to do a variety of tasks to move the team forward
- Passionate and knowledgeable about AGI/ASI measurement
- Able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end
It would be great if you also have:
- Prior background / domain expertise in finance, especially investment banking or private equity (e.g., through internships, prior jobs)
- An ability to work cross-functionally
- Excellent communication skills
