Software Engineer, Search Evaluations
Job Description
- Significant experience building systems to evaluate quality for search or other AI-oriented areas
- A voracious and intrinsic desire to learn and fill in missing skills, and an equally strong talent for sharing that information clearly and concisely with others
- Thrive on going deep into data to identify issues and trends
- Build and evolve a framework for quality evaluation that enables research and product engineering teams to identify gaps, track progress, and accelerate robust iteration
- Work with a small, senior team of engineers and researchers to combine existing best practices with innovative approaches based on state-of-the-art models to develop industry-leading systems
- Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
- Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
- 401(k) retirement plan with employer match
- Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
- Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
- 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend to fuel your professional growth
- Daily meals in our offices, and meal delivery credits as eligible
- Relocation support for eligible employees
- Additional taxable fringe benefits, such as charitable donation matching and wellness stipends
About the Team
The Applied AI team works across research, engineering, product, and design to bring OpenAI’s technology to the world.
We seek to learn from deployment and broadly distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. We aim to make our innovative tools globally accessible, transcending geographic, economic, or platform barriers. Our commitment is to facilitate the use of AI to enhance lives, fostered by rigorous insights into how people use our products.
About the Role
In this role, you’ll lead development of the systems we use to evaluate the quality of our AI models and products. You’ll help us leverage a combination of human and automated methods to accelerate robust iteration and development of new models and product features.
We’re looking for an experienced engineer with a track record of building effective systems to evaluate quality in domains like search or other AI-oriented areas.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
In this role, you will:
- Build and evolve a framework for quality evaluation that enables our research and product engineering teams to identify gaps in quality, track progress, and accelerate robust iteration
- Work with a small, senior team of engineers and researchers to combine existing best practices with innovative approaches based on state-of-the-art models to develop industry-leading systems
You might thrive in this role if you:
- Have significant experience building systems to evaluate quality for search or other AI-oriented areas
- Have a voracious and intrinsic desire to learn and fill in missing skills, and an equally strong talent for sharing that information clearly and concisely with others
- Thrive on going deep into data to identify issues and trends
