LLM Evaluation Lead

Our mission at Oura is to empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped millions of people understand and improve their health by providing daily insights and practical steps to inspire healthy lifestyles.

Empowering the world starts with living our values and empowering our team. As a quickly growing company focused on helping people live healthier and happier lives, we ensure that our team members have what they need to do their best work — both in and out of the office.

Join Oura in shaping how millions of people connect with their health!

At Oura, we’re building the future of personal health, powered by cutting-edge technology and backed by science. We’re expanding our efforts to bring more thoughtful, human-centered AI features into our mobile app, and are now looking for an AI Evaluation Lead to help us set the quality bar for Oura Advisor and AI-driven features.

About this role

This role combines cross-team coordination, forward-looking innovation, and linguistic craft. As the AI Evaluation Lead, you’ll guide teams on how our AI speaks with Members, help design and run evaluations on tone and content, and champion AI solutions across the company.

We’re looking for someone who doesn’t just follow the latest in AI development, but actively participates in it. You experiment with new tools, refine prompts, and innovate how AI can be used and improved in practice.

This is a unique opportunity to directly influence how Oura’s AI Advisor supports members on their health journey – one conversation and insight at a time.

What You’ll Do

• Own our evaluation data set, making sure of its quality and optimal coverage.
• Act as the guardian of Oura’s AI voice and set the quality bar: ensure Advisor and other AI-powered features always reflect our distinctive communication style.
• Coordinate and guide teams: help them design and create their own evaluations by providing best practices and consultation, while prioritizing evaluation needs and keeping standards consistent.
• Champion AI practices across Oura: serve as a trusted spokesperson, helping teams understand how to use and improve AI responsibly and effectively.
• Shape prompts and interactions: bring your linguistic expertise and copywriting craft to ensure every AI response feels clear, human, and on brand.
• Evolve evaluation processes: partner with engineering to refine tooling and create scalable, repeatable workflows for LLM testing and feedback.

What we are looking for

• Deep curiosity about AI, with experience and forward-looking ideas on how prompting and evaluation work in practice.
• Proven linguistic and copywriting skills.
• Experience guiding or coaching others: you’re comfortable helping cross-functional teams adopt new practices and learn from you.
• Strong collaboration skills: you thrive in busy interfaces across product, design, and engineering.
• Ability to balance detail-oriented evaluation with the bigger picture of member experience.
• Comfort working in the evolving, sometimes ambiguous context of AI.

Nice-to-Haves

• Familiarity with Oura’s product, or a strong interest in health, wellbeing, and human physiology and psychology.
• Background in building content libraries, or curating knowledge bases.
• Experience facilitating workshops, training, or internal advocacy around new tools or processes.
• Understanding of product development and software workflows.

Location

Our team is based in our Helsinki and Oulu offices, so we’re ideally looking for someone located in either city. The role can also be done remotely from elsewhere in Finland, as long as you’re open to occasionally visiting one of the offices to connect with the team in person.

What we offer

• Competitive salary
• Lunch benefit
• Wellness benefit
• Flexible working hours
• An Oura ring of your own
• Personal learning & development program
• Wellness Time Off

Oura is proud to be an equal opportunity workplace. We celebrate diversity and are committed to creating an inclusive environment for all employees. Individuals seeking employment at Oura are considered without regard to age, ancestry, color, gender (including pregnancy, childbirth, or related medical conditions), gender identity or expression, genetic information, marital status, medical condition, mental or physical disability, national origin, protected family care or medical leave status, race, religion (including beliefs and practices or the absence thereof), sexual orientation, military or veteran status, or any other characteristic protected by federal, state, or local laws. We will not tolerate discrimination or harassment based on any of these characteristics.

We will work to ensure individuals with disabilities are provided reasonable accommodation to participate in the interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

Disclaimer: Beware of fake job offers!

We’ve been alerted to scammers posing as ŌURA recruiters, especially for remote roles. Please note:

• Our jobs are listed only on the ŌURA Careers page and trusted job boards.
• We will never ask for personal information like ID or payment for equipment upfront.
• Official offers are sent through Docusign after a verbal offer, not via text or email.

Stay cautious and protect your personal details.

To all recruitment agencies: Oura does not accept agency resumes. Please do not forward resumes to our jobs alias, Oura employees, or any other organization's location. Oura is not responsible for any fees related to unsolicited resumes.

Create a Job Alert

Interested in building your career at Ōura? Get future opportunities sent straight to your email.

Create alert

Apply for this job

------------------

• indicates a required field

Autofill with MyGreenhouse

First Name*

Last Name*

Preferred First Name

Email*

Phone

Country*

Phone*

Resume/CV*

AttachAttach

Dropbox

Google Drive

Enter manuallyEnter manually

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter*

AttachAttach

Dropbox

Google Drive

Enter manuallyEnter manually

Accepted file types: pdf, doc, docx, txt, rtf

• * *

LinkedIn Profile

Website

Legal First Name*

Legal Last Name*

Preferred First Name

Please share if you will need any accommodations during the interview process if your application is selected.

This job requires being located in Finland. Are you located in Finland or interested in relocation?*

Select...

Location: City, Region, Country *

Submit application