Head of Engineering, QA

2 Minutes ago • 6 Years + • Quality Assurance • $200,000 PA - $230,000 PA

Job Summary

Job Description

Sully.ai's mission is to create superhuman doctors, believing access to doctors is a basic human right. As Head of Engineering, QA, you will build the QA function from the ground up, owning strategy, automation, and execution. This 0→1 role involves ensuring AI medical employees are safe, reliable, and high-performing, setting standards, scaling automation, and growing a dedicated team.
Must have:
  • Define the framework for automation, functional, performance, and compliance testing.
  • Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
  • Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
  • Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
  • Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).
Good to have:
  • Experience testing AI/LLM workflows.
  • Dashboarding/observability tooling.
  • GitHub Actions CI/CD integration.
  • Prior startup or healthcare QA experience.
Perks:
  • Build QA from 0→1: Define how quality is done at a fast-growing AI healthcare startup.
  • Real Impact: Ensure clinical-grade safety and reliability in products used by doctors and patients.
  • Remote-First: Work with a mission-driven team from anywhere.
  • Compensation: Competitive salary + equity.
  • Tackle Hard Problems: AI QA at scale in healthcare—complex, high-impact, and career-defining.

Job Details

About Sully.ai

Our mission is "One Human, One Doctor". We are creating superhuman doctors, because access to doctors is a basic human right.

Start with making doctors superhuman. Our vision is to eliminate doctor distractions and help them navigate the best treatments for their patients.

About the role

The Role

As Head of Engineering, QA at Sully.ai, you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 role: you’ll be the first in function, setting standards, scaling automation, and growing a team.

What You'll Do

  • Own QA Strategy: Define the framework for automation, functional, performance, and compliance testing.
  • Build & Scale Automation: Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
  • Ensure Reliability: Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
  • Guarantee Quality: Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
  • Lead & Grow: Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).

What You'll Bring (Must-Have)

  • Founder / 0→1 experience — first in function, building QA processes and teams from scratch.
  • 6–8+ years QA experience with strong Playwright expertise.
  • 3-4+ years with strong people leadership.
  • Proven ability to automate functional UI and API test cases.
  • Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
  • Experience with scaling test automation and maintaining reliability.
  • Highly motivated, driven, and ownership-oriented.

Nice to Have

  • Experience testing AI/LLM workflows.
  • Dashboarding/observability tooling.
  • GitHub Actions CI/CD integration.
  • Prior startup or healthcare QA experience.

Tech Snapshot

  • Automation: Playwright, Cypress, PyTest
  • CI/CD: GitHub Actions, Kubernetes, Docker
  • Performance: Locust, JMeter, k6
  • Cloud: AWS/GCP/Azure
  • AI QA: Prompt/LLM evaluation, guardrails

Why Join Sully.ai?

🔥 Build QA from 0→1: Define how quality is done at a fast-growing AI healthcare startup.

📈 Real Impact: Ensure clinical-grade safety and reliability in products used by doctors and patients.

🌎 Remote-First: Work with a mission-driven team from anywhere.

💰 Compensation: Competitive salary + equity.

🏆 Tackle Hard Problems: AI QA at scale in healthcare—complex, high-impact, and career-defining.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Mountain View, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Quality Assurance Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Mountain View, California, United States (Remote)

Mountain View, California, United States (Remote)

Mountain View, California, United States (Remote)

Mountain View, California, United States (Remote)

United States (Remote)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Sully.ai

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug