About Sully.ai

Our mission is "One Human, One Doctor". We are creating superhuman doctors, because access to doctors is a basic human right.

Start with making doctors superhuman. Our vision is to eliminate doctor distractions and help them navigate the best treatments for their patients.

About the role

The Role

As Head of Engineering, QA at Sully.ai, you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 role: you’ll be the first in function, setting standards, scaling automation, and growing a team.

What You'll Do

• Own QA Strategy: Define the framework for automation, functional, performance, and compliance testing.
• Build & Scale Automation: Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
• Ensure Reliability: Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
• Guarantee Quality: Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
• Lead & Grow: Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).

What You'll Bring (Must-Have)

• Founder / 0→1 experience — first in function, building QA processes and teams from scratch.
• 6–8+ years QA experience with strong Playwright expertise.
• 3-4+ years with strong people leadership.
• Proven ability to automate functional UI and API test cases.
• Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
• Experience with scaling test automation and maintaining reliability.
• Highly motivated, driven, and ownership-oriented.

Nice to Have

• Experience testing AI/LLM workflows.
• Dashboarding/observability tooling.
• GitHub Actions CI/CD integration.
• Prior startup or healthcare QA experience.

Tech Snapshot

• Automation: Playwright, Cypress, PyTest
• CI/CD: GitHub Actions, Kubernetes, Docker
• Performance: Locust, JMeter, k6
• Cloud: AWS/GCP/Azure
• AI QA: Prompt/LLM evaluation, guardrails

Why Join Sully.ai?

🔥 Build QA from 0→1: Define how quality is done at a fast-growing AI healthcare startup.

📈 Real Impact: Ensure clinical-grade safety and reliability in products used by doctors and patients.

🌎 Remote-First: Work with a mission-driven team from anywhere.

💰 Compensation: Competitive salary + equity.

🏆 Tackle Hard Problems: AI QA at scale in healthcare—complex, high-impact, and career-defining.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.