Staff Software Engineer - LLM Prompt Quality

7 Minutes ago • All levels • Quality Assurance

Job Summary

Job Description

Sully.ai is dedicated to creating superhuman doctors to improve healthcare access. This role involves shaping product capabilities as a Senior Full Stack Engineer, working closely with co-founders. Key responsibilities include expert prompt engineering for LLM performance, iterating on user feedback, and full-stack development. The ideal candidate will have expertise in LLM output quality, prompting frameworks, and experience in fast-paced startup environments. The role offers the chance to impact healthcare, contribute to early-stage growth, and work remotely with competitive compensation.
Must have:
  • Play a pivotal hands-on role in shaping the current and future capabilities of our product.
  • Work closely with co-founders to build core components and elevate the product.
  • Be an expert prompt engineer, studying latest strategies for LLM performance.
  • Innovate and apply new ideas for prompt iteration and optimization.
  • Perform full-stack engineering, building end-to-end features.
Good to have:
  • Experience with Applied GenAI
  • LLMOps
  • LLM evaluations
Perks:
  • Shape the future of healthcare by building category-defining partnerships.
  • Make an early-stage impact on partnership roadmap and company growth.
  • Work in a flexible, remote-first environment with a mission-driven team.
  • Receive competitive compensation, equity, and make a real difference.
  • Tackle complex scalability challenges in a rapidly growing company.

Job Details

About Sully.ai

Our mission is "One Human, One Doctor". We are creating superhuman doctors, because access to doctors is a basic human right.

Start with making doctors superhuman. Our vision is to eliminate doctor distractions and help them navigate the best treatments for their patients.

About the role

What You'll Do

  • We are seeking an exceptional Senior Full Stack Engineer to join our team and play a pivotal hands-on role in shaping the current and future capabilities of our product.
  • Work closely with the co-founders and be responsible for building core components and elevating our product to the next level.
  • Be an expert prompt engineer who deeply studies the latest strategies for prompting new models and getting the best performance out of them.
  • Use your innovative thinking and application of new ideas for prompt iteration and optimization for supporting new models, iterating on user feedback, etc.
  • Full-stack engineering, touching all parts of the stack and building end-to-end features.

What You'll Bring

  • Expertise in evaluating and improving output quality, accuracy and consistency of LLMs, both off-the-shelf and fine-tuned
  • Experience building and/or using prompting frameworks for prompt hosting, versioning and application
  • Proven track record in fast-paced, startup environments and collaborating with global teams
  • Advanced skills in software development methodologies, programming languages, and system architecture
  • Experience in customer-facing roles for requirements gathering and updates
  • Knowledge of GenAI, LLMs

Tech Stack

Frontend: ReactJS, Bootstrap, Tailwind CSS, or similar frameworks

Backend: Node.js, Express.js

Databases: NoSQL and SQL

DevOps: CI/CD pipelines, cloud services (GCP, Azure, AWS)

Bonus: Experience with Applied GenAI, LLMOps, and LLM evaluations

Why Join Sully.ai?

  • Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
  • Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
  • Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
  • Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
  • Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Quality Assurance Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!