Software Development Engineer II - AI
3 Months ago • 2-4 Years
Research Development
Job Description
Highspot is a leading sales enablement company using AI and GenAI in its SaaS platform. This role focuses on ensuring the quality of AI and GenAI features by evaluating model outputs, creating datasets, and collaborating with data scientists and engineers. The candidate will help develop a framework for evaluating AI agents, working with text, documents, audio, and video. Responsibilities include validating AI output, creating high-quality reference data, annotating multi-modal data, running performance analytics, fine-tuning model code, improving processes, and collaborating with cross-functional teams.
Must Have:
- 2-4 years experience in data science/AI/ML
- Experience evaluating AI results
- Working knowledge of AI/ML evaluation techniques
- Strong analytical skills and attention to detail
- Bachelor's or Master's in Computer Science or Data Science
- Strong English communication skills
- Self-directed and organized
About Highspot
Highspot is a software product development company and a recognized global leader in the sales enablement category, leveraging cutting-edge AI and GenAI technologies at the core of its robust Software-as-a-Service (SaaS) platform. Highspot is revolutionizing how millions of individuals work worldwide. Through its AI-powered platform, Highspot drives enterprise transformation to empower sales teams through intelligent content management, training, contextual guidance, customer engagement, meeting intelligence, and actionable analytics. The Highspot platform delivers advanced features tailored to business needs, in a modern design that sales and marketing executives appreciate and is the #1 rated sales enablement platform on G2 Crowd.
While headquartered in Seattle, Highspot has expanded its footprint across America, Canada, the UK, Germany, Australia, and now India, solidifying its presence in the Asia Pacific markets.
About The Role
You will safeguard the quality of our AI and GenAI features by evaluating model outputs, creating “golden” datasets, and guiding continuous improvements in collaboration with data scientists and engineers. Be the guide to the team as the team creates a robust methodology and framework that will drive evaluation of hundreds of AI agents.
Responsibilities
- Validate AI Output – Review model results across text, documents, audio, and video; flag errors and improvement opportunities.
- Create Golden Datasets – Build and maintain high-quality reference data with help from subject-matter experts.
- Data Annotation – Accurately label multi-modal data and perform light preprocessing (e.g., text cleanup, image resizing).
- Quality Analytics – Run accuracy metrics, trend analyses, and clustering to gauge model performance. Fine-Tune Model Code – Adjust training scripts and parameters to boost accuracy and keep behavior consistent across models.
- Process Improvement & Documentation – Refine annotation workflows and keep clear records of methods, findings, and best practices.
- Cross-Functional Collaboration – Partner with ML engineers, product managers, and QA peers to ship reliable, user-ready features.
Required Qualifications
- 2 to 4 years of experience in data science/AI/ML. Specific experience in evaluation of AI results is strongly preferred
- Working knowledge of AI/ML evaluation techniques
- Solid analytical skills and meticulous attention to detail.
- Bachelor’s or Master’s in Computer Science, Data Science, or a related field.
- Strong English written and verbal communication.
- Self-directed, organized, and comfortable with ambiguous problem spaces.
#LI-SG1
Equal Opportunity Statement
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of age, ancestry, citizenship, color, ethnicity, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or invisible disability status, political affiliation, veteran status, race, religion, or sexual orientation.
Did you read the requirements as a checklist and not tick every box? Don't rule yourself out! If this role resonates with you, hit the ‘apply’ button.
Set alerts for more jobs like Software Development Engineer II - AI
Set alerts for new jobs by Highspot
Set alerts for new Research Development jobs in India
Set alerts for new jobs in India
Set alerts for Research Development (Remote) jobs
