Senior Software Development Engineer in Test with ML
Job Summary
Job Description
Cyara is seeking a Senior Software Development Engineer in Test with expertise in Machine Learning to join their team. The role involves defining and executing the end-to-end test strategy for the CX assurance platform, ensuring high test coverage and scalability. Responsibilities include designing and implementing automated test cases for deep insights, analytics, AI trust tests (hallucination detection, grounding, consistency), and building automated test frameworks using JavaScript/TypeScript, Node.js, React, and Cypress. The engineer will monitor test results, identify regressions, and proactively drive resolutions, while also improving test infrastructure and CI/CD pipeline integration for fast feedback loops. A working knowledge of machine learning fundamentals and AI trustworthiness principles is essential.
Must have:
- JavaScript/TypeScript proficiency
- Node.js and React experience
- Cypress framework expertise
- Machine learning fundamentals
- AI trustworthiness principles understanding
- Test strategy ownership
- Agile/Scrum experience
- Analytical and problem-solving skills
- Excellent communication skills
Good to have:
- k-fold cross-validation
- Precision/recall/F1 metrics
- Model performance analysis
Perks:
- Flexible work environment
- Competitive compensation
- Results-oriented work culture
- Fast-paced environment
- Continuous improvement focus
- Family first atmosphere
- Team-oriented atmosphere
- Positive atmosphere
15 skills required
Job Details
Cyara is the world’s leading Automated CX Assurance Platform provider, helping leading brands across the globe deliver better CX with less effort, cost, and risk. Cyara supports the entire CX software development lifecycle, from design to functional and regression testing, load testing, chatbot testing, and production monitoring, ensuring enterprises can build flawless customer journeys across voice and digital channels while reducing the risk of customer-facing defects. Every day, the most recognizable brands across the globe trust Cyara to deliver customer smiles at scale. Interested to find out more about us? Check out: www.cyara.com
Want to know what it’s really like to work at Cyara? Check out this link to meet some real Cyaran’s and read about their individual career journey with us: https://cyara.com/employee-profiles/
Cyara’s Diversity, Equity, Inclusive and Belonging Statement:
At Cyara, we are dedicated to fostering a workplace that embodies equal opportunity and champions diversity, equity, inclusion, and belonging (DEIB). We strive to cultivate an environment where every individual feels valued, respected, and empowered to bring their whole selves to work, contributing unique perspectives and talents. Our commitment includes continuously evaluating and enhancing our policies, practices, and culture to align with our DEIB principles. We ensure a discrimination-free environment where individuals are evaluated solely on their merits and abilities, regardless of legally protected statuses such as sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, or medical condition. By celebrating our differences and championing inclusivity, we enrich our organization, make more thoughtful decisions, and drive collective success.
Cyara’s Values Statement: At Cyara, our values shape everything we do. We're passionate about Delivering Excellence by putting the customer first, collaborating globally, and always striving to improve. We take smart risks and Innovate Boldly, setting new standards and learning from every experience. Integrity First is our cornerstone—we value humility, authenticity, and respect for diversity, building trust in all we do. We Embrace Curiosity by empowering you to experiment, learn, and grow in a dynamic environment. At Cyara, our values drive us forward, shaping a culture where innovation and excellence thrive.
Key Responsibilities
- Define, own, and execute the end-to-end test strategy for the CX assurance platform, ensuring high test coverage, efficiency, and scalability.
- Design and implement automated test cases that evaluate:
- The quality and variance of outputs from deep insights and analytics of training models.
- The reliability and reasoning in AI trust tests, including hallucination detection, grounding, and consistency.
- Build and maintain automated test frameworks using JavaScript/TypeScript, Node.js, React, and Cypress.
- Monitor and analyze test results, identify regressions, and proactively drive resolution.
- Continuously improve test infrastructure and CI/CD pipeline integration to ensure fast, reliable feedback loops.
Required Skills and Qualifications
- Technical Expertise
- Strong proficiency in JavaScript/TypeScript, with hands-on experience in Node.js and React applications.
- Deep experience with end-to-end testing frameworks, especially Cypress.
- Working knowledge of machine learning fundamentals and model evaluation techniques.
- Familiarity with k-fold cross-validation, precision/recall/F1 metrics, and analyzing model performance across datasets.
- Understanding of AI trustworthiness principles such as interpretability, robustness, and bias detection.
- Proven experience owning the test strategy for complex systems, including planning, execution, and test architecture.
- Ability to define coverage metrics, assess test gaps, and drive toward measurable quality goals.
- Experience working in agile/Scrum environments, actively participating in story grooming and sprint planning.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication skills for cross-functional collaboration.
- A mindset of ownership, initiative, and continuous improvement.
AI/ML & Data Science Knowledge
Test Strategy and Leadership
Soft Skills
Why you should join us:
At Cyara you’ll have the opportunity to work with a group of people who share common goals, are driven by a similar passion, and value the expertise of their peers. Cyara is committed to being an equal opportunity employer, focused on building and maintaining a diverse, inclusive and authentic workplace; and a work environment that is free from discrimination and harassment, based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy. At Cyara we appreciate and welcome the fact that our culture is living and growing as we continue to evolve over time. With this opportunity comes the chance to enjoy a flexible work environment, competitive compensation and a work culture that's results-oriented, fast-paced and focused on continuous improvement, whilst maintaining a family first, team oriented, and ever positive atmosphere.
Cyara cares for its own - you’ll feel that on your first day - and you'll get the chance to work for a global, growing company, and an all-inclusive team of innovators. We credit our amazing growth and success to the fact that we’ve built our business on four essential values that we live and breathe every day:
Deliver Excellence
Innovate Boldly
Integrity First
Embrace Curiosity
Interested? Know someone who might be? Apply online now.
Agencies: Thanks but we’ve got this one! Please, no phone calls or emails to any employees of Cyara outside of the Talent Acquisition team. Cyara’s policy is to only accept resumes from Agencies via the Cyara Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes, by the Cyara Talent Acquisition team before submitting any CV's. Any resume submitted outside of this process will be deemed the sole property of Cyara and, in the event, a candidate is submitted outside of this policy is hired, no fee or payment of any kind will be paid
Similar Jobs
Canva
Brisbane, Queensland, Australia (Remote)
• 1 Month ago
King
London, England, United Kingdom (On-Site)
• 1 Month ago
Chimera entertainment
Montreal, Quebec, Canada (On-Site)
• 3 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
InMobiInMobi
Bengaluru, Karnataka, India (On-Site)
• 3 Weeks ago
Paytm
Bengaluru, Karnataka, India (On-Site)
• 7 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Hyderabad, Telangana, India
Get notifed when new similar jobs are uploaded
Testing Jobs
WebMD
Portland, Oregon, United States (On-Site)
• 1 Month ago
Rockstar Games
New York, United States (On-Site)
• 2 Months ago
Drive mode
Mountain View, California, United States (Hybrid)
• 3 Months ago
Roblox
San Mateo, California, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
