Abu Dhabi, United Arab Emirates (On-site)

QA-AUTOMATION

2 Months ago • 2-5 Years

Quality Assurance

Job Description

This QA Automation role involves developing and automating test plans for AI tools, focusing on prompt accuracy, hallucination mitigation, and response completeness. Responsibilities include ensuring platform compliance, identifying user experience issues, documenting defects, and maintaining testing frameworks. The ideal candidate will have 2-5 years of software quality assurance experience, preferably with AI/ML systems, and a Bachelor's degree in a related field.

Good To Have:

Familiarity with automated testing tools (e.g., Cypress)
Familiarity with test management platforms (e.g., Zephyr)
Experience in AI/LLM output evaluation, especially for accuracy, relevance, and hallucination detection.
Understanding of Agile/Scrum methodologies.
Understanding of CI/CD pipelines.
Understanding of version control tools like Git.
Certification in ISTQB or similar QA frameworks.
Excellent attention to detail and issue tracking via JIRA/TestRail.

Must Have:

Develop test plans to validate prompt accuracy, hallucination mitigation, and response completeness.
Automate test scripts for user journeys within the AI tool.
Ensure platform compliance with internal knowledge governance standards.
Identify user experience issues, document defects, and create detailed reports on findings.
Maintain testing frameworks and tools, including automation.
Selenium
TestRail
Playwright with JavaScript

Add these skills to join the top 1% applicants for this job

github

game-texts

quality-control

agile-development

automated-testing

playwright

user-experience-ux

selenium

testrail

cypress

ci-cd

git

jira

javascript

Job Description

Must have Skills: Selenium, TestRail, Playwright with JavaScript

Responsibilities: Develop test plans to validate prompt accuracy, hallucination mitigation, and response completeness. Automate test scripts for user journeys within the AI tool. Ensure platform compliance with internal knowledge governance standards. Identify user experience issues, document defects, and create detailed reports on findings. Maintain testing frameworks and tools, including automation.

Skills: Familiarity with automated testing tools (e.g., Selenium, Playwright, Cypress) and test management platforms (e.g., TestRail, Zephyr). Experience in AI/LLM output evaluation, especially for accuracy, relevance, and hallucination detection, is a strong plus. Understanding of Agile/Scrum methodologies, CI/CD pipelines, and version control tools like Git. Certification in ISTQB or similar QA frameworks is advantageous but not mandatory. Excellent attention to detail and issue tracking via JIRA/TestRail.

Qualifications: Bachelor s degree in Computer Science, Software Engineering, Information Technology, or a related field. 2-5 years of experience in software quality assurance, ideally with exposure to AI/ML-based systems.

Set alerts for more jobs like QA-AUTOMATION

Set alerts for new jobs by Nagarro

Set alerts for new Quality Assurance jobs in United Arab Emirates

Set alerts for new jobs in United Arab Emirates

Set alerts for Quality Assurance (Remote) jobs