QA Engineer

7 Minutes ago • All levels

Quality Assurance

Job Description

We are looking for a detail-oriented and proactive QA Engineer to ensure the quality and reliability of our AI-powered applications. This role involves validating complex agentic workflows, LLM integrations, and full-stack functionality across React.js front ends and AWS-based back-ends. The QA Engineer will design and execute test plans, validate LLM outputs, perform various types of testing, develop automated test suites, and collaborate with AI engineers and product managers to ensure high test coverage and early defect detection.

Must Have:

Design and execute test plans and test cases for AI-driven applications
Validate LLM outputs, RAG pipelines, and Knowledge Base integrations
Perform functional, integration, regression, and exploratory testing
Develop and maintain automated test suites for APIs and UI workflows
Collaborate closely with AI engineers and product managers
Monitor and report on test execution, bugs, and quality metrics using JIRA or similar
Strong experience in manual and automated testing of web applications and APIs
Familiarity with React.js front-end testing using Jest, React Testing Library, or similar tools
Experience testing serverless back-ends using AWS Lambda and related services
Understanding LLM behavior, prompt-response validation, and AI evaluation techniques
Experience with Postman, REST API testing, and mocking/stubbing
Proficiency in scripting languages like Python or JavaScript for test automation
Familiarity with CI/CD pipelines and version control systems like Git

Add these skills to join the top 1% applicants for this job

github

game-texts

quality-control

test-coverage

test-suites

automated-testing

load-testing

api-testing

performance-testing

security-testing

react

aws

postman

ci-cd

front-end

back-end

git

python

jira

javascript

Role Summary:

We are looking for a detail-oriented and proactive QA Engineer to ensure the quality and reliability of our AI-powered applications. You will be responsible for validating complex agentic workflows, LLM integrations, and full-stack functionality across React.js front ends and AWS-based back-ends. This role requires a strong understanding of testing strategies for AI systems, APIs, and dynamic user interfaces.

Key Responsibilities:

Design and execute test plans and test cases for AI-driven applications
Validate LLM outputs, RAG pipelines, and Knowledge Base integrations for correctness, consistency, and safety.
Perform functional, integration, regression, and exploratory testing across front-end nd back-end components.
Develop and maintain automated test suites for APIs and UI workflows.
Collaborate closely with AI engineers and product managers to ensure test coverage and early defect detection.
Monitor and report on test execution, bugs, and quality metrics using tools like JIRA or similar.
Contribute to continuous improvement of QA processes and tooling.

Required Skills & Qualifications:

Strong experience in manual and automated testing of web applications and APIs.
Familiarity with React.js front-end testing using tools like Jest, React Testing Library, or similar tools.
Experience testing serverless back-ends using AWS Lambda and related services.
Understanding LLM behavior, prompt-response validation, and AI evaluation techniques.
Experience with Postman, REST API testing, and mocking/stubbing.
Proficiency in scripting languages like Python or JavaScript for test automation.
Familiarity with CI/CD pipelines and version control systems like Git.
Experience testing RAG pipelines, vector search, or embedding-based retrieval.
Understanding AI safety, bias testing, and hallucination detection.
Experience with load testing, performance testing, and security testing.