Senior Quality Assurance Engineer

SoftwareUs, a LikeCard Company, is a leading innovator in Fin-tech and E-commerce, delivering high-quality digital solutions. We are hiring a Senior QA Engineer with deep expertise in AI testing to ensure the quality, reliability, and security of our AI-powered applications. This role involves designing and implementing testing frameworks for AI workflows, testing LLM-based systems for accuracy and safety, building automated test suites, and developing performance, load, and security testing. The engineer will also create prompt engineering tests and monitor AI system quality using various tools.

Must Have

• Design and implement testing frameworks for AI workflows (LangGraph, CrewAI, IngestKit).
• Test LLM-based systems for accuracy, consistency, and safety.
• Build automated test suites and integrate into CI/CD pipelines.
• Develop performance, load, and security testing for AI workflows.
• Create prompt engineering tests to validate and optimize prompts.
• Monitor AI system quality with tools like LangSmith, Prometheus, Grafana.
• 5+ years of QA engineering experience, with 3+ years in AI/ML testing.
• Strong knowledge of AI workflow testing (LangGraph or similar).
• Proficiency in Python testing frameworks (testes, hypothesis).
• Experience with LLM testing, evaluation metrics, and security/privacy testing.
• Solid understanding of CI/CD pipelines, Docker, Kubernetes.

Good to Have

• Experience with LangSmith and observability tools.
• Knowledge of AI performance optimization.
• Familiarity with AI ethics, responsible AI, and compliance testing.

About SoftwarUs:

SoftwareUs, a LikeCard Company, is a leading innovator in the Fin-tech and E-commerce space, delivering high-quality, cutting-edge digital solutions. We develop advanced applications and platforms designed to empower both users and businesses.

We’re looking for a Senior QA Engineer with deep expertise in AI testing to ensure the quality, reliability, and security of our AI-powered applications.

What You’ll Do

• Design and implement testing frameworks for AI workflows (LangGraph, CrewAI, IngestKit).
• Test LLM-based systems for accuracy, consistency, and safety.
• Build automated test suites and integrate into CI/CD pipelines.
• Develop performance, load, and security testing for AI workflows.
• Create prompt engineering tests to validate and optimize prompts.
• Monitor AI system quality with tools like LangSmith, Prometheus, Grafana.

Requirements

What We’re Looking For

• 5+ years of QA engineering experience, with 3+ years in AI/ML testing.
• Strong knowledge of AI workflow testing (LangGraph or similar).
• Proficiency in Python testing frameworks (testes, hypothesis).
• Experience with LLM testing, evaluation metrics, and security/privacy testing.
• Solid understanding of CI/CD pipelines, Docker, Kubernetes.

Nice to Have

• Experience with LangSmith and observability tools.
• Knowledge of AI performance optimization.
• Familiarity with AI ethics, responsible AI, and compliance testing.