Senior Quality Assurance Engineer
3 Months ago • 5 Years +
Quality Assurance
Job Description
SoftwareUs, a LikeCard Company, is a leading innovator in Fin-tech and E-commerce, delivering high-quality digital solutions. We are hiring a Senior QA Engineer with deep expertise in AI testing to ensure the quality, reliability, and security of our AI-powered applications. This role involves designing and implementing testing frameworks for AI workflows, testing LLM-based systems for accuracy and safety, building automated test suites, and developing performance, load, and security testing. The engineer will also create prompt engineering tests and monitor AI system quality using various tools.
Good To Have:
- Experience with LangSmith and observability tools.
- Knowledge of AI performance optimization.
- Familiarity with AI ethics, responsible AI, and compliance testing.
Must Have:
- Design and implement testing frameworks for AI workflows (LangGraph, CrewAI, IngestKit).
- Test LLM-based systems for accuracy, consistency, and safety.
- Build automated test suites and integrate into CI/CD pipelines.
- Develop performance, load, and security testing for AI workflows.
- Create prompt engineering tests to validate and optimize prompts.
- Monitor AI system quality with tools like LangSmith, Prometheus, Grafana.
- 5+ years of QA engineering experience, with 3+ years in AI/ML testing.
- Strong knowledge of AI workflow testing (LangGraph or similar).
- Proficiency in Python testing frameworks (testes, hypothesis).
- Experience with LLM testing, evaluation metrics, and security/privacy testing.
- Solid understanding of CI/CD pipelines, Docker, Kubernetes.
About SoftwarUs:
SoftwareUs, a LikeCard Company, is a leading innovator in the Fin-tech and E-commerce space, delivering high-quality, cutting-edge digital solutions. We develop advanced applications and platforms designed to empower both users and businesses.
We’re looking for a Senior QA Engineer with deep expertise in AI testing to ensure the quality, reliability, and security of our AI-powered applications.
What You’ll Do
- Design and implement testing frameworks for AI workflows (LangGraph, CrewAI, IngestKit).
- Test LLM-based systems for accuracy, consistency, and safety.
- Build automated test suites and integrate into CI/CD pipelines.
- Develop performance, load, and security testing for AI workflows.
- Create prompt engineering tests to validate and optimize prompts.
- Monitor AI system quality with tools like LangSmith, Prometheus, Grafana.
Requirements
What We’re Looking For
- 5+ years of QA engineering experience, with 3+ years in AI/ML testing.
- Strong knowledge of AI workflow testing (LangGraph or similar).
- Proficiency in Python testing frameworks (testes, hypothesis).
- Experience with LLM testing, evaluation metrics, and security/privacy testing.
- Solid understanding of CI/CD pipelines, Docker, Kubernetes.
Nice to Have
- Experience with LangSmith and observability tools.
- Knowledge of AI performance optimization.
- Familiarity with AI ethics, responsible AI, and compliance testing.
Set alerts for more jobs like Senior Quality Assurance Engineer
Set alerts for new jobs by Like Card
Set alerts for new Quality Assurance jobs in Jordan
Set alerts for new jobs in Jordan
Set alerts for Quality Assurance (Remote) jobs
