Senior QA Architect

11 Minutes ago • 5 Years +
Quality Assurance

Job Description

This role involves building foundational infrastructure to secure AI agents, focusing on their identities, access patterns, and interactions with sensitive systems and data. The Senior QA Architect will develop and maintain high-quality work procedures, execute manual and automated tests, and lead the team in quality assurance. This is a unique opportunity to shape a new security infrastructure layer for AI agents, ensuring their safe and effective operation in enterprise environments.
Good To Have:
  • Knowledge of observability tools like OpenTelemetry, Datadog
  • Background or experience in software development and/or security testing
  • Knowledge of security principles (e.g., access control, secrets exposure, identity testing)
Must Have:
  • Define the overall testing strategy and tooling stack across integration, regression, and load/performance testing.
  • Drive an automation-first mindset — collaborate with developers to ensure code is testable and observable.
  • Partner with product and security to define quality gates for features like agent identity, access delegation, and secrets handling.
  • Lead root-cause analysis for escaped bugs and define improvement actions.
  • Own CI quality metrics and dashboards (e.g., build stability, test flakiness, regression coverage).
  • Influence decisions about test environments, mocks, test data, and production parity.
  • Collaborate with the centralized quality group to push for E2E coverage
  • At least 5 years of experience in QA positions
  • Experience building QA practices for cloud-native, distributed systems
  • Deep expertise in defining quality strategy in early-stage teams or 0→1 products
  • Hands-on experience with CI/CD pipelines (e.g., GitHub Actions, CircleCI, or similar)
  • Experience testing Go-based systems — or equivalent backend APIs — including performance and concurrency validation
  • Familiarity with AWS services, including API Gateway, Lambda, DynamoDB, CloudWatch
  • Experience in building automated testing gates in CI/CD-based products

Add these skills to join the top 1% applicants for this job

leadership
github
game-texts
quality-control
automated-testing
performance-testing
security-testing
aws
circleci
ci-cd
github-actions

We’re building foundational infrastructure to secure AI agents — including their identities, access patterns, and interactions with sensitive systems and data. This includes designing intelligent, dynamic mechanisms for ephemeral access control, secrets management, and agent/user identity tailored to modern agent frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, and beyond.

In your role, you will be responsible for developing and maintaining high-quality work procedures, executing both manual and automated tests, and leading the team to achieve better quality.

This is a rare opportunity to help shape a new security infrastructure layer from the ground up — in a team with the agility of a startup and the backing of a mature organization. You’ll play a pivotal role in shaping how AI agents operate safely and effectively across real-world enterprise environments.

Responsibilities:

  • Define the overall testing strategy and tooling stack across integration, regression, and load/performance testing.
  • Drive an automation-first mindset — collaborate with developers to ensure code is testable and observable.
  • Partner with product and security to define quality gates for features like agent identity, access delegation, and secrets handling.
  • Lead root-cause analysis for escaped bugs and define improvement actions.
  • Own CI quality metrics and dashboards (e.g., build stability, test flakiness, regression coverage).
  • Influence decisions about test environments, mocks, test data, and production parity.
  • Collaborate with the centralized quality group to push for E2E coverage

Qualifications

  • At least 5 years of experience in QA positions
  • Experience building QA practices for cloud-native, distributed systems
  • Deep expertise in defining quality strategy in early-stage teams or 0→1 products
  • Hands-on experience with CI/CD pipelines (e.g., GitHub Actions, CircleCI, or similar)
  • Experience testing Go-based systems — or equivalent backend APIs — including performance and concurrency validation
  • Familiarity with AWS services, including API Gateway, Lambda, DynamoDB, CloudWatch
  • Knowledge of observability tools like OpenTelemetry, Datadog - Advantage
  • Background or experience in software development and/or security testing - Advantage.
  • Knowledge of security principles (e.g., access control, secrets exposure, identity testing) — a strong Advantage
  • Experience in building automated testing gates in CI/CD-based products

Set alerts for more jobs like Senior QA Architect
Set alerts for new jobs by CyberArk
Set alerts for new Quality Assurance jobs in Israel
Set alerts for new jobs in Israel
Set alerts for Quality Assurance (Remote) jobs
Contact Us
hello@outscal.com
Made in INDIA 💛💙