Senior Staff Engineer - AI/ML QA Engineer

15 Hours ago • 4-8 Years • Quality Assurance

Job Summary

Job Description

This Senior Staff Engineer - AI/ML QA Engineer role requires leading QA efforts to ensure software and AI system reliability. Responsibilities include building and maintaining automated test frameworks (Python, Robot Framework) for APIs, UI, backend, and data pipelines; integrating automated tests into CI/CD pipelines; conducting functional, performance, and exploratory testing; collaborating with engineers and product teams on quality strategies and metrics; and debugging and resolving complex QA issues, including AI/LLM challenges. The ideal candidate possesses expert-level Python skills and general test automation framework experience, along with fundamental GenAI/LLM testing knowledge.
Must have:
  • Python (Expert)
  • Test Automation Framework
  • GenAI/LLM Testing Fundamentals
  • Build automated test frameworks
  • Integrate tests into CI/CD
  • Conduct functional and performance testing
Good to have:
  • Docker
  • Robot Framework

Job Details

Company Description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (19000+ experts across 33 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

Job Description

Looking for senior QA automation profile who can Lead QA efforts to ensure software and AI system reliability.

Key Responsibilities:

  • Build and maintain automated test frameworks (Python, Robot Framework) for APIs, UI, backend, and data pipelines.
  • Integrating automated tests into CI/CD pipelines.
  • Conduct functional, performance, and exploratory testing. Collaborating with engineers and product teams on quality strategies and success metrics.
  • Debugg and resolving complex QA issues, including AI/LLM-related challenges.

Qualifications

Must have Skills: Python (Expert), Test Automation Framework - General Experience, GenAI/LLM Testing Fundamentals.

Good To Have Skills: Docker (Capable), Robot Framework.

Similar Jobs

PENN Interactive - Engineering Manager, ML Platform

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
1 Week ago
Morning Star - Senior Software Engineer

Morning Star

Chicago, Illinois, United States (Hybrid)
4 Months ago
The Walt Disney Company - Principal Software Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
1 Week ago
Microsoft - Digital Technology Specialist - Azure Data & AI - CEMA Market (Arabic Speaker)

Microsoft

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago
Playtech - Front End Developer

Playtech

Kyiv, Kyiv City, Ukraine (On-Site)
1 Week ago
NVIDIA - Senior Supplier Quality Engineer

NVIDIA

Santa Clara, California, United States (On-Site)
3 Weeks ago
NVIDIA - Senior Software QA Test Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
NVIDIA - Senior System Validation Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
1 Month ago
G5 Games - Senior QA Automation Engineer

G5 Games

Podgorica, Podgorica Municipality, Montenegro (Remote)
1 Month ago
Inspired Entertainment - QA Tester

Inspired Entertainment

Burton Upon Trent, England, United Kingdom (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Walt Disney Company - Sr Software Engineer

The Walt Disney Company

Washington, United States (On-Site)
2 Days ago
Ziff Davis - Senior Full Stack Software Engineer

Ziff Davis

Los Angeles, California, United States (Hybrid)
3 Months ago
Intrepid Studios,  Inc  - Associate Software Engineer

Intrepid Studios, Inc

(Remote)
1 Week ago
Luxoft - Orchestrade - Azure infrastructure cloud Senior engineer

Luxoft

Poland, Ohio, United States (Remote)
3 Months ago
Krafton  - [AI] Deep Learning Service Dev - Backend Engineer (3년 이상)

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Anko GCC - DevOps Engineer

Anko GCC

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
ION - Database Engineer (352), New York (hybrid)

ION

New York, New York, United States (Hybrid)
4 Months ago
Luxoft - DevOps Engineer with Azure

Luxoft

Pune, Maharashtra, India (On-Site)
2 Months ago
Verve - Senior Machine Learning Engineer

Verve

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Jam City - DATA ENGINEER

Jam City

Montevideo, Montevideo Department, Uruguay (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Colombia

Easygo - Customer Support Representative

Easygo

Bogotá, Bogota, Colombia (On-Site)
2 Weeks ago
Token Metrics - Crypto SaaS Product Manager Intern (Colombia-Remote)

Token Metrics

Medellín, Antioquia, Colombia (Remote)
4 Months ago
Anthology  Inc  - Software Engineer I

Anthology Inc

Bogotá, Bogota, Colombia (Remote)
3 Days ago
Evolution - Server Administrator

Evolution

Medellín, Antioquia, Colombia (On-Site)
2 Months ago
The Workshop - Technical Infrastructure Project Manager

The Workshop

Tocancipá, Cundinamarca, Colombia (On-Site)
3 Months ago
Nagarro - Staff Engineer - DevOps Site Reliability

Nagarro

Colombia (Remote)
2 Weeks ago
Amber - 3D Animator

Amber

Bogotá, Bogota, Colombia (Hybrid)
1 Week ago
LeoVegas - Live Trader

LeoVegas

Medellín, Antioquia, Colombia (On-Site)
3 Months ago
Amber - Senior Unreal Game Engineer (Project Based)

Amber

Bogota, Colombia (On-Site)
7 Months ago
Rush Street Interactive - Growth Hacker

Rush Street Interactive

Bogotá, Bogota, Colombia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

Experis - VR Video Games Engineer

Experis

Portland, Oregon, United States (On-Site)
7 Months ago
Daybreak Game Company LLC - QA Lead

Daybreak Game Company LLC

Renton, Washington, United States (Hybrid)
1 Week ago
Logitech - Sr. SDT EE Engineer

Logitech

Suzhou, Jiangsu, China (On-Site)
1 Month ago
PlayStation Global - Staff Software Development Engineer in Test

PlayStation Global

San Mateo, California, United States (On-Site)
1 Month ago
DRIFE - QA Engineer

DRIFE

Bengaluru, Karnataka, India (On-Site)
6 Months ago
NVIDIA - Test Floor Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Riot Games - Senior Manager, QA - VALORANT Experience Team

Riot Games

Dublin, County Dublin, Ireland (On-Site)
3 Months ago
Hogarth - QA Analyst

Hogarth

Hyderabad, Telangana, India (Hybrid)
4 Months ago
Inworld AI - Senior Software Development Engineer in Test (SDET) – Game Engine SDKs - Canada

Inworld AI

Vancouver, British Columbia, Canada (On-Site)
4 Months ago
SingleStore - QA Engineer

SingleStore

Hyderabad, Telangana, India (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded