Senior Software Automation Test Engineer

1 Year ago • 6 Years +

Testing

Job Description

Razer is seeking a Senior AI Automation Engineer to lead the development and automation of internal AI product testing during early development stages. This role involves ensuring AI models and systems undergo thorough validation and functional testing before production integration. The engineer will build and maintain automated testing frameworks, mentor junior staff, collaborate with AI teams, and establish robust AI product testing frameworks. Responsibilities include designing and implementing automated testing frameworks for AI products on cloud platforms, developing unit, integration, and functional tests, defining best practices for AI testing, and creating tools for evaluation and explainability testing. The role also entails defining benchmarking criteria, building CI/CD pipelines, implementing version control, and developing internal tools for test result tracking.

Good To Have:

Experience with Infrastructure as Code tools such as Terraform.
Ability and willingness to learn new technologies in a fast-paced environment.

Must Have:

6+ years of experience in AI automation, MLOps, or software testing for AI products.
Develop AI testing frameworks and automated validation pipelines.
Strong programming skills in Python, Bash, or Java.
Hands-on experience with AI Testing & Validation (Pytest, Great Expectations).
In-depth understanding of containerization (Docker, Kubernetes) and DevOps practices.
Experience developing and deploying AI applications (edge and cloud).
Knowledge of distributed computing (Spark, Dask) and parallel processing.
Strong problem-solving and debugging abilities for AI systems.
Excellent written and verbal communication skills.

Add these skills to join the top 1% applicants for this job

communication

problem-solving

game-texts

agile-development

automated-testing

functional-testing

aws

azure

terraform

spark

google-cloud-platform

ci-cd

docker

kubernetes

python

bash

java

Joining Razer will place you on a global mission to revolutionize the way the world games. Razer is a place to do great work, offering you the opportunity to make an impact globally while working across a global team located across 5 continents. Razer is also a great place to work, providing you the unique, gamer-centric #LifeAtRazer experience that will put you in an accelerated growth, both personally and professionally.

Job Responsibilities :

We are seeking a Senior AI Automation Engineer to lead the development and automation of internal AI product testing at the early stages of development. This role is crucial in ensuring that AI models and systems undergo comprehensive validation, development and functional testing, before being integrated into production. You will be responsible for building and maintaining automated testing frameworks that enable AI teams to efficiently test their models and products. As a senior member, you will mentor junior engineers, work cross-functionally with AI teams, and establish robust AI product testing frameworks.

Essential Duties and Responsibilities

Design and implement automated testing frameworks and workflows for AI products / models in early-stage development, both locally and on cloud platforms (AWS, GCP, Azure)
Develop unit tests, integration tests, and functional tests for AI components.
Define best practices for AI product / model testing, debugging, and validation.
Create tools to automate AI product / model evaluation, robustness checks, and explainability testing.
Work with AI teams and data scientists to define benchmarking criteria and pass/fail thresholds.
Build continuous integration and deployment (CI/CD) pipelines to streamline AI product / model testing, in containeriszed environments (Docker, Kubernetes)
Implement version control, rollback mechanisms, and experiment tracking for AI models.
Develop internal tools and dashboards for AI teams to track test results and model performance.
Optimize AI testing environments for parallel and distributed testing at scale.
Partner with AI teams and MLOps teams to enhance internal testing capabilities.
Provide mentorship and technical leadership to junior engineers.

Pre-Requisites :

Qualifications

6+ years of experience in AI automation, MLOps, or software testing for AI products.
Proven experience in developing AI testing frameworks and automated validation pipelines, such as AI model evaluation, adversarial testing, and explainability frameworks
Strong programming skills in Python, Bash or Java.
Hands-on experience AI Testing & Validation (Pytest, Great Expectations and etc).
In depth understanding of containerization (Docker, Kubernetes) and DevOps practices.
Experience in developing and deploying AI applications running both edge deployment (TensorRT, ONNX) and on cloud infrastructure (AWS, Azure or Google Cloud Platform) using Infrastructure as code tools such as Terraform
Knowledge of distributed computing (Spark, Dask) and parallel processing.
Strong problem-solving and debugging abilities for AI systems.
Ability and willingness to learn any new technologies and apply them at work in order to stay ahead, in a fast paced, high pressure, agile environment
Excellent written and verbal communication skills for coordinating across teams.

Education & Experience