Staff AI QA Engineer

2 Months ago • 7 Years +

Job Summary

Job Description

As a Staff AI QA Engineer, you will ensure the quality and reliability of AI/ML models and systems. This involves collaborating with data scientists, ML engineers, and software developers to design, implement, and execute comprehensive test strategies. Your role includes refining test plans, reproducing defects, developing and maintaining automated test suites, validating AI models, ensuring data integrity, and improving model reliability. You will also document test plans and resolutions. This role directly impacts the performance and robustness of AI solutions, ensuring their successful implementation and operation within the company's infrastructure.

Must have:

Minimum of 7 years of experience in software quality assurance.
2+ years focused on AI/ML testing.
Strong knowledge of test automation frameworks (e.g., PyTest).
Experience with AI/ML model validation and testing techniques.
Proficiency in Python and ML libraries (e.g., TensorFlow, PyTorch).
Hands-on experience with CI/CD pipelines and automated testing.
Ability to analyze logs, trace errors, and conduct root cause analysis.
Strong problem-solving skills and attention to detail.
Bachelor’s or Master’s degree in a related field.

Good to have:

Experience working with cloud-based AI/ML platforms.
Experience with large-scale distributed AI systems.
Knowledge of MLOps best practices and model monitoring

12 skills required

12 skills required for this role

Add these skills to join the top 1% applicants for this job

shell

tensorflow

ci-cd

azure

aws

python

pytorch

data-science

quality-control

automated-testing

test-suites

saas-business-models

Job Details

About AiDASH

AiDASH is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture goals. AiDASH exists to safeguard critical infrastructure and secure the future of humanAIty™. Learn more at www.aidash.com

We are a Series C climate tech startup backed by leading investors, including Shell Ventures, National Grid Partners, G2 Venture Partners, Duke Energy, Edison International, Lightrock, Marubeni, among others. We have been recognized by Forbes two years in a row as one of “America’s Best Startup Employers.” We are also proud to be one of the few climate software companies in Time Magazine’s “America’s Top GreenTech Companies 2024”. Deloitte Technology Fast 500™ recently ranked us at No. 12 among San Francisco Bay Area companies, and No. 59 overall in their selection of the top 500 for 2024.

Join us in Securing Tomorrow!

The Role

We are seeking a highly skilled Staff AI QA Engineer to join our Data Science team in Bengaluru, India. In this role, you will be responsible for ensuring the quality and reliability of our AI/ML models and systems. You will work closely with data scientists, ML engineers, and software developers to design, implement, and execute comprehensive test strategies. Your work will directly impact the robustness and performance of our AI solutions.

How you'll make an impact:

Review and refine test plans to ensure that all critical AI/ML functionalities are rigorously tested
Reproduce defects in a controlled test environment, track down their sources, and work with engineers to resolve them
Develop, maintain, and improve automated test suites for AI/ML models and data pipelines
Validate AI models under various conditions, including edge cases and high-load scenarios
Ensure data integrity across training, validation, and production pipelines
Work closely with software and AI engineers to define testing requirements and improve model reliability
Maintain clear documentation of test plans, issues found, and resolutions implemented

What we're looking for:

Minimum of 7 years of experience in software quality assurance, with at least 2+ years focused on AI/ML testing
Strong knowledge of test automation frameworks (e.g., PyTest)
Experience with AI/ML model validation and testing techniques
Proficiency in Python and familiarity with machine learning libraries (e.g., TensorFlow, PyTorch)
Hands-on experience with CI/CD pipelines and automated testing in DevOps environments
Ability to analyze logs, trace errors, and conduct thorough root cause analysis
Strong problem-solving skills and attention to detail
Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field

Preferred Qualifications:

Experience working with cloud-based AI/ML platforms (AWS SageMaker, Azure ML, GCP AI)
Experience with large-scale distributed AI systems and performance benchmarking
Knowledge of MLOps best practices and model monitoring

We are proud to be an equal-opportunity employer. We are committed to embracing diversity and inclusion in our hiring practices, and we promote a work environment where everyone, from any race, color, religion, sex, sexual orientation, gender identity, or national origin, can do their best work.

We are committed to providing an inclusive and accessible interview experience for all candidates. Please let us know if you require any accommodation during the interview process, and we will make every effort to meet your needs.