Staff AI QA Engineer
Job Summary
Job Description
As a Staff AI QA Engineer, you will ensure the quality and reliability of AI/ML models and systems. This involves collaborating with data scientists, ML engineers, and software developers to design, implement, and execute comprehensive test strategies. Your role includes refining test plans, reproducing defects, developing and maintaining automated test suites, validating AI models, ensuring data integrity, and improving model reliability. You will also document test plans and resolutions. This role directly impacts the performance and robustness of AI solutions, ensuring their successful implementation and operation within the company's infrastructure.
Must have:
- Minimum of 7 years of experience in software quality assurance.
- 2+ years focused on AI/ML testing.
- Strong knowledge of test automation frameworks (e.g., PyTest).
- Experience with AI/ML model validation and testing techniques.
- Proficiency in Python and ML libraries (e.g., TensorFlow, PyTorch).
- Hands-on experience with CI/CD pipelines and automated testing.
- Ability to analyze logs, trace errors, and conduct root cause analysis.
- Strong problem-solving skills and attention to detail.
- Bachelor’s or Master’s degree in a related field.
Good to have:
- Experience working with cloud-based AI/ML platforms.
- Experience with large-scale distributed AI systems.
- Knowledge of MLOps best practices and model monitoring
14 skills required
Job Details
About AiDASH
AiDASH is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture goals. AiDASH exists to safeguard critical infrastructure and secure the future of humanAIty™. Learn more at www.aidash.com
We are a Series C climate tech startup backed by leading investors, including Shell Ventures, National Grid Partners, G2 Venture Partners, Duke Energy, Edison International, Lightrock, Marubeni, among others. We have been recognized by Forbes two years in a row as one of “America’s Best Startup Employers.” We are also proud to be one of the few climate software companies in Time Magazine’s “America’s Top GreenTech Companies 2024”. Deloitte Technology Fast 500™ recently ranked us at No. 12 among San Francisco Bay Area companies, and No. 59 overall in their selection of the top 500 for 2024.
Join us in Securing Tomorrow!
The Role
We are seeking a highly skilled Staff AI QA Engineer to join our Data Science team in Bengaluru, India. In this role, you will be responsible for ensuring the quality and reliability of our AI/ML models and systems. You will work closely with data scientists, ML engineers, and software developers to design, implement, and execute comprehensive test strategies. Your work will directly impact the robustness and performance of our AI solutions.
How you'll make an impact:
- Review and refine test plans to ensure that all critical AI/ML functionalities are rigorously tested
- Reproduce defects in a controlled test environment, track down their sources, and work with engineers to resolve them
- Develop, maintain, and improve automated test suites for AI/ML models and data pipelines
- Validate AI models under various conditions, including edge cases and high-load scenarios
- Ensure data integrity across training, validation, and production pipelines
- Work closely with software and AI engineers to define testing requirements and improve model reliability
- Maintain clear documentation of test plans, issues found, and resolutions implemented
What we're looking for:
- Minimum of 7 years of experience in software quality assurance, with at least 2+ years focused on AI/ML testing
- Strong knowledge of test automation frameworks (e.g., PyTest)
- Experience with AI/ML model validation and testing techniques
- Proficiency in Python and familiarity with machine learning libraries (e.g., TensorFlow, PyTorch)
- Hands-on experience with CI/CD pipelines and automated testing in DevOps environments
- Ability to analyze logs, trace errors, and conduct thorough root cause analysis
- Strong problem-solving skills and attention to detail
- Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field
Preferred Qualifications:
- Experience working with cloud-based AI/ML platforms (AWS SageMaker, Azure ML, GCP AI)
- Experience with large-scale distributed AI systems and performance benchmarking
- Knowledge of MLOps best practices and model monitoring
We are proud to be an equal-opportunity employer. We are committed to embracing diversity and inclusion in our hiring practices, and we promote a work environment where everyone, from any race, color, religion, sex, sexual orientation, gender identity, or national origin, can do their best work.
We are committed to providing an inclusive and accessible interview experience for all candidates. Please let us know if you require any accommodation during the interview process, and we will make every effort to meet your needs.
Similar Jobs
Coupa
Pune, Maharashtra, India (Hybrid)
• 7 Months ago
Sabre India
Dallas, Texas, United States (Hybrid)
• 3 Weeks ago
The Walt Disney Company
Lake Buena Vista, Florida, United States (On-Site)
• 3 Months ago
SimpliSafe
Boston, Massachusetts, United States (Hybrid)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Palo Alto Networks
Chicago, Illinois, United States (On-Site)
• 3 Weeks ago
ISS Stoxx
Mumbai, Maharashtra, India (On-Site)
• 1 Month ago
high radius
Houston, Texas, United States (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Jobs in Bengaluru, Karnataka, India
Kulfi Collective
Mumbai, Maharashtra, India (On-Site)
• 1 Month ago
Get notifed when new similar jobs are uploaded
Quality Assurance Jobs
Trellix
Bengaluru, Karnataka, India (On-Site)
• 1 Month ago
Apple
Cupertino, California, United States (On-Site)
• 1 Week ago
Get notifed when new similar jobs are uploaded
About The Company
AiDash is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, and water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture goals. Our customers deliver ROI in their first year of deployment with reduced costs, improved reliability, and achieved sustainability goals. Learn more at www.aidash.com.
Get notified when new jobs are added by AiDash
