Senior SWQA Test Development Engineer, LLM Benchmarking

1 Month ago • 5 Years + • Quality Assurance

Job Summary

Job Description

NVIDIA seeks a Senior SWQA Test Development Engineer specializing in LLM Benchmarking. Responsibilities include test planning, execution, and reporting; automating test cases; developing QA tools; managing the bug lifecycle; and collaborating with cross-functional teams. The ideal candidate will have a strong background in test automation (API/UI), model testing, LLM benchmarking, and experience with Unix/Linux and Python. This role requires proficiency in failure analysis and a deep understanding of QA principles. The engineer will significantly impact the quality of NVIDIA's products.
Must have:
  • 5+ years QA experience
  • Proficient in Unix/Linux and Python
  • API/UI test automation experience
  • Model testing and LLM benchmarking expertise
  • Strong QA sense and problem-solving skills
Good to have:
  • Experience with NVIDIA GPU hardware
  • Deep learning framework background
  • Parallel programming experience (CUDA/OpenCL)

Job Details

NVIDIA is the world leader in GPU Computing. We are passionate about markets include gaming, automotive, professional vision, HPC, datacenters and networking in addition to our traditional OEM business. NVIDIA is also well positioned as the ‘AI Computing Company’, and NVIDIA GPUs are the brains powering modern Deep Learning software frameworks, accelerated analytics, modern data centers, and driving autonomous vehicles. We have some of the most experienced and dedicated people in the world working for us. If you are dedicated, forward-thinking, and if working with hard-working technical people across countries sounds exciting, this job is for you.

We are now looking for a Senior Software QA Test Development Engineer, you will collaborate with multi-functional groups. SWQA test developer engineer at NVIDIA is responsible for test planning, execution, and reporting, you will also write scripts to automate testing, design and develop tools for QA team, or develop integration tests for validation, so QA engineer can improve productivity or optimize test plan. As a SWQA test developer, you must identify weak spots and constantly design better and creative test plans to break software and identify potential issues. You will have a huge impact on the quality of NVIDIA's products.

What you’ll be doing:

  • Review product requirements and develop test matrix.

  • Build test plan, design test case, execute and report test progress, bugs, and results to management.

  • Automate test cases and assist in the architecture, crafting and implementing of test frameworks.

  • Manage bug lifecycle and co-work with inter-groups to drive for solutions.

  • In-house repro and verify customer issues/fixes.

What we need to see:

  • BS or higher degree or equivalent experience in CS/EE/CE plus equivalent with 5+ years QA experience.

  • Proficient in Unix/Linux and shell/python programming skills.

  • Rich experience in test cases development, tests automation in API/UI and failure analysis.

  • Good knowledge and hands-on experience in model testing and LLM benchmarking

  • Good QA sense including attention to detail, problem-solving, data analysis, quality standards knowledge, time management etc.

  • Excellent communicator, fluent written and verbal English.

  • Good teamwork with ability to work independently.

  • Passion to learn new hardcore technology.

Ways to stand out from the crowd:

  • Experience working with NVIDIA GPU hardware is a strong plus

  • Background in deep learning frameworks is a plus

  • Experience in parallel programming ideally CUDA/OpenCL is a plus

#LI-Hybrid

Similar Jobs

Zeta - Site Reliability Engineer I (Payzapp)

Zeta

Bengaluru, Karnataka, India (On-Site)
4 Months ago
ION - Senior Linux Systems Administrator - Somerset, NJ

ION

Clifton, New Jersey, United States (Hybrid)
4 Months ago
Luxoft - Murex Technical Developer - Lead

Luxoft

Toronto, Ontario, Canada (On-Site)
3 Months ago
Rockstar Games - Online System Administrator

Rockstar Games

Bengaluru, Karnataka, India (On-Site)
4 Days ago
NVIDIA - CAD Layout Design Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
NVIDIA - Test Floor Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Actian - Sustenance Engineer - Actian Data Platform - Bangalore/Pune

Actian

Bengaluru, Karnataka, India (On-Site)
4 Months ago
N-iX - Senior Automation QA (Big Data)

N-iX

Ukraine (Remote)
1 Day ago
Playrix - Lead SDET

Playrix

Cyprus (Remote)
3 Months ago
Bohemia Interactive - QA Automation Engineer - DayZ

Bohemia Interactive

Prague, Prague, Czechia (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Product Test Engineer (RDSS Intern) - 2025

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Feld Entertainment - Body Refurb Technician

Feld Entertainment

Ellenton, Florida, United States (On-Site)
4 Months ago
NVIDIA - Senior SRAM Engineer, Circuit Design

NVIDIA

Santa Clara, California, United States (Hybrid)
5 Days ago
CloudLinux - Lead SDET/QA Automation Engineer at CloudLinux (worldwide remote, work anywhere)

CloudLinux

Ljubljana, Ljubljana, Slovenia (Remote)
3 Months ago
The Walt Disney Company - Media Systems Engineer II

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
1 Week ago
PwC - IN- Senior Associate_ DevOps_Advisory Corporate_Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Rackspace Technology - AWS Devops Engineer I - R-20532

Rackspace Technology

Gurugram, Haryana, India (Remote)
2 Months ago
ByteDance - Design Verification Engineer - Multimedia Lab

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Setra Systems - Software Quality Engineer II - Embedded V&V

Setra Systems

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Visteon Corporation - Android Framework Engineer

Visteon Corporation

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Shanghai, Shanghai, China

Razer - Lead Site Reliability Engineer

Razer

Shanghai, Shanghai, China (On-Site)
4 Months ago
Tencent - Global Communications Intern

Tencent

Beijing, Beijing, China (On-Site)
2 Months ago
Zengame Technology - New Media Business Manager

Zengame Technology

Shenyang, Liaoning, China (On-Site)
1 Week ago
Riot Games - Principal Environment Concept Artist

Riot Games

Shanghai, Shanghai, China (On-Site)
4 Months ago
Tencent - Social Media Content Operator - PUBG Mobile Esports

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Week ago
Tencent - 游戏帐号安全产品经理

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Thatgamecompany - Backend Engineer - Shanghai

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
8 Months ago
Kaiying Network - Administrative Specialist

Kaiying Network

Shanghai, Shanghai, China (On-Site)
1 Week ago
Mattel  Inc  - Industrial Engineer

Mattel Inc

Dongguan, Guangdong Province, China (On-Site)
2 Months ago
Nagarro - Associate Principal Engineer (Cloud Architecture)

Nagarro

China (Remote)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

Intrepid Studios,  Inc  - Game QA Engineer

Intrepid Studios, Inc

San Diego, California, United States (On-Site)
4 Days ago
SuperPlay - QA Manual Engineer

SuperPlay

Warsaw, Masovian Voivodeship, Poland (Remote)
8 Months ago
Manastu Space - AIT Technician

Manastu Space

Navi Mumbai, Maharashtra, India (On-Site)
5 Months ago
Luxoft - Senior QA Analyst - AML & FinCrime

Luxoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Unity - Senior Software Developer, QA

Unity

Montreal, Quebec, Canada (On-Site)
4 Months ago
Playrix - Lead QA Automation Engineer (Mobile)

Playrix

Ukraine (Remote)
3 Months ago
Growe - Customer Support Quality Team Leader

Growe

Colombia (On-Site)
3 Weeks ago
CloudLinux - Lead SDET/QA Automation Engineer at CloudLinux (worldwide remote, work anywhere)

CloudLinux

Prague, Prague, Czechia (Remote)
3 Months ago
Fluence - Systems Engineer - Product Verification & Validation (m/f/d)

Fluence

Erlangen, Bavaria, Germany (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Yokne'am Illit, North District, Israel (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

United States (Remote)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug