Senior SWQA Test Development Engineer, LLM Benchmarking

1 Month ago • 5 Years + • Quality Assurance

Job Summary

Job Description

NVIDIA seeks a Senior SWQA Test Development Engineer specializing in LLM Benchmarking. Responsibilities include test planning, execution, and reporting; automating test cases; developing QA tools; managing the bug lifecycle; and collaborating with cross-functional teams. The ideal candidate will have a strong background in test automation (API/UI), model testing, LLM benchmarking, and experience with Unix/Linux and Python. This role requires proficiency in failure analysis and a deep understanding of QA principles. The engineer will significantly impact the quality of NVIDIA's products.
Must have:
  • 5+ years QA experience
  • Proficient in Unix/Linux and Python
  • API/UI test automation experience
  • Model testing and LLM benchmarking expertise
  • Strong QA sense and problem-solving skills
Good to have:
  • Experience with NVIDIA GPU hardware
  • Deep learning framework background
  • Parallel programming experience (CUDA/OpenCL)

Job Details

NVIDIA is the world leader in GPU Computing. We are passionate about markets include gaming, automotive, professional vision, HPC, datacenters and networking in addition to our traditional OEM business. NVIDIA is also well positioned as the ‘AI Computing Company’, and NVIDIA GPUs are the brains powering modern Deep Learning software frameworks, accelerated analytics, modern data centers, and driving autonomous vehicles. We have some of the most experienced and dedicated people in the world working for us. If you are dedicated, forward-thinking, and if working with hard-working technical people across countries sounds exciting, this job is for you.

We are now looking for a Senior Software QA Test Development Engineer, you will collaborate with multi-functional groups. SWQA test developer engineer at NVIDIA is responsible for test planning, execution, and reporting, you will also write scripts to automate testing, design and develop tools for QA team, or develop integration tests for validation, so QA engineer can improve productivity or optimize test plan. As a SWQA test developer, you must identify weak spots and constantly design better and creative test plans to break software and identify potential issues. You will have a huge impact on the quality of NVIDIA's products.

What you’ll be doing:

  • Review product requirements and develop test matrix.

  • Build test plan, design test case, execute and report test progress, bugs, and results to management.

  • Automate test cases and assist in the architecture, crafting and implementing of test frameworks.

  • Manage bug lifecycle and co-work with inter-groups to drive for solutions.

  • In-house repro and verify customer issues/fixes.

What we need to see:

  • BS or higher degree or equivalent experience in CS/EE/CE plus equivalent with 5+ years QA experience.

  • Proficient in Unix/Linux and shell/python programming skills.

  • Rich experience in test cases development, tests automation in API/UI and failure analysis.

  • Good knowledge and hands-on experience in model testing and LLM benchmarking

  • Good QA sense including attention to detail, problem-solving, data analysis, quality standards knowledge, time management etc.

  • Excellent communicator, fluent written and verbal English.

  • Good teamwork with ability to work independently.

  • Passion to learn new hardcore technology.

Ways to stand out from the crowd:

  • Experience working with NVIDIA GPU hardware is a strong plus

  • Background in deep learning frameworks is a plus

  • Experience in parallel programming ideally CUDA/OpenCL is a plus

#LI-Hybrid

Similar Jobs

NVIDIA - Senior DevOps Engineer - Accelerated Computing

NVIDIA

Westford, Massachusetts, United States (Hybrid)
1 Month ago
Next Level Business Services - SDE Web Developer

Next Level Business Services

Redmond, Washington, United States (On-Site)
4 Months ago
Larian Studios - DevOps Build Engineer

Larian Studios

Dublin, County Dublin, Ireland (On-Site)
3 Months ago
ByteDance - Software Development Engineer - Cloud Native Databases

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Cognizant - Oracle BRM CI-CD

Cognizant

Pune, Maharashtra, India (Hybrid)
3 Months ago
PwC - Assurance Technology Risk & Quality Manager

PwC

Dublin, County Dublin, Ireland (On-Site)
4 Months ago
G5 Games - Senior QA Automation Engineer

G5 Games

Podgorica, Podgorica Municipality, Montenegro (Remote)
1 Month ago
Nium - Sr SDET

Nium

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Corsair - Software QA Engineer at Elgato (m/f/d)

Corsair

Munich, Bavaria, Germany (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

DEVOTEAM - Tech Lead Java

DEVOTEAM

Casablanca, Casablanca-Settat, Morocco (Remote)
4 Months ago
ION - Technical Support Analyst, Chicago - 5849/9555

ION

Chicago, Illinois, United States (On-Site)
4 Months ago
Sinch - Lead System Engineer (Linux)

Sinch

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Rackspace Technology - Site Reliability Engineer / Observability Engineer

Rackspace Technology

India (Remote)
2 Weeks ago
Vista - Senior Quality Engineer

Vista

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Swiss Re - Senior Site Reliability Engineer

Swiss Re

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Rockstar Games - Online System Administrator

Rockstar Games

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Luxoft - Murex Lead MxML Developer

Luxoft

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Luxoft - Senior .net developer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago
Hogarth - Comp Artist - Buenos Aires Based

Hogarth

Buenos Aires, Buenos Aires, Argentina (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Shanghai, Shanghai, China

Keywords Studios (Player Support) - 3D Character Artist

Keywords Studios (Player Support)

Shanghai, Shanghai, China (On-Site)
9 Months ago
Riot Games - Senior Business Operation Manager

Riot Games

Shanghai, Shanghai, China (On-Site)
5 Months ago
NVIDIA - CPU Architecture Intern - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Spin Master - Project Manager

Spin Master

Guangdong Province, China (On-Site)
1 Month ago
NVIDIA - Deep Learning Computing Performance Architect

NVIDIA

Shanghai, Shanghai, China (Hybrid)
1 Month ago
Microsoft - Senior Applied Scientist (Core Search)

Microsoft

Beijing, Beijing, China (On-Site)
1 Month ago
NVIDIA - Senior ASIC Verification Engineer - Networking Chip Design

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Day ago
Tencent - ARPG Product Expert - Game Overseas Publishing

Tencent

Shenzhen, Guangdong Province, China (On-Site)
4 Days ago
Tencent - Overseas Game Business Translator

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Days ago
Tencent - Senior Level Designer (3A Action Game)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

SparkCognition - Senior QA Engineer

SparkCognition

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Gametion Technologies   - Game Tester

Gametion Technologies

Navi Mumbai, Maharashtra, India (On-Site)
4 Months ago
Evolution - QA Engineer

Evolution

Riga, Latvia (Hybrid)
9 Months ago
Epic Games - Senior QA Analyst, Manual (Web App)

Epic Games

Bellevue, Washington, United States (On-Site)
1 Month ago
Saviynt - Senior Engineer SDET, Quality Engineering

Saviynt

El Segundo, California, United States (Hybrid)
4 Months ago
CloudLinux - Lead SDET/QA Automation Engineer at CloudLinux (worldwide remote, work anywhere)

CloudLinux

Bratislava Region, Slovakia (Remote)
3 Months ago
N-iX - Senior Automation (JS, Cypress) Test Engineer

N-iX

Ukraine (Remote)
1 Week ago
Amazon - QA Specialist, Amazon Games

Amazon

Bucharest, Bucharest, Romania (On-Site)
4 Months ago
Wind River Systems - Senior Software Engineer – ASPICE Experienced

Wind River Systems

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Nintendo - Contract - DevOps Engineer

Nintendo

Redmond, Washington, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Shenzhen, Guangdong Province, China (On-Site)

Bengaluru, Karnataka, India (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Shanghai, Shanghai, China (On-Site)

Shanghai, Shanghai, China (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug