Senior SWQA Test Development Engineer, LLM Benchmarking

4 Months ago • 5 Years + • Quality Assurance

Job Summary

Job Description

NVIDIA seeks a Senior SWQA Test Development Engineer specializing in LLM Benchmarking. Responsibilities include test planning, execution, and reporting; automating test cases; developing QA tools; managing the bug lifecycle; and collaborating with cross-functional teams. The ideal candidate will have a strong background in test automation (API/UI), model testing, LLM benchmarking, and experience with Unix/Linux and Python. This role requires proficiency in failure analysis and a deep understanding of QA principles. The engineer will significantly impact the quality of NVIDIA's products.
Must have:
  • 5+ years QA experience
  • Proficient in Unix/Linux and Python
  • API/UI test automation experience
  • Model testing and LLM benchmarking expertise
  • Strong QA sense and problem-solving skills
Good to have:
  • Experience with NVIDIA GPU hardware
  • Deep learning framework background
  • Parallel programming experience (CUDA/OpenCL)

Job Details

NVIDIA is the world leader in GPU Computing. We are passionate about markets include gaming, automotive, professional vision, HPC, datacenters and networking in addition to our traditional OEM business. NVIDIA is also well positioned as the ‘AI Computing Company’, and NVIDIA GPUs are the brains powering modern Deep Learning software frameworks, accelerated analytics, modern data centers, and driving autonomous vehicles. We have some of the most experienced and dedicated people in the world working for us. If you are dedicated, forward-thinking, and if working with hard-working technical people across countries sounds exciting, this job is for you.

We are now looking for a Senior Software QA Test Development Engineer, you will collaborate with multi-functional groups. SWQA test developer engineer at NVIDIA is responsible for test planning, execution, and reporting, you will also write scripts to automate testing, design and develop tools for QA team, or develop integration tests for validation, so QA engineer can improve productivity or optimize test plan. As a SWQA test developer, you must identify weak spots and constantly design better and creative test plans to break software and identify potential issues. You will have a huge impact on the quality of NVIDIA's products.

What you’ll be doing:

  • Review product requirements and develop test matrix.

  • Build test plan, design test case, execute and report test progress, bugs, and results to management.

  • Automate test cases and assist in the architecture, crafting and implementing of test frameworks.

  • Manage bug lifecycle and co-work with inter-groups to drive for solutions.

  • In-house repro and verify customer issues/fixes.

What we need to see:

  • BS or higher degree or equivalent experience in CS/EE/CE plus equivalent with 5+ years QA experience.

  • Proficient in Unix/Linux and shell/python programming skills.

  • Rich experience in test cases development, tests automation in API/UI and failure analysis.

  • Good knowledge and hands-on experience in model testing and LLM benchmarking

  • Good QA sense including attention to detail, problem-solving, data analysis, quality standards knowledge, time management etc.

  • Excellent communicator, fluent written and verbal English.

  • Good teamwork with ability to work independently.

  • Passion to learn new hardcore technology.

Ways to stand out from the crowd:

  • Experience working with NVIDIA GPU hardware is a strong plus

  • Background in deep learning frameworks is a plus

  • Experience in parallel programming ideally CUDA/OpenCL is a plus

#LI-Hybrid

Similar Jobs

ByteDance - Senior Site Reliability Architect - Security Engineering - San Jose

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Cadence - IT -Sr Staff Systems Engineer

Cadence

Noida, Uttar Pradesh, India (On-Site)
8 Months ago
Nielsen Holdings - Software Engineer - Bigdata (Java/ Scala/ Python ,SQL , AWS)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
ByteDance - Global SRE Lead, Security Engineering

ByteDance

Singapore (On-Site)
6 Months ago
Starkflow - Oracle SOA Consultant

Starkflow

New South Wales, Australia (Hybrid)
3 Months ago
Trailmix Games - QA Analyst (Contract)

Trailmix Games

London, England, United Kingdom (Hybrid)
4 Months ago
SSC Technologies - Head of Software QA Engineering

SSC Technologies

Windsor, Connecticut, United States (Hybrid)
7 Months ago
Plarium - QA Engineer

Plarium

Warsaw, Masovian Voivodeship, Poland (Remote)
3 Months ago
Provenir - Senior Quality Assurance Automation Engineer

Provenir

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Xsolla - QA Engineer

Xsolla

Baku, Azerbaijan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Test Product Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
4 Months ago
Fluence - Jr. Controls Engineer (m/f/d) - German speaker

Fluence

Erlangen, Bavaria, Germany (Hybrid)
7 Months ago
NVIDIA - Senior Software QA Test Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
CloudLinux - SDET / QA Automation Engineer

CloudLinux

Sofia City Province, Bulgaria (Remote)
3 Months ago
PwC - Senior Associate

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Luxoft - Murex Datamart Reporting Consultant

Luxoft

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata (Java/Scala , Spark, Python, AWS )

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
7 Months ago
ByteDance - Site Reliability Engineer (Cloud) - Infrastructure Engineering

ByteDance

Singapore (On-Site)
6 Months ago
Samsung Semiconductor - Staff DevOps Engineer

Samsung Semiconductor

San Jose, California, United States (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Shanghai, Shanghai, China

Mattel  Inc  - Sr Equip & Facility Engineer

Mattel Inc

Dongguan, Guangdong Province, China (On-Site)
5 Months ago
Ubisoft - Game Designer - Social [Casual Party Game]

Ubisoft

Shanghai, Shanghai, China (On-Site)
9 Months ago
NVIDIA - Senior System Low Power Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
Animoca Brands - Backend Developer

Animoca Brands

China (Remote)
8 Months ago
Yodo1 - Executive Coordinator

Yodo1

Beijing, Beijing, China (Remote)
2 Months ago
The Walt Disney Company - Associate Technical Director

The Walt Disney Company

Shanghai, Shanghai, China (On-Site)
4 Months ago
Ubisoft - Technical Director, Level Design

Ubisoft

Shanghai, Shanghai, China (On-Site)
4 Months ago
Tencent - Senior Client-Side Security Engineer

Tencent

Shenzhen, Guangdong Province, China (On-Site)
5 Months ago
Razer - Lead Site Reliability Engineer

Razer

Shanghai, Shanghai, China (On-Site)
8 Months ago
Microsoft - Software Engineer

Microsoft

Beijing, Beijing, China (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Quality Assurance Jobs

Paradox Interactive - QA Analyst - Hearts of Iron

Paradox Interactive

Stockholm, Stockholm County, Sweden (On-Site)
4 Months ago
Power Integrations - Senior Failure Analysis Engineer

Power Integrations

Penang, Malaysia (On-Site)
7 Months ago
Token Metrics - Crypto QA Engineer (Remote)

Token Metrics

İstanbul, Türkiye (Remote)
7 Months ago
Wargaming - QA Engineer (World of Tanks)

Wargaming

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Funcom - Senior Dev QA Tester - Dune: Awakening

Funcom

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago
SingleStore - QA Engineer

SingleStore

Hyderabad, Telangana, India (Remote)
7 Months ago
StoneX Group  Inc  - UAT Tester

StoneX Group Inc

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Tesla - Electronics Failure Analysis Engineer EMEA

Tesla

North Brabant, Netherlands (On-Site)
3 Months ago
Overwolf - Manual QA Engineer

Overwolf

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug