AI Computing Software Engineering Intern, TensorRT

3 Months ago • Upto 1 Years • Research & Development

Job Summary

Job Description

NVIDIA seeks excellent Software Engineering interns to join its rapidly growing research and development team focused on GPU-accelerated deep learning inference using TensorRT. Interns will develop highly optimized deep learning kernels, conduct performance analysis, collaborate on software and architecture improvements across various teams (automotive, image understanding, speech, LLMs), and work with deep learning frameworks like TensorFlow or PyTorch. The role involves performance modeling, profiling, debugging, and code optimization across CPU and GPU architectures. Strong C/C++ programming, software design skills, and a deep curiosity about AI are essential. This internship provides hands-on experience contributing to cutting-edge deep learning software used globally.
Must have:
  • Excellent C/C++ programming skills
  • Deep learning kernel development
  • Performance analysis & modeling
  • GPU programming (CUDA/OpenCL)
  • Experience with TensorFlow/PyTorch
Good to have:
  • Python experience
  • CPU/GPU architectural knowledge

Job Details

We are rapidly growing our research and software development for Inference. We seek excellent Software Engineers and Interns to join our team. We specialize in developing GPU-accelerated Deep Learning software. Researchers around the world are using NVIDIA GPUs to power a revolution in deep learning, enabling breakthroughs in numerous areas. Join the team that builds software to enable new solutions. Collaborate with the deep learning community to implement the latest algorithms for public release in TensorRT.

What you’ll be doing:

  • Develop deeply optimized deep learning kernels for inference.

  • Conduct performance analysis and modeling to understand the performance limiter of current software stack as well as underlying hardware architecture.

  • Collaborate with different teams to improve both the software and architectures to extend the state of the art in performance, efficiency, reliability, and programmability.

  • Work with cross-collaborative teams across automotive, image understanding, speech understanding, and large language models to develop creative solutions.

What we need to see:

  • Pursuing BS or higher degree in Computer Engineering, Computer Science, Electrical Engineer, or related computing focused degree.

  • Excellent C/C++ programming and software designing skills, including debugging, performance analysis, and test design.

  • Python experience is a plus.

  • Performance modelling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU.

  • GPU programming experience (CUDA or OpenCL).

  • Experience working with deep learning frameworks like TensorFlow or PyTorch.

  • Strong curiosity about artificial intelligence, awareness of the latest developments in LLMs, generative, and recommender models.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking people in the world working for us. If you're creative and autonomous, we want to hear from you!

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Similar Jobs

Crunchyroll - Senior Machine Learning Engineer, Recommendations

Crunchyroll

Culver City, California, United States (On-Site)
5 Months ago
ByteDance - Machine Learning Engineer - Machine Learning Infrastructure

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Smarsh - Lead Machine Learning Engineer

Smarsh

India (Hybrid)
6 Months ago
NVIDIA - Senior AI-HPC Cluster Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago
Evolution - Data Scientist

Evolution

Warsaw, Masovian Voivodeship, Poland (Hybrid)
8 Months ago
Trend Micro - Senior Software Development Engineer

Trend Micro

Manila, Metro Manila, Philippines (Hybrid)
6 Months ago
Meta - Software Engineer, Machine Learning

Meta

Fremont, California, United States (Remote)
5 Months ago
Meta - ML Silicon Performance Architect

Meta

Sunnyvale, California, United States (On-Site)
5 Months ago
Nintendo - Senior Engineer, Device Driver (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
3 Months ago
NVIDIA - Technical Product Manager - AV Simulation

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoMotive - Software Engineer, Machine Learning-Perception

GoMotive

India (Remote)
1 Month ago
NVIDIA - LLM Application Intern, AV Infrastructure - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Meta - Software Engineer, Machine Learning

Meta

Burlingame, California, United States (On-Site)
5 Months ago
ByteDance - Software Engineer in Machine Learning Systems

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Research Engineer Graduate (Machine Learning Sys-US) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Snail Games - Software Engineer - AI/Machine Translation

Snail Games

Beverly Hills, California, United States (Remote)
1 Month ago
Netflix - Machine Learning Software Engineer L4/L5

Netflix

United States (Remote)
3 Months ago
ByteDance - Video Analysis and Quality Algorithm Intern 2023 Summer/Fall (PHD)

ByteDance

San Diego, California, United States (On-Site)
5 Months ago
Ubisoft - Scientifique en données ML Senior _ Groupe Technologique Content Creation

Ubisoft

Montreal, Quebec, Canada (On-Site)
2 Months ago
Netflix - Product Manager, ML Platform: Training

Netflix

Los Gatos, California, United States (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

NVIDIA - Mixed Signal Circuit Design Intern - 2025

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
NVIDIA - Safety Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Product Development Engineer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
PwC - Risk & Quality - Manager

PwC

Taipei City, Taiwan (On-Site)
6 Months ago
Garena - Sea Group - Infrastructure Engineer (DC Site)

Garena

Taipei City, Taiwan (On-Site)
3 Months ago
NVIDIA - Senior Technical Program Manager - Deep Learning Enterprise Server Software

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
PearlAbyss - Marketing Manager, Taiwan (Pearl Abyss Subsidiary)

PearlAbyss

Taipei City, Taiwan (On-Site)
3 Months ago
NVIDIA - System Design Validation Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - System Level Product Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal Design Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior ASIC Timing Engineer

NVIDIA

Westford, Massachusetts, United States (On-Site)
2 Months ago
Meta - Software Engineer (Leadership) - Machine Learning

Meta

Burlingame, California, United States (Remote)
5 Months ago
Krafton  - Publishing Tech PM

Krafton

Seoul, South Korea (On-Site)
3 Months ago
Krafton  - [Chairman’s Office] Staff (3년 ~ 6년)

Krafton

Seoul, South Korea (On-Site)
5 Months ago
ByteDance - Research Scientist, Foundation Model, Speech & Audio

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Fluence - Controls Software Engineer-II(m/f/d)

Fluence

Berlin, Berlin, Germany (Hybrid)
6 Months ago
NVIDIA - Senior Thermal Design Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Month ago
Netflix - Machine Learning Scientist (L5)

Netflix

United States (Remote)
2 Months ago
ByteDance - Research Scientist in Large Language Model, Graduates - Doubao (Seed) - 2024 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Google - Software Engineering Manager, People with Disabilities

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Seoul, South Korea (Hybrid)

Yokne'am Illit, North District, Israel (Hybrid)

Yokne'am Illit, North District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

California, United States (Hybrid)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug