Deep Learning Engineer, Datacenters

3 Weeks ago • 3 Years + • Research & Development

Job Summary

Job Description

NVIDIA's Deep Learning Engineer in Datacenters will help develop software infrastructure to analyze deep learning applications, evolve cost-efficient datacenter architectures for LLMs, and work with experts to develop analysis and profiling tools in Python, bash, and C++. Responsibilities involve analyzing system and software characteristics of DL applications, developing analysis tools, and measuring key performance metrics to estimate efficiency improvements. The role requires collaboration with various teams across NVIDIA, from research to silicon architecture. The ideal candidate will have experience with system software, GPU kernels, or DL frameworks and a strong understanding of system architecture and performance.
Must have:
  • Bachelor's degree in EE/CS (Master's/PhD preferred)
  • 3+ years relevant experience
  • System software/Silicon architecture experience
  • C/C++ and Python programming
  • Deep Learning application analysis
Good to have:
  • CUDA, PyTorch, TensorFlow
  • Containerization (Docker), Slurm
  • Performance monitoring tools (perf, gprof)
  • Performance modeling (CPU, GPU, Memory, Network)
  • Multi-site/functional team experience

Job Details

As NVIDIA makes inroads into the Datacenter business, our team plays a central role in getting the most out of our exponentially growing datacenter deployments as well as establishing a data-driven approach to hardware design and system software development. We collaborate with a broad cross section of teams at NVIDIA ranging from DL research teams to CUDA Kernel and DL Framework development teams, to Silicon Architecture Teams. As our team grows, and as we seek to identify and take advantage of long term opportunities, our skillset needs are expanding as well.

Do you want to influence the development of high-performance Datacenters designed for the future of AI? Do you have an interest in system architecture and performance? In this role you will find how CPU, GPU, networking, and IO relate to deep learning (DL) architectures for Natural Language Processing, Computer Vision, Autonomous Driving and other technologies. Come join our team, and bring your interests to help us optimize our next generation systems and Deep Learning Software Stack.

What you'll be doing:

  • Help develop software infrastructure to characterize and analyze a broad range Deep Learning applications
  • Evolve cost-efficient datacenter architectures tailored to meet the needs of Large Language Models (LLMs).
  • Work with experts to help develop analysis and profiling tools in Python, bash and C++ to measure key performance metrics of DL workloads running on Nvidia systems.
  • Analyze system and software characteristics of DL applications.
  • Develop analysis tools and methodologies to measure key performance metrics and to estimate potential for efficiency improvement.

What we need to see:

  • A Bachelor’s degree in Electrical Engineering or Computer Science with 3 years or more of relevant experience (Masters or PhD degree preferred)
  • Experience in at least one of the following:
    • System Software: Operating Systems (Linux), Compilers, GPU kernels (CUDA), DL Frameworks (PyTorch, TensorFlow).
    • Silicon Architecture and Performance Modeling/Analysis: CPU, GPU, Memory or Network Architecture
  • Experience programming in C/C++ and Python. Exposure to Containerization Platforms (docker) and Datacenter Workload Managers (slurm) is a plus
  • Demonstrated ability to work in virtual environments, and a strong drive to own tasks from beginning to end. Prior experience with such environments will make you stand out.

Ways to stand out from the crowd:

  • Background with system software, Operating system intrinsics, GPU kernels (CUDA), or DL Frameworks (PyTorch, TensorFlow).

  • Experience with silicon performance monitoring or profiling tools (e.g. perf, gprof, nvidia-smi, dcgm).

  • In depth performance modeling experience in any one of CPU, GPU, Memory or Network Architecture

  • Exposure to Containerization Platforms (docker) and Datacenter Workload Managers (slurm).

  • Prior experience with multi-site teams or multi-functional teams.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid

Similar Jobs

Cargo Studio - Lead DevOps Engineer

Cargo Studio

(On-Site)
2 Months ago
The Walt Disney Company - Senior Pipeline Engineer

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Month ago
Nintendo - Contract - DevOps Engineer

Nintendo

Redmond, Washington, United States (On-Site)
2 Months ago
Zeta - Sr. Site Reliability Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Senior Lab Engineer, Project Starline

Google

Mountain View, California, United States (On-Site)
1 Week ago
Riot Games - Principal Software Engineer, Gameplay - Teamfight Tactics

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
NVIDIA - Senior Package Layout Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
Google - Full Chip Physical Integration and CAD Engineer, Silicon

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
ByteDance - Senior Machine Learning Ops Engineer, ML System

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Vigaet - Self-Driving Car Intern

Vigaet

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hacksaw Studios - Client Integration Developer

Hacksaw Studios

Stockholm, Stockholm County, Sweden (On-Site)
2 Months ago
Velotio Technologies - Senior DevOps Engineer (GCP)

Velotio Technologies

Maharashtra, India (Remote)
1 Month ago
Flying Bark Productions - DevOps Engineer

Flying Bark Productions

New South Wales, Australia (Hybrid)
2 Months ago
Toptracer - Junior Software Engineer

Toptracer

Stockholm, Stockholm County, Sweden (Hybrid)
2 Months ago
Xsolla - Database Administrator

Xsolla

Montreal, Quebec, Canada (Hybrid)
2 Weeks ago
Steer Studios - Windows and Linux System Administrator

Steer Studios

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
3 Weeks ago
Luxoft - DevOps Engineer with Azure

Luxoft

Pune, Maharashtra, India (On-Site)
4 Months ago
ByteDance - Backend Software Engineer

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Trend Micro - (Sr.) Software Engineer in Linux

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Assystems - PROCESS  ENGINEER

Assystems

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Product Solutions Engineer, Payments Platform

Google

Hyderabad, Telangana, India (On-Site)
6 Days ago
OpenText - Lead UX Designer

OpenText

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
EterPride | Brand Design & Digital Agency - Senior Visualizer

EterPride | Brand Design & Digital Agency

Ahmedabad, Gujarat, India (On-Site)
8 Months ago
Warner Bros Games - Staff Analytics Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Month ago
Luxoft - IT Business Analyst

Luxoft

New Delhi, Delhi, India (Remote)
4 Months ago
Luxoft - Java Developer with React JS

Luxoft

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Nagarro - Engineer

Nagarro

India (Remote)
6 Months ago
Simple Viral Games - Backend Developer Intern

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Luxoft - Solution Architect

Luxoft

New Delhi, Delhi, India (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Magnopus - Lead Engineer

Magnopus

St Albans, England, United Kingdom (On-Site)
2 Months ago
NVIDIA - Principal SoC Architect - Hardware

NVIDIA

Westford, Massachusetts, United States (On-Site)
1 Week ago
ByteDance - Research Scientist, Foundation Model, Speech Understanding

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Cadence - Principal Solutions Engineer - AE

Cadence

Noida, Uttar Pradesh, India (On-Site)
7 Months ago
ByteDance - Firmware Software Engineer / Architect

ByteDance

San Jose, California, United States (On-Site)
1 Week ago
Luxoft - Regular C++ Software Developer

Luxoft

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Google - RTL Design Engineer

Google

Madison, Wisconsin, United States (On-Site)
6 Days ago
Evolution - C++ Developer (Video)

Evolution

Riga, Latvia (On-Site)
3 Months ago
Google - Software Engineering Manager, Core Dev, Rust

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug