Senior C++ Software Engineer - Apache Spark Solution

3 Months ago • 8 Years + • Data Analyst

Job Summary

Job Description

NVIDIA's Spark Acceleration group seeks experienced C++ Software Engineers to accelerate Apache Spark for data science. Responsibilities include designing and implementing a native Spark execution engine using RAPIDS, Velox, and UCX; optimizing data exchange between Velox and RAPIDS; enhancing Velox for performance and Spark compatibility; contributing to the RAPIDS library; conducting performance benchmarking; and presenting technical solutions. The ideal candidate will have 8+ years of software development experience, 3+ years with Velox, RAPIDS, or similar frameworks, exceptional C++ skills, and expertise in columnar data processing. Experience with GPU-accelerated libraries is a plus.
Must have:
  • 8+ years software development experience
  • 3+ years with Velox/RAPIDS
  • Exceptional C++ skills
  • Columnar data processing expertise
  • High-quality distributed system design
Good to have:
  • GPU-accelerated library experience (CUDA, cuBLAS, NCCL, RAPIDS, UCX)
  • Apache Spark, Hadoop, Hive, Arrow committership
Perks:
  • Highly competitive salary
  • Comprehensive benefits package

Job Details

We are seeking experienced C++ Software Engineers to join our Spark Acceleration group. Data scientists spend a considerable amount of time exploring data, iterating over machine learning (ML) experiments.  NVIDIA  believes that data science workflows can benefit tremendously from being accelerated, to enable data scientists to explore many more and larger datasets to drive towards their business goals, faster, and more reliably.

You will work with the open source community to accelerate Apache Spark for data science. Apache Spark is the most popular data processing engine in data centers for data science. We aim to dramatically accelerate Apache Spark use cases without application code changes. You will work on open source libraries including Spark-RAPIDS (https://github.com/NVIDIA/spark-rapids), RAPIDS (https://github.com/rapidsai), and Velox (https://github.com/facebookincubator/velox).

What you'll be doing:

  • Design and implement native Spark execution engine using RAPIDS, Velox, UCX and other related libraries. 

  • Design and implement solutions to optimize data exchange between Velox and RAPIDS libraries

  • Enhance Velox OSS library for improved performance and Spark compatibility

  • Contribute to RAPIDS library for large-scale adoptions in major enterprises

  • Conduct performance benchmarking and profiling to achieve speed-of-light performance

  • Working with a team of exceptional engineers including PMC and Committers of Apache Spark, Apache Hadoop, Apache Hive, and Apache Arrow

  • Presenting technical solutions in industry conferences and meetups

What we need to see:

  • BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field 

  • 8+ years of work or research experience in software development

  • 3+ years hands-on development experience with Velox, RAPIDS or similar data processing frameworks in memory management techniques and data serialization

  • Exceptional C++ development experience in design, programming, testing, and debugging  

  • Design and development expertises in columnar data processing with SIMD (Single Instruction, Multiple Data) and vectorization techniques

  • Familiarity with operating systems and software development environments for ARM

  • Proven technical skills in designing and implementing high-quality distributed systems 

  • Able to work successfully with multi-functional teams across organizational boundaries and geographies

  • Highly motivated with strong communication skills

Ways to stand out from the crowd:

  • Committership at major open source big-data projects 

  • Working experience with GPU-accelerated libraries (CUDA, cuBLAS, NCCL, RAPIDS, UCX) 

We are an AA/EEO/Disabled employer and with highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people on the planet working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you.

Similar Jobs

Mixmob - Senior Full-Stack React/Node & NFT Gaming Developer

Mixmob

Vancouver, British Columbia, Canada (Remote)
11 Months ago
Evolution - Unreal Engine / C++ Developer

Evolution

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
CData Software - Platform Engineer

CData Software

Bengaluru, Karnataka, India (On-Site)
8 Months ago
PwC - IN_Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
Voodoo - Freelance Senior Back-end Engineer Node.Js

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
Zengame Technology - Advertisement Optimizer

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
QUANTIC DREAM - Data Analyst (F/M/NB)

QUANTIC DREAM

Paris, Île-de-France, France (Hybrid)
7 Months ago
ByteDance - Senior Software Engineer, Database Acceleration

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Meta - Data Scientist, Product Analytics

Meta

Los Angeles, California, United States (Remote)
1 Month ago
PwC - Associate

PwC

Pune, Maharashtra, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Manager-Data Engineer|Pune

PwC

Pune, Maharashtra, India (On-Site)
8 Months ago
Appier - Senior Software Engineer, Data Backend

Appier

Taipei City, Taiwan (On-Site)
1 Month ago
ARHS - Senior Java Jee Developer

ARHS

Luxembourg (On-Site)
7 Months ago
JMA - Senior Embedded Systems Security Engineer

JMA

Plano, Texas, United States (On-Site)
6 Months ago
ION - Technical Consultant - Endur

ION

Jersey City, New Jersey, United States (On-Site)
7 Months ago
JustPlay - Director of Data

JustPlay

(Remote)
1 Month ago
euro monitor - Software Engineer 3

euro monitor

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Western Digital - Analyst 3, Data Analytics - Power BI Developer

Western Digital

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Keen Software House - Senior Render Programmer

Keen Software House

Prague, Prague, Czechia (Remote)
3 Months ago
Glean - Cloud Operations Engineer

Glean

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Beijing, Beijing, China

Ubisoft - Economic Designer

Ubisoft

Shanghai, Shanghai, China (On-Site)
4 Months ago
Tencent - Senior Environment Concept Artist

Tencent

Shenzhen, Guangdong Province, China (On-Site)
3 Months ago
IGG - News Editor (Indian)

IGG

Fuzhou, Fujian, China (On-Site)
7 Months ago
Paper Games - HR Generalist Intern - Recruitment (Spring 2025)

Paper Games

Shanghai, Shanghai, China (On-Site)
1 Month ago
Google - Senior Account Executive, Mid-Market Sales, Google Customer Solutions

Google

Guangdong Province, China (On-Site)
1 Month ago
NVIDIA - Deep Learning Performance Architect

NVIDIA

Beijing, Beijing, China (On-Site)
3 Months ago
Virtuos - Head of Game Division, Shanghai

Virtuos

China (On-Site)
1 Month ago
Tencent - Senior 3D Environment Artist - Global AAA Action Game

Tencent

Shenzhen, Guangdong Province, China (On-Site)
5 Months ago
Google - Account Manager, Gaming, Large Customer Sales

Google

Shanghai, Shanghai, China (On-Site)
1 Month ago
NVIDIA - PCB Layout Engineer

NVIDIA

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Google - Senior Data Scientist Product, Google Play Games

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Tencent - WeChat Product Management Intern

Tencent

(On-Site)
1 Month ago
RoofStack - Senior Data Analyst

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
2 Months ago
Ness Digital - Big Data Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
4 Months ago
Playtika - Expert Business Analyst

Playtika

Israel (On-Site)
2 Months ago
DraftKings - Lead Data Science Engineer, Search

DraftKings

Boston, Massachusetts, United States (On-Site)
3 Months ago
Inkittt - Senior Product Analyst

Inkittt

San Francisco, California, United States (Hybrid)
2 Months ago
Netflix - Data Scientist (L5) - Cloud Games Quality of Experience

Netflix

United States (Remote)
1 Month ago
ByteDance - Risk Data Analytics Business Partner

ByteDance

Singapore (On-Site)
1 Month ago
Meta - Data Scientist, Product Analytics

Meta

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

Pune, Maharashtra, India (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug