Senior C++ Software Engineer - Apache Spark Solution

3 Months ago • 8 Years + • Data Analyst

Job Summary

Job Description

NVIDIA seeks experienced C++ Software Engineers to join their Spark Acceleration group, focusing on accelerating Apache Spark for data science. Responsibilities include designing and implementing a native Spark execution engine using RAPIDS, Velox, and UCX; optimizing data exchange between Velox and RAPIDS; enhancing Velox for performance and Spark compatibility; contributing to the RAPIDS library; conducting performance benchmarking; and presenting technical solutions. The ideal candidate will have 8+ years of software development experience, 3+ years with Velox, RAPIDS, or similar frameworks, and exceptional C++ skills in design, programming, testing, and debugging. Experience with columnar data processing, SIMD, and vectorization is essential.
Must have:
  • 8+ years software development experience
  • 3+ years with Velox/RAPIDS
  • Exceptional C++ skills
  • Columnar data processing expertise
  • SIMD and vectorization knowledge
  • High-quality distributed systems design
Good to have:
  • Open source big data project committership
  • GPU-accelerated library experience (CUDA, cuBLAS, NCCL, RAPIDS, UCX)
Perks:
  • Competitive salary
  • Comprehensive benefits package

Job Details

We are seeking experienced C++ Software Engineers to join our Spark Acceleration group. Data scientists spend a considerable amount of time exploring data, iterating over machine learning (ML) experiments.  NVIDIA  believes that data science workflows can benefit tremendously from being accelerated, to enable data scientists to explore many more and larger datasets to drive towards their business goals, faster, and more reliably.

You will work with the open source community to accelerate Apache Spark for data science. Apache Spark is the most popular data processing engine in data centers for data science. We aim to dramatically accelerate Apache Spark use cases without application code changes. You will work on open source libraries including Spark-RAPIDS (https://github.com/NVIDIA/spark-rapids), RAPIDS (https://github.com/rapidsai), and Velox (https://github.com/facebookincubator/velox).

What you'll be doing:

  • Design and implement native Spark execution engine using RAPIDS, Velox, UCX and other related libraries. 

  • Design and implement solutions to optimize data exchange between Velox and RAPIDS libraries

  • Enhance Velox OSS library for improved performance and Spark compatibility

  • Contribute to RAPIDS library for large-scale adoptions in major enterprises

  • Conduct performance benchmarking and profiling to achieve speed-of-light performance

  • Working with a team of exceptional engineers including PMC and Committers of Apache Spark, Apache Hadoop, Apache Hive, and Apache Arrow

  • Presenting technical solutions in industry conferences and meetups

What we need to see:

  • BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field 

  • 8+ years of work or research experience in software development

  • 3+ years hands-on development experience with Velox, RAPIDS or similar data processing frameworks in memory management techniques and data serialization

  • Exceptional C++ development experience in design, programming, testing, and debugging  

  • Design and development expertises in columnar data processing with SIMD (Single Instruction, Multiple Data) and vectorization techniques

  • Familiarity with operating systems and software development environments for ARM

  • Proven technical skills in designing and implementing high-quality distributed systems 

  • Able to work successfully with multi-functional teams across organizational boundaries and geographies

  • Highly motivated with strong communication skills

Ways to stand out from the crowd:

  • Committership at major open source big-data projects 

  • Working experience with GPU-accelerated libraries (CUDA, cuBLAS, NCCL, RAPIDS, UCX) 

We are an AA/EEO/Disabled employer and with highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people on the planet working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you.

Similar Jobs

Google - Senior Product Manager, DevOps, Google Cloud

Google

Kirkland, Washington, United States (On-Site)
6 Days ago
Samsung Semiconductor - Staff IT Solution and Database Architect

Samsung Semiconductor

San Jose, California, United States (On-Site)
1 Week ago
GoTo Group - Software Engineer Intern

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
1 Month ago
Hasura - Senior Frontend Engineer - Bengaluru/Hybrid

Hasura

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Netflix - Analytics Engineer 5 - Product

Netflix

Los Angeles, California, United States (On-Site)
1 Week ago
Creative Assembly - Data Engineer

Creative Assembly

England, United Kingdom (Hybrid)
2 Weeks ago
Tencent - Marketing Data Analyst (深圳)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
6 Months ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Azerion - Data Analyst Intern

Azerion

North Holland, Netherlands (Hybrid)
6 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Keen Software House - Senior Render Programmer

Keen Software House

Prague, Prague, Czechia (Remote)
2 Months ago
N-iX - Senior Data Engineer

N-iX

Medellín, Antioquia, Colombia (Flexible)
1 Week ago
PwC - IN-Senior Associate_ML Engineer_Data and Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Rackspace Technology - Site Reliability Engineer III

Rackspace Technology

India (Remote)
1 Month ago
Teravision Games - Lead Programmer

Teravision Games

Bogotá, Bogota, Colombia (Hybrid)
2 Months ago
Rackspace Technology - Frontend Engineer (UX-Focused)

Rackspace Technology

Gurugram, Haryana, India (Remote)
1 Month ago
Zeta - Information Developer

Zeta

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
House of How - Lead Game Engineer - Sweden

House of How

Boden, Norrbotten County, Sweden (On-Site)
5 Months ago
Epic Games - Senior DevOps Programmer

Epic Games

London, England, United Kingdom (On-Site)
2 Months ago
Paytm - DevOps Engineer/Senior DevOps-Paytm Money

Paytm

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Shanghai, Shanghai, China

NVIDIA - Senior DFT Methodology - Data Analytics Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Virtuos - Management Trainee

Virtuos

China (On-Site)
1 Month ago
Google - Senior Account Strategist, Mid-Market Sales

Google

Shenzhen, Guangdong Province, China (On-Site)
6 Days ago
Kaiying Network - Game Publishing Brand/Marketing Planner

Kaiying Network

Shanghai, Shanghai, China (On-Site)
1 Month ago
NVIDIA - Deep Learning Software Engineering Intern, Test Development - 2025

NVIDIA

Shanghai, Shanghai, China (On-Site)
1 Week ago
Tencent - Strategic Investment Manager-Video Games(深圳)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
3 Months ago
NVIDIA - Machine Learning Software Platform Architect

NVIDIA

Shanghai, Shanghai, China (Hybrid)
3 Months ago
Tencent - Game Data Analyst

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago
Tencent - UGC Operation - PUBG Mobile

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
NinjaVan - Sales Manager

NinjaVan

Shenzhen, Guangdong Province, China (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Google - Senior Staff Data Scientist Manager, Research, Search Verticals

Google

San Francisco, California, United States (On-Site)
1 Week ago
Google - Data Engineer, Play Data Science and Analytics

Google

Mountain View, California, United States (On-Site)
1 Week ago
Google - Strategy and Operations Senior Analyst, GCAS GTM

Google

New York, New York, United States (On-Site)
1 Week ago
Mistplay - Senior Data Analyst I, Growth Analytics

Mistplay

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Nagarro - Senior Analyst

Nagarro

Cebu City, Central Visayas, Philippines (On-Site)
6 Months ago
Tesla - Data Analytics Internship

Tesla

North Brabant, Netherlands (On-Site)
2 Months ago
Zazz - Data Engineer

Zazz

(Remote)
3 Months ago
Playrix - Data QA Engineer

Playrix

Portugal (Remote)
6 Months ago
Arrise Solutions (India)   - Data Scientist - Recommender S/m's

Arrise Solutions (India)

Hyderabad, Telangana, India (On-Site)
6 Months ago
Next Level Business Services - Google Analytics

Next Level Business Services

San Antonio, Texas, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug