Machine Learning Software Platform Architect

3 Months ago • 5 Years + • Artificial Intelligence

Job Summary

Job Description

NVIDIA seeks a Machine Learning Software Platform Architect to design, develop, and maintain infrastructure for LLM-based applications in chip design. Responsibilities include managing LLMs, developing applications (like QA bots and code generators), collaborating with hardware designers and LLM researchers, optimizing infrastructure for performance and scalability, and ensuring data security. The ideal candidate possesses 5+ years of experience in AI/ML infrastructure, strong Python and web development skills, and a deep understanding of chip design and LLM techniques.
Must have:
  • 5+ years experience in AI/ML infrastructure (LLMs preferred)
  • Proficiency in Python and web development
  • Understanding of chip design & computational challenges
  • Experience with data management and secure storage
  • Excellent problem-solving skills and teamwork
Good to have:
  • Experience with microservices
  • Cloud/distributed infrastructure background
  • Familiarity with React or Vue.js
  • Understanding of SQL & NoSQL databases
Perks:
  • Highly competitive salaries
  • Comprehensive benefits package

Job Details

Widely considered to be one of the technology world’s most desirable employers, NVIDIA is an industry leader with groundbreaking developments in High-Performance Computing, Artificial Intelligence and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

NVIDIA is seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our growing team. The successful candidate will work at the intersection of GPU chip design and AI, you will be responsible for the design, development, and maintenance of the infrastructure around NVIDIA's internal large language model aimed at facilitating chip design.

What you'll be doing:

  • Develop and maintain the infrastructure for managing large language models (LLMs) based application specifically adapted for the chip design and hardware domain.

  • Develop and maintain LLM based applications to serve hardware engineers, such as LLM based QA bot, code generator etc.

  • Collaborate with HW chip designers and LLM research teams to understand the specific needs and challenges of GPU design and ensure the LLM infrastructure is well-suited to these needs.

  • Collaborate with LLM research teams to collect & organize training / fine-tuning data to train hardware specific language model

  • Optimize the infrastructure for performance, scalability, and reliability, and ensure the secure and efficient management of data.

  • Stay updated with the latest industry trends in AI and machine learning, and continuously look for opportunities to apply these advancements to improve the LLM infrastructure.

What we need to see:

  • 5+ years work experience in developing and maintaining AI or machine learning infrastructure, preferably in the context of large language models.

  • BS in computer science or related or equivalent experience

  • Strong proficiency in Python and web development, and familiarity with LLM related techniques e.g., langchain, vector database, prompt engineering, etc.

  • Understanding of chip design and related computational and data challenges.

  • Experience with data management, including doc cleaning, transformation, and secure storage.

  • Excellent problem-solving skills and the ability to work effectively in a team.

  • In depth understanding of Machine Learning / Deep Learning / NLP concepts.

Ways to stand out from the crowd:

  • You crafted & developed production quality microservices

  • Strong technical background in cloud/distributed infrastructure

  • An excellent plus if you are familiar with front-end development using React or Vue.js

  • Strong understanding of SQL & NoSQL Data platforms.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our exclusive engineering teams are rapidly growing. Are you a creative and passionate about applying Machine Learning to solve remarkably interesting problems? Are you interested in being involved in state-of-the-art development in the field of AI & love a challenge? If so, we want to hear from you!

#LI-Hybrid

Similar Jobs

Microsoft - Senior Software Engineer / Software Engineer - Full Stack

Microsoft

Dublin, County Dublin, Ireland (On-Site)
1 Week ago
Aristocrat Gaming - Front End Developer

Aristocrat Gaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Weeks ago
Velotio Technologies - Senior Engineer (ROR)

Velotio Technologies

Pune, Maharashtra, India (Remote)
1 Month ago
Anthology  Inc  - Platform Engineer II

Anthology Inc

Bogotá, Bogota, Colombia (Remote)
4 Months ago
Netflix - Security Software Engineer 5

Netflix

United States (Remote)
2 Months ago
NVIDIA - Senior Developer Relations Manager - Robotics

NVIDIA

Tokyo, Japan (On-Site)
3 Months ago
Google - Senior Technical Program Manager II, Machine Learning, TPU Systems

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
NVIDIA - AI Computing Software Development Engineer, TensorRT

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
Google - Senior Software Engineer, AI/ML, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Highspot - Principal Frontend Web Engineer

Highspot

Vancouver, British Columbia, Canada (Hybrid)
6 Months ago
Meta - Software Engineer, Front End

Meta

Singapore (On-Site)
5 Months ago
Google - Kaggle Staff Software Engineer, AI/ML

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Flow - Senior/Staff Web Engineer

Flow

New York, New York, United States (Hybrid)
6 Months ago
ByteDance - Tech Lead Manager - Fullstack-Customer Service Platform-SG

ByteDance

Singapore (On-Site)
5 Months ago
Immutable - Senior Software Engineer

Immutable

Australia (Hybrid)
1 Month ago
Netflix - Full-Stack Engineer (L5)

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Numrah - Fullstack Engineer - Automoderation

Numrah

(On-Site)
1 Week ago
Canva - Engineering Manager - (Python/Javascript) - Internal Apps

Canva

Brisbane, Queensland, Australia (Remote)
3 Weeks ago
SmileGate - SRE Platform Front-End Developer

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Shanghai, Shanghai, China

Tencent - Senior Environment Concept Artist

Tencent

Shenzhen, Guangdong Province, China (On-Site)
2 Months ago
Thatgamecompany - Marketing Project Manager - China

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
1 Month ago
Riot Games - Game Designer, Level-Design - R&D

Riot Games

Shanghai, Shanghai, China (On-Site)
1 Month ago
NVIDIA - OEM Account Manager

NVIDIA

Beijing, Beijing, China (On-Site)
1 Week ago
Thatgamecompany - Senior DevOps Engineer (LiveOps)

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
1 Month ago
Microsoft - Digital Solution Area Specialists

Microsoft

Shanghai, Shanghai, China (Hybrid)
1 Day ago
Qingci Games - Animator

Qingci Games

Xiamen, Fujian, China (On-Site)
2 Weeks ago
Paper Games - Animation Internship - Infinite Warmth (NOVA Training Camp)

Paper Games

Shanghai, Shanghai, China (On-Site)
2 Weeks ago
Ourpalm - Legal BP

Ourpalm

Guangzhou, Guangdong Province, China (On-Site)
1 Month ago
Google - Business Development Manager, New Business Sales

Google

Beijing, Beijing, China (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Tencent - UA Manager - AI Integrated

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Tencent - Game AI Product Management Intern

Tencent

Auckland, Auckland, New Zealand (On-Site)
1 Month ago
Google - Cloud Developer II, AI/ML, Professional Services

Google

Atlanta, Georgia, United States (On-Site)
1 Day ago
Google - Senior Technical Solutions Consultant, AI, Customer Experience Suite

Google

Waterloo, Ontario, Canada (On-Site)
1 Week ago
Google - Software Engineer III, Core Machine Learning, Google Cloud

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
DraftKings - Senior Manager, Technical Learning & Development

DraftKings

New York, New York, United States (On-Site)
2 Weeks ago
Microsoft - Member of Technical Staff, High Performance Computing Engineer

Microsoft

Mountain View, California, United States (Hybrid)
2 Weeks ago
PlayStation Global - Senior Director, AI Governance

PlayStation Global

Aliso Viejo, California, United States (Hybrid)
2 Months ago
The Walt Disney Company - Senior Machine Learning Engineer - Ad Platforms

The Walt Disney Company

San Francisco, California, United States (On-Site)
2 Months ago
NVIDIA - Senior High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Massachusetts, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

Texas, United States (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (Hybrid)

Santa Clara, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug