Outscal Logooutscal logo

Machine Learning Software Platform Architect

1 Month ago • 5 Years + • Artificial Intelligence • $148,000 PA - $356,500 PA

Job Summary

Job Description

NVIDIA seeks a Machine Learning Software Platform Architect to design, develop, and maintain infrastructure for large language model (LLM) applications in chip design. Responsibilities include developing LLM-based applications (e.g., QA bots, code generators), collaborating with hardware engineers and LLM research teams, optimizing infrastructure for performance and scalability, managing data securely, and staying current with AI trends. The role requires expertise in LLM infrastructure, Python, web development, chip design, and data management.
Must have:
  • 5+ years experience in AI/ML infrastructure
  • Proficiency in Python and web development
  • LLM expertise (Langchain, vector databases)
  • Understanding of chip design and data challenges
  • Data management skills (cleaning, transformation, storage)
Good to have:
  • Microservices development experience
  • Cloud/distributed infrastructure expertise
  • React or Vue.js front-end development
  • SQL & NoSQL database knowledge
Perks:
  • Highly competitive salary
  • Comprehensive benefits package
  • Equity

Job Details

Widely considered to be one of the technology world’s most desirable employers, NVIDIA is an industry leader with groundbreaking developments in High-Performance Computing, Artificial Intelligence and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is seeking a highly skilled and experienced Large Language Model (LLM) based Application Infrastructure engineer to join our growing team. The successful candidate will work at the intersection of GPU chip design and AI. You will be responsible for the design, development, and maintenance of the infrastructure around Nvidia's internal large language model aimed at facilitating chip design.

What you'll be doing:

  • Develop and maintain the infrastructure for managing large language models (LLMs) based application specifically adapted for the chip design and hardware domain.

  • Develop and maintain LLM based applications to serve hardware engineers, such as LLM based QA bot, code generator etc.

  • Collaborate with HW chip designers and LLM research teams to understand the specific needs and challenges of GPU design and ensure the LLM infrastructure is well-suited to these needs.

  • Collaborate with LLM research teams to collect & organize training / fine-tuning data to train hardware specific language model

  • Optimize the infrastructure for performance, scalability, and reliability, and ensure the secure and efficient management of data.

  • Stay updated with the latest industry trends in AI and machine learning, and continuously look for opportunities to apply these advancements to improve the LLM infrastructure.

What we need to see:

  • BS in computer science or related or equivalent experience

  • 5+ years experience

  • Experience in developing and maintaining AI or machine learning infrastructure, preferably in the context of large language models.

  • Strong proficiency in Python and web development, and familiarity with LLM related techniques e.g., langchain, vector database, prompt engineering, etc.

  • Understanding of chip design and related computational and data challenges.

  • Experience with data management, including doc cleaning, transformation, and secure storage.

  • Excellent problem-solving skills and the ability to work effectively in a team.

  • In depth understanding of Machine Learning / Deep Learning / NLP concepts.

Ways to stand out from the crowd:

  • You crafted & developed production quality microservices

  • Strong technical background in cloud/distributed infrastructure

  • An excellent plus if you are familiar with front-end development using React or Vue.js

  • Strong understanding of SQL & NoSQL Data platforms.

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most forward-thinking and hardworking people in the world working for us and, due to outstanding growth, our exclusive engineering teams are rapidly growing. Are you a creative and passionate about applying Machine Learning to solve remarkably interesting problems? Are you interested in being involved in state-of-the-art development in the field of AI & love a challenge? If so, we want to hear from you!

The base salary range is 148,000 USD - 356,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

N-iX - Senior .NET Engineer

N-iX

Poland (Remote)
1 Month ago
PlayStation Global - Senior Software Engineer - C++

PlayStation Global

Madison, Wisconsin, United States (Hybrid)
11 Hours ago
Relax Gaming  - Front-End Technical Lead

Relax Gaming

Harju County, Estonia (Hybrid)
4 Weeks ago
ION - Web UI Developer (React), Budapest

ION

Budapest, Hungary (Hybrid)
5 Months ago
Patterned Learning Career - Senior Frontend Engineer

Patterned Learning Career

(Remote)
1 Month ago
Meta - Software Engineer, Systems ML - SW/HW Co-design

Meta

New York, New York, United States (Remote)
4 Months ago
Mashgin - Senior Software Engineer, Machine Learning and Artificial Intelligence

Mashgin

Palo Alto, California, United States (Hybrid)
5 Months ago
Interface AI - Technical Support Engineer L2

Interface AI

India (Remote)
1 Month ago
Passive Logic - AI Control Theory & Optimization Scientist

Passive Logic

Salt Lake City, Utah, United States (On-Site)
3 Months ago
Granicus - Data Scientist 4

Granicus

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Convergint - Frontend/UI Developer

Convergint

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Enphase Energy - Sr. Staff Engineer - Enlighten Cloud Backend

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
ION - Lead UI Developer, New York

ION

New York, New York, United States (Hybrid)
5 Months ago
Fluxon - Staff Software Engineer

Fluxon

Bengaluru, Karnataka, India (Remote)
5 Months ago
Hitachi - Java Developers

Hitachi

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

Singapore, Singapore (On-Site)
4 Months ago
USE Insider - Senior iOS Developer

USE Insider

İstanbul, İstanbul, Türkiye (Remote)
5 Months ago
Rohde & Schwarz - Frontend Developer

Rohde & Schwarz

Bengaluru, Karnataka, India (On-Site)
7 Months ago
CloudHire - Senior Full Stack Architect: Angular & NestJS

CloudHire

Maharashtra, India (Remote)
1 Week ago
NinjaVan - Staff Data Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

Keywords Studios (Player Support) - Tax Analyst

Keywords Studios (Player Support)

Montreal, Quebec, Canada (Remote)
3 Hours ago
Inworld AI - Forward Deployed Engineer - Canada

Inworld AI

Vancouver, British Columbia, Canada (Remote)
5 Months ago
Epic Games - Senior Gameplay Systems Programmer, Unreal Engine

Epic Games

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Next Level Games - Senior Gameplay Animator

Next Level Games

British Columbia, Canada (Hybrid)
2 Months ago
Epic Games - Senior Pipeline Developer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
PwC - Forensic Manager

PwC

Toronto, Ontario, Canada (On-Site)
5 Months ago
DNEG - Pipeline Developer

DNEG

Montreal, Quebec, Canada (Hybrid)
5 Days ago
Behaviour Interactive - Senior Online Programmer - Unannounced IP | Programmeur·euse Senior·e en ligne  - Projet non annoncé

Behaviour Interactive

Montreal, Quebec, Canada (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

The Walt Disney Company - Lead Machine Learning Engineer

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
1 Day ago
PAPAYA - Data Scientist

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
NVIDIA - Senior Technical Instructor - AI and Data Center Infrastructure

NVIDIA

United Kingdom (Remote)
2 Weeks ago
Airlab Inc  - Junior Programmer Artificial Intelligence

Airlab Inc

Quebec, Canada (On-Site)
11 Hours ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Pittsburgh, Pennsylvania, United States (On-Site)
4 Months ago
Keywords Studios (Player Support) - AI - Research Associate (Prompts)

Keywords Studios (Player Support)

Silesian Voivodeship, Poland (On-Site)
1 Week ago
Keywords Studios (Player Support) - Technical Research Associate - AI

Keywords Studios (Player Support)

(Remote)
1 Week ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

San Jose, California, United States (On-Site)
4 Months ago
NVIDIA - System Software Engineering Manager

NVIDIA

Bengaluru, Karnataka, India (On-Site)
8 Hours ago

Get notifed when new similar jobs are uploaded

About The Company

Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.


Hsinchu, Hsinchu City, Taiwan (On-Site)

Yokne'am Illit, North District, Israel (On-Site)

Seoul, South Korea (Hybrid)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Ra'anana, Center District, Israel (On-Site)

Shanghai, Shanghai, China (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Be'er Sheva, South District, Israel (On-Site)

Santa Clara, California, United States (On-Site)

Santa Clara, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by NVIDIA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug