Research Engineer - Foundation Models

6 Months ago • All levels • Research Development • $150,000 PA - $300,000 PA

Job Summary

Job Description

We are seeking a research engineer with exceptional technical expertise in training Generative AI models. You will join our research team to develop core multimodal foundation models and manage large-scale GPU training runs. Your responsibilities will include leading research in multimodal foundation models, designing and experimenting with novel algorithms and architectures, optimizing model performance for production environments, inspecting and managing large data clusters to identify bottlenecks, and collaborating with cross-functional teams.
Must have:
  • Strong Python and PyTorch engineering skills.
  • Experience building ML models from scratch in PyTorch.
  • Familiarity with generative multimodal models and deep learning.
  • Knowledge of Transformers.
  • Lead research in multimodal foundation models.
  • Optimize model performance for production.
  • Inspect large data clusters for inefficiencies.
Good to have:
  • Familiarity with Linux clusters and scripting.
  • Experience with large distributed systems (>100 GPUs).
Perks:
  • Competitive equity packages in the form of stock options
  • Comprehensive benefits plan

Job Details

We are looking for research engineer with extremely strong technical experience in training Generative AI models. You’ll be part of the research team, helping build our core multimodal foundation models and manage training runs across thousands of GPUs.

Responsibilities

  • Lead and contribute to cutting-edge research in multimodal foundation models

  • Design, develop, and experiment with novel algorithms, architectures, and techniques that enhance the performance, efficiency, and scalability of our AI models.

  • Optimize the performance of models for deployment in production environments, focusing on latency, throughput, and computational efficiency without compromising accuracy or robustness.

  • Inspect and manage large-scale data clusters to find inefficiencies and bottlenecks in model training, and data loading

  • Collaborate with cross-functional teams including data, applied research and infrastructure

Experience

  • Very strong demonstrated engineering ability in Python and Pytorch.

  • Experience building ML models from scratch in Pytorch.

  • Academic or Professional experience with (and understanding of) generative multimodal models such as Diffusion Models and GANs, as well as deep learning concepts such as Transformers.

  • Good to have familiarity with Linux clusters, systems & scripting.

  • Good to have experience working with large distributed systems (>100 GPUs).

Compensation

  • The pay range for this position in California is $180,000 - $250,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan. 

Your application are reviewed by real people.

Similar Jobs

Progress - Product Led Growth Product Manager

Progress

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Months ago
bombit - Game Designer

bombit

Poland (Hybrid)
1 Month ago
Codeway Studios - Product Specialist

Codeway Studios

Istanbul, İstanbul, Türkiye (On-Site)
2 Months ago
Wargaming - Global Payroll Manager

Wargaming

Vilnius, Vilnius County, Lithuania (Hybrid)
3 Weeks ago
Progress - Presales Engineer

Progress

Rotterdam, South Holland, Netherlands (Hybrid)
2 Months ago
PayPal - Machine Learning Engineer

PayPal

San Jose, California, United States (Hybrid)
3 Weeks ago
ISS Stoxx - ESG Research Analyst - Norm-Based Research

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
2 Years ago
Match Group - Senior ML Software Engineering Team Leader

Match Group

Seoul, South Korea (Hybrid)
10 Months ago
PhonePe - Decision Scientist

PhonePe

Bengaluru, Karnataka, India (On-Site)
1 Month ago
gismart - Machine Learning Engineer

gismart

(On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Expedia - Windows Infrastructure Engineer III - Endpoint Management

Expedia

London, England, United Kingdom (On-Site)
2 Months ago
Sword Health - Strategy & Operations Trainee

Sword Health

Portugal (Hybrid)
1 Month ago
WongDoody - Service Design Lead

WongDoody

Pune, Maharashtra, India (On-Site)
3 Months ago
luxsoft - Senior/Lead DevOps Engineer

luxsoft

Gurugram, India (On-Site)
1 Month ago
Arrise Solutions (India)   - Senior Data Scientist (Remote)

Arrise Solutions (India)

Hyderabad, Telangana, India (Remote)
10 Months ago
Matte projects - Senior Experiential Producer

Matte projects

New York, United States (On-Site)
1 Month ago
Side - Project Manager, Video Games.

Side

São Paulo, State Of São Paulo, Brazil (On-Site)
3 Weeks ago
Tesla - Cell Manufacturing Engineering Internship, Roll-to-Roll Equipment

Tesla

Brandenburg, Germany (On-Site)
5 Months ago
IO Interactive - Technical Program Manager

IO Interactive

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Obviously A - Software Engineer (Testing)

Obviously A

Brazil (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Palo Alto, California, United States

Riot Games - Business Systems Analyst II, Finance Technology

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Epic Games - Tech Artist

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Backbone - Senior Consumer Insights Marketing Researcher

Backbone

Atherton, California, United States (Hybrid)
1 Year ago
Vercel - Software Engineer, AI SDK

Vercel

San Francisco, California, United States (Hybrid)
3 Months ago
Tavus - Senior Data Engineer

Tavus

San Francisco, California, United States (Hybrid)
4 Months ago
Jane Street - Experienced Hire Recruiter, Non-Technology

Jane Street

New York, United States (On-Site)
3 Months ago
PayPal - Principal Designer, AI Personalization

PayPal

New York, New York, United States (Hybrid)
2 Months ago
Gloss Genius - Senior Software Engineer, Infrastructure

Gloss Genius

New York, United States (Hybrid)
3 Months ago
whoop - Security Architect

whoop

Boston, Massachusetts, United States (On-Site)
3 Weeks ago
Grammarly - Manager, Commissions

Grammarly

United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

NVIDIA - Research Scientist, Deep Learning and Computer Vision

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
5 Months ago
appier - Senior LLM Scientist

appier

Taipei City, Taiwan (On-Site)
3 Months ago
Capgemini - Machine Learning Engineer

Capgemini

Chennai, Tamil Nadu, India (On-Site)
3 Months ago
C3 IoT - AI Solution Manager/Senior AI Solution Manager (Federal - Intelligence Community)

C3 IoT

Tysons, Virginia, United States (On-Site)
1 Month ago
eBay - Applied Researcher (T24)

eBay

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Ansys - R&D Engineering Manager

Ansys

Cambridge, England, United Kingdom (Hybrid)
2 Months ago
Meta - AI Research Scientist, VLLM (Vision Large Language Models) - Generative AI

Meta

Redmond, Washington, United States (On-Site)
3 Months ago
Pika - Research Engineer (Applied Research)

Pika

Palo Alto, California, United States (On-Site)
4 Months ago
Enverus - Senior Analyst, Research (Intelligence)

Enverus

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
bytedance - Research Engineer / Scientist - Storage for LLM

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Luma

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug