Distinguished Engineer (Technical Director)/Senior Principal Engineer - Roblox AI Assistant

1 Month ago • 15 Years + • Research Development • $372,940 PA - $448,990 PA

Job Summary

Job Description

Roblox is seeking an exceptional Director-level technical engineering lead to push the boundaries of AI-assisted game development. The core problem is specializing foundation models, particularly for generating high-quality, context-aware Lua code within the Roblox engine. This involves adapting frontier LLMs to the intricacies of Lua, transforming vast amounts of code into high-signal training data for fine-tuning and evaluation, moving beyond simple instruction following to genuine reasoning and problem-solving for complex coding tasks, and establishing rigorous evaluation methodologies. The role requires deep expertise in LLM post-training techniques like SFT, RLHF, and DPO, a proven track record of significantly improving model capabilities, strong technical and hands-on skills, and a rigorous approach to data quality and curation.
Must have:
  • Obsessed with LLM post-training loop (SFT, RLHF, DPO, data curation, evaluation)
  • Proven track record improving LLM capabilities in specialized domains
  • Deeply technical and hands-on with LLM mechanics
  • Rigorous about data quality and effective curation
  • 15+ years of experience with deep expertise in LLM post-training
  • Fluent in ML frameworks (PyTorch) and data processing tools (PySpark)
Good to have:
  • Experience in code generation specialization
  • Experience designing and scaling data annotation efforts
  • MS/PhD in CS, ML, or related quantitative field
Perks:
  • Unmatched Scale & Impact
  • Unique Dataset & Domain
  • Focused Challenge
  • Equity compensation
  • Benefits

Job Details

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. 

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. 

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

At Roblox, we're on a mission to empower all the creators of the world to build and share amazing immersive experiences. As a member of the Roblox Studio team, you’ll be working on the most popular tool for game development in the world on a platform with over 80M daily active users. Our Studio team is seeking an exceptional Director-level technical engineering lead to push the boundaries of AI-assisted game development.

The Core Problem:

Foundation models are powerful generalists, but unlocking their true potential requires deep specialization. At Roblox, we're building an AI Assistant to fundamentally change how millions of creators build immersive experiences. A critical component is generating high-quality, context-aware Lua code. This isn't about simple boilerplate; it's about understanding user intent, the nuances of the Roblox API, and the structure of complex game logic. Making a large language model genuinely useful – truly assistive – for programming in a specific, massive ecosystem like Roblox is a frontier challenge in applied AI.

As a Technical Director (IC role) for Roblox Assistant, you’ll own the overall technical vision for machine learning initiatives toward a future where the highest quality games can be created dramatically faster than is possible today and the strategy and execution for specializing our LLMs for code generation via post-training.

What We Need to Solve:

  • Deep Specialization: How do we effectively adapt frontier LLMs to master the intricacies of Lua within the Roblox engine? 
  • Data is King (and Hard): We have vast amounts of code, but transforming it into high-signal training data for SFT, preference tuning (RLHF, DPO, etc.), and robust evaluation is a complex machine learning and engineering challenge. We need to pioneer sophisticated quality signals and data mixing strategies.
  • Beyond Instruction Following: Moving past simple prompt-response towards genuine reasoning and problem-solving for complex coding tasks. How do we improve the model's ability to handle ambiguity, plan multi-step and multi-file code generation, and debug?
  • Rigorous Evaluation: Defining and implementing meaningful evaluations that capture true coding utility, beyond surface-level metrics.

You Have:

We need someone who lives and breathes improving LLM output quality, specifically for pushing performance in challenging, specialized domains.

  • You are obsessed with the post-training loop: You have deep, hands-on experience and intuition for techniques like Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), Direct Preference Optimization (DPO), data curation/mixology, and building robust evaluation suites. You understand the subtle interplay between data quality, model scale, and tuning strategies.
  • You have competed and won at the highest levels: You have a proven track record of taking state-of-the-art foundation models and significantly improving their capabilities on specific, difficult tasks – ideally code generation, but deep expertise demonstrated in any complex domain (e.g., mathematics, reasoning, native multimodal output, complex instruction following) is highly relevant. You've likely led teams of 25+ engineers pushing benchmark performance at leading AI labs or internal efforts within major tech companies.
  • You are deeply technical and hands-on: While you will lead technical direction, you aren't afraid to dive into the weeds to diagnose tricky model behavior, analyze failure modes, or prototype new data processing techniques. You understand the mechanics, not just the concepts.
  • You think rigorously about data: You appreciate that progress is often gated by data quality and effective curation. You have experience designing and scaling data annotation efforts and developing signals to identify high-quality data for specialized domains.
  • Qualifications: A strong academic background (MS/PhD preferred) in CS, ML, or a related quantitative field.
    • Proven track record with 15+ years of experience including deep expertise in frontier LLM post-training .
    • Fluent in ML frameworks (like PyTorch) and data processing tools (like PySpark).

You Will:

  • Define and drive the technical roadmap for improving Roblox Assistant's code generation and reasoning capabilities through advanced LLM post-training.
  • Lead the design and execution of experiments in fine-tuning, preference alignment, and data strategy.
  • Establish rigorous evaluation methodologies to measure true progress in coding assistance.
  • Work closely with ML engineers, providing technical guidance and mentorship focused specifically on model improvement techniques.
  • Stay at the absolute forefront of LLM research and apply relevant advancements to our specific challenges.
  • Contribute to the core intellectual challenges of making AI a powerful, reliable tool for millions of software creators.

Why Roblox?

  • Unmatched Scale & Impact: Directly influence how millions of creators build on a platform with 80M+ daily active users.
  • Unique Dataset & Domain: Access to a massive, unique corpus of Lua code, creator interactions, and 3D environment context – an incredible sandbox for specializing models.
  • Focused Challenge: A chance to dedicate your expertise to solving a critical, concrete problem in AI-assisted creation at the cutting edge.

If you are deeply passionate about pushing the boundaries of LLM capabilities for game development and want to apply your skills to redefine coding assistance for a massive creative community, we encourage you to apply.

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range
$372,940$448,990 USD

Roles that are based in our San Mateo, CA Headquarters are in-office Tuesday, Wednesday, and Thursday, with optional in-office on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations for all candidates during the interview process.

Similar Jobs

Qualcomm - Machine Learning Software Engineer

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Rivian - Staff Software Engineer, ML Training and Inference Infrastructure

Rivian

London, England, United Kingdom (On-Site)
1 Month ago
Thales - Quantum-AI Research Scientist

Thales

Montreal, Quebec, Canada (On-Site)
2 Months ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
8 Months ago
Salesforce - Principal Technical Architect

Salesforce

Singapore (Hybrid)
1 Month ago
Hedra - Research Engineer

Hedra

San Francisco, California, United States (On-Site)
3 Months ago
Qualcomm - Engineer - AI Orchestration

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
studio Frog  - Senior Machine Learning Engineer

studio Frog

Ontario, Canada (On-Site)
3 Weeks ago
Digital extremes - AI Programmer

Digital extremes

London, Ontario, Canada (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PayPal - Senior AI Machine Learning Engineer

PayPal

San Jose, California, United States (Hybrid)
1 Month ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
11 Months ago
NVIDIA - Senior High-Performance LLM Training Engineer

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago
Google - Senior ML Systems Engineer, AICore

Google

Taipei City, Taiwan (On-Site)
2 Months ago
Reddit - Machine Learning Engineer, Search (multiple levels)

Reddit

United States (Remote)
2 Months ago
NVIDIA - Senior Software Engineer, PyTorch - Deep Learning

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago
Krafton - Deep Learning Engineer - LLM Game Agent

Krafton

Seoul, South Korea (On-Site)
5 Months ago
bytedance - Research Scientist in Multimodal Graduate (Applied Machine Learning) - 2024 Start (PhD)

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Apple - AIML - Machine Learning Engineer, Answers, Knowledge & Intelligence (AKI)

Apple

Santa Clara, California, United States (On-Site)
3 Weeks ago
Electronic Arts - Data Scientist - NLP

Electronic Arts

Madrid, Community Of Madrid, Spain (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Mateo, California, United States

Apple - Location Software Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Sony Pictures Entertainment - Analyst, Production Finance Systems

Sony Pictures Entertainment

Culver City, California, United States (On-Site)
1 Month ago
rivos - Silicon Verification - Intern

rivos

Santa Clara, California, United States (On-Site)
9 Months ago
WebTech Corporation - Director, Tax Accounting

WebTech Corporation

Pittsburgh, Pennsylvania, United States (On-Site)
2 Months ago
Trek - Future Store Manager

Trek

Tacoma, Washington, United States (On-Site)
5 Months ago
NVIDIA - HPC Operations Manager - Hardware Engineering

NVIDIA

Austin, Texas, United States (On-Site)
4 Months ago
Next Level Business Services - SAP OER Project Manager

Next Level Business Services

Redmond, Washington, United States (On-Site)
9 Months ago
Toast - Territory Account Executive

Toast

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Riot Games - Staff Software Engineer - UnEco

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
bytedance - Backend Software Engineer

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

ShyftLabs - AI Engineer

ShyftLabs

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Morning Star - Analyst, Manager Research

Morning Star

Tokyo, Japan (Hybrid)
1 Month ago
Thumbtack - Staff Experience Researcher

Thumbtack

United States (Remote)
1 Month ago
Keywords International - Technical Research Associate - AI

Keywords International

San Francisco, California, United States (Remote)
3 Months ago
Apple - Manager, ML Data Operations

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Reddit - Machine Learning Manager - Ads Engagement Modeling

Reddit

United States (Remote)
1 Month ago
Synechron - Senior AIML Engineer

Synechron

Pune, Maharashtra, India (On-Site)
1 Month ago
zoox - Principal Machine Learning Engineer

zoox

Foster City, California, United States (On-Site)
8 Months ago
ISS Stoxx - Research Analyst (Financial Services)

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
2 Months ago
Capgemini - Gen AI Professional

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Mateo, California, United States (On-Site)

Washington, District Of Columbia, United States (Hybrid)

San Mateo, California, United States (On-Site)

San Mateo, California, United States (Hybrid)

San Mateo, California, United States (On-Site)

Gurugram, Haryana, India (Hybrid)

San Mateo, California, United States (On-Site)

San Mateo, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Roblox

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug