AI Tooling Engineer

2 Months ago β€’ 5 Years + β€’ Research Development β€’ $150,000 PA - $225,000 PA

Job Summary

Job Description

We are seeking full-stack engineers passionate about AI tooling to join our applied research team. You will build interfaces, pipelines, and services that bring multimodal foundation models into the hands of creators. Responsibilities include developing web-based tools for intuitive model interaction, designing pipelines for model training and inference, and collaborating with research and technical art teams. You'll extend open-source frameworks like ComfyUI for various use cases, contributing to both internal tooling and external features, and supporting productization efforts for multimodal AI applications.
Must have:
  • Build web tools and UIs for advanced model behavior.
  • Design and implement pipelines for model training, fine-tuning, and inference.
  • Collaborate with Research and Technical Art teams.
  • Extend and integrate open-source frameworks like ComfyUI.
  • Contribute to internal experimentation tooling and external features.
  • Support productization of multimodal AI applications.
  • 5+ years of software engineering experience.
  • Strong Python and JavaScript/TypeScript skills.
  • Experience with modern web frameworks (React, Next.js).
  • Familiarity with ML pipelines and GPU compute.
Good to have:
  • Experience with training and deploying models (LoRA, ControlNet, diffusion models).
  • Passion for building usable tools for creative professionals.
  • Experience shipping tools between R&D and production.
  • Experience with LoRA, ControlNet, or real-time AI media generation.
  • Interfaces that helped non-engineers leverage AI creatively.
Perks:
  • Work on frontier multimodal models and build the tools that make them real.
  • Collaborate with an exceptional team of engineers, researchers, and technical artists.
  • Shape the future of human interaction with generative AI.
  • Contribute at the boundary of research, product, and creativity with real user impact.
  • Offers Equity

Job Details

We are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

We're looking for full stack engineers who are passionate about AI tooling, have a strong product sense, and enjoy working at the intersection of research and usability. You'll be part of Luma's applied research team and build interfaces, pipelines, and services that bring the latest model capabilities directly into the hands of creators.

🧠 A Day in the Life

In the morning, you tweak a prototype interface used to test a new spatial-control feature for video generation β€” hooking it into an inference service you helped build last week.

After a quick sync with the Research team, you jump into a session with Technical Art to refine the UI for LoRA training on a stylized dataset.

By afternoon, you’re wiring up a ComfyUI extension to support a new model architecture. You close the day by reviewing feedback from a design partner who used your tool in a client demo.

πŸ”¨ What You’ll Do

  • Build web-based tools and UIs that make advanced model behavior feel intuitive and usable

  • Design and implement pipelines for model training, fine-tuning (e.g., LoRA), and real-time inference

  • Collaborate with Research and Technical Art teams to prototype new workflows grounded in evolving model capabilities

  • Extend and integrate open-source frameworks like ComfyUI to fit internal and client-specific use cases

  • Contribute to both internal experimentation tooling and external-facing production features

  • Support productization efforts for enterprise and B2B applications involving multimodal AI

🧩 You Might Be a Fit If…

  • 5+ years of experience in software engineering, ideally across both backend and frontend systems

  • Strong Python and JavaScript/TypeScript skills; fluency in modern web frameworks (e.g., React, Next.js)

  • Familiarity with ML pipelines and GPU-based compute (e.g., PyTorch, ffmpeg, SLURM/Kubernetes)

  • Experience with training and deploying models (LoRA, ControlNet, diffusion models a plus)

  • Passion for building usable, elegant tools for technical artists, researchers, or creative professionals

  • Bonus: experience shipping tools that sit between R&D and production, or serve external creative clients

πŸ’‘ Bonus Points

  • Experience with LoRA, ControlNet, or real-time AI media generation

  • Tools that shipped between R&D prototypes and production-quality software

  • Interfaces or systems that helped non-engineers leverage AI models creatively

🌍 Why Join our Applied Research team?

  • Work on frontier multimodal models β€” and build the tools that make them real

  • Collaborate with an exceptional team of engineers, researchers, and technical artists

  • Shape the future of how humans interact with generative AI β€” not just inside Luma, but out in the world

  • Contribute at the boundary of research, product, and creativity β€” with real user impact

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Palo Alto, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research Development Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

Palo Alto, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Luma

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug