AI Tooling Engineer

Luma AI is seeking a full stack AI Tooling Engineer to join their applied research team. This role involves developing interfaces, pipelines, and services to integrate advanced multimodal foundation model capabilities for creators. The engineer will work at the intersection of research and usability, building web-based tools, designing model training pipelines, and collaborating with research and technical art teams to prototype new workflows. The position requires strong software engineering experience, particularly in Python, JavaScript/TypeScript, and modern web frameworks, with familiarity in ML pipelines and GPU-based compute.

Must Have

• 5+ years of experience in software engineering, ideally across both backend and frontend systems
• Strong Python and JavaScript/TypeScript skills
• Fluency in modern web frameworks (e.g., React, Next.js)
• Familiarity with ML pipelines and GPU-based compute (e.g., PyTorch, ffmpeg, SLURM/Kubernetes)
• Experience with training and deploying models
• Passion for building usable, elegant tools for technical artists, researchers, or creative professionals

Good to Have

• Experience with LoRA, ControlNet, or real-time AI media generation
• Tools that shipped between R&D prototypes and production-quality software
• Interfaces or systems that helped non-engineers leverage AI models creatively

Perks & Benefits

• Work on frontier multimodal models
• Collaborate with an exceptional team of engineers, researchers, and technical artists
• Shape the future of how humans interact with generative AI
• Contribute at the boundary of research, product, and creativity with real user impact

We are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

We're looking for full stack engineers who are passionate about AI tooling, have a strong product sense, and enjoy working at the intersection of research and usability. You'll be part of Luma's applied research team and build interfaces, pipelines, and services that bring the latest model capabilities directly into the hands of creators.

🧠 A Day in the Life

In the morning, you tweak a prototype interface used to test a new spatial-control feature for video generation — hooking it into an inference service you helped build last week.

After a quick sync with the Research team, you jump into a session with Technical Art to refine the UI for LoRA training on a stylized dataset.

By afternoon, you’re wiring up a ComfyUI extension to support a new model architecture. You close the day by reviewing feedback from a design partner who used your tool in a client demo.

🔨 What You’ll Do

• Build web-based tools and UIs that make advanced model behavior feel intuitive and usable
• Design and implement pipelines for model training, fine-tuning (e.g., LoRA), and real-time inference
• Collaborate with Research and Technical Art teams to prototype new workflows grounded in evolving model capabilities
• Extend and integrate open-source frameworks like ComfyUI to fit internal and client-specific use cases
• Contribute to both internal experimentation tooling and external-facing production features
• Support productization efforts for enterprise and B2B applications involving multimodal AI

🧩 You Might Be a Fit If…

• 5+ years of experience in software engineering, ideally across both backend and frontend systems
• Strong Python and JavaScript/TypeScript skills; fluency in modern web frameworks (e.g., React, Next.js)
• Familiarity with ML pipelines and GPU-based compute (e.g., PyTorch, ffmpeg, SLURM/Kubernetes)
• Experience with training and deploying models (LoRA, ControlNet, diffusion models a plus)
• Passion for building usable, elegant tools for technical artists, researchers, or creative professionals
• Bonus: experience shipping tools that sit between R&D and production, or serve external creative clients

💡 Bonus Points

• Experience with LoRA, ControlNet, or real-time AI media generation
• Tools that shipped between R&D prototypes and production-quality software
• Interfaces or systems that helped non-engineers leverage AI models creatively

🌍 Why Join our Applied Research team?

• Work on frontier multimodal models — and build the tools that make them real
• Collaborate with an exceptional team of engineers, researchers, and technical artists
• Shape the future of how humans interact with generative AI — not just inside Luma, but out in the world
• Contribute at the boundary of research, product, and creativity — with real user impact