AI Research Scientist/Engineer Multimodal VLM and MLLM

13 Minutes ago • 5 Years +

Research Development

Job Description

As an AI Research Scientist at Autodesk Research, you will conduct fundamental and applied research to help customers imagine, design, and make a better world. The team works on projects spanning learning-based design systems, computer vision, graphics, robotics, human-computer interaction, sustainability, simulation, manufacturing, architectural design, and construction. This role involves developing new ML models and AI techniques, leading research projects, reviewing literature, and exploring new data sources.

Good To Have:

Significant post-graduate research experience, or five or more years of work experience
Experience with foundation and open-source models, meta/transfer learning, fine-tuning, distillation, multi-task/continual learning, RL, RLxF, and/or image/audio/video/3D generation/understanding
Experience or familiarity with 3D Graphics/Animation, Manufacturing, Engineering, Architecture, and/or Construction domain

Must Have:

Master's or PhD in AI/ML related fields (Computer Science, Mathematics, Statistics, Physics, Linguistics, Mechanical Engineering, etc.)
Strong background in applying Deep Learning techniques (custom architectures, model optimization, novel loss functions, production-ready solutions)
Familiarity with statistical methods for Machine Learning (Bayesian methods, HMMs, graphical models, etc.)
Familiarity with PyTorch, PyTorch Lightning, or similar frameworks
Strong coding abilities in Python
Strong Software development skills and familiarity with GPUs, MLOps, Git, large-scale ML systems
Experience with Transformers, LLMs, NLP, Multi-modal Deep Learning, and VLMs/MLLMs
Publication track record in machine learning conferences and/or journals

Add these skills to join the top 1% applicants for this job

github

unity

game-texts

pytorch

transfer-learning

deep-learning

computer-vision

git

python

autodesk

machine-learning

AI Research Scientist/Engineer (Multimodal)

Position Overview

As an AI Research Scientist at Autodesk Research, you will be doing fundamental and applied research that will help our customers imagine, design, and make a better world.

We are a team of scientists, researchers, engineers, and designers working together on projects that range from learning-based design systems, computer vision, graphics, robotics, human-computer interaction, sustainability, simulation, manufacturing, architectural design and construction.

This role will report to a Research Manager in the AI Lab.

Location: UK/EMEA, US or Canada Remote or Hybrid

Responsibilities

Develop new ML models and AI techniques
Lead on research projects within a global team
Review relevant AI/ML literature to identify emerging methods, technologies, and best practices.
Explore new data sources and discover techniques for best leveraging data

Minimum Qualifications

A Master's or PhD in a field related to AI/ML, such as: Computer Science, Mathematics, Statistics, Physics, Linguistics, Mechanical Engineering, or related disciplines
Strong background applying Deep Learning techniques (including implementing custom architectures, optimizing model performance, developing novel loss functions, metrics, and benchmarks, and deploying production-ready solutions)
Familiarity in statistical methods for Machine Learning (e.g. Bayesian methods, HMMs, graphical models, dimension reduction, clustering, classification, regression techniques, etc.)
Familiarity with PyTorch, PyTorch Lightning, or similar frameworks
Strong coding abilities in Python
Strong Software development skills and familiarity with GPUs, MLOps, Git, High-performance large-scale ML systems and platforms.
Experience with Transformers, LLMs, NLP, Multi-modal Deep Learning, and VLMs/MLLMs
Publication track record in machine learning conferences and/or journals

Preferred Qualifications

Significant post-graduate research experience, or five or more years of work experience (actual job title/position will be commensurate with experience)
Experience with foundation and open-source models, meta/transfer learning, fine-tuning, distillation, multi-task/continual learning, RL, RLxF, and/or image/audio/video/3D generation/understanding
Experience or familiarity with the 3D Graphics/Animation, Manufacturing, Engineering, Architecture, and/or Construction domain.

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers

Shape the world, shape your future

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!