Research Engineer - Audio Driven Facial Animation

2 Months ago • All levels • $175,000 PA - $210,000 PA

Job Summary

Job Description

Flawless is seeking a Research Engineer specializing in Audio Driven Facial Animation. The role involves working on challenging problems in deep learning, including audio-driven 3D facial animation, GAN models for visual speech synthesis, speech-based modeling, and multi-modal fusion for audio-visual learning. The engineer will collaborate with a passionate team, contributing to the development of exciting products based on the company's proprietary research. The company offers a collaborative and creative environment, shaping the future of AI in filmmaking. Responsibilities include deep learning architecture expertise and machine learning principles.

Must have:

Ph.D. or Postdoctoral researcher in relevant field
6+ years of experience in Python and deep learning frameworks
Strong publication record in major 3D Computer Vision venues
Proficiency in math and statistical methods for signal processing
Experience with audio-visual learning and multimodal fusion

Perks:

Autonomy
A hybrid working environment
Competitive Salary
Incentivized Stock Options

10 skills required

10 skills required for this role

Add these skills to join the top 1% applicants for this job

neural-networks

tensorflow

computer-vision

deep-learning

python

pytorch

communication

storytelling

real-time-vfx

video-editing

Job Details

"The AI company that's revolutionizing Hollywood"Flawless is shattering the boundaries of traditional filmmaking with its groundbreaking suite of Gen AI film editing tools. Our mission is to empower filmmakers with cutting-edge technology that allows creativity without compromise, expands storytelling possibilities, and delivers unparalleled visual and emotional experiences. We are also setting new standards in ethical AI by creating the Artistic Rights Treasury (A.R.T.), a rights management solution designed to protect artists and rights holders within the Entertainment landscape.

Reports to: Ari Shapiro - VP of Research

What we are looking for: Flawless are looking for a Research Engineer - Audio Driven Facial Animation. You will be working in an environment based on trust, autonomy and collaboration, and this is a great opportunity for someone who wants to be part of a growing company in its most exciting stage of development. You can play a part in shaping the future of a company that’s caring, creative and collaborative.

As a Research Engineer on the science team at Flawless, you will work with a close-knit, passionate group of world-class individuals tackling some of the most challenging problems in deep learning, including audio-driven 3D facial animation, GAN models for visual speech synthesis, speech-based modeling, multi-modal fusion for audio-visual learning, and a much more.

Our work in automated visual translation is just the beginning, we’re developing countless exciting products based on the application of our proprietary, cornerstone research.

Qualifications

Ph.D. or Postdoctoral researcher in 3D Computer Vision, Speech Synthesis, Computer Graphics, or related field
Demonstrable research experience with a strong publication record in major 3D Computer Vision, Speech Processing, and Computer Graphics venues and journals like CVPR, SIGGRAPH, or NeurIPS
6+ years of experience in Python with proficiency in deep learning frameworks such as PyTorch or Tensorflow
High degree of proficiency in math and statistical methods for signal processing
Experience with to audio-visual learning, multimodal fusion, and/or 3D audio-driven face animation
Outstanding communication skills to collaborate in a team with Scientist, Research/ML Engineers and VFX artists.
Experience with speech modeling and speed synthesis with deep neural networks
Generative and cross-domain attention models for 3D visual speech synthesis applications

$175,000 - $210,000 a year

Interview Process:

At Flawless, our team and interview process want to help you show your best self. We’ll dive into past projects and simulate working together. Our interview process is four rounds with some casual Zoom (or in-person) coffee in between to get to know each other:

- Recruiting Screen: 30-45 minute call with our recruiting team (We want to discuss your background, interests and motivations as well as the practical details and make sure that Flawless would be a good fit for you)

- Hiring Manager Screen: 45-60 minute zoom interview - you will meet with our VP of Research to discuss your technical expertise.

- Coding Interview: - 60 min live coding test. This will be a technical paired-programming task with one of our science team. This is designed to be an open/pairing type exercise to assess your ability to parse simple requirements, translate those into code, and demonstrate your fluency with hands on coding.

- Domain Depth AI/ML: 60 onsite interview where you will meet 1-2 members of the Applied/Research science teams, through a screen share format talking through experience in deep learning architecture, and machine learning principles.

- Reverse System Design: 60 Minute onsite / virtual interview - Use this time to meet Sr Leaders in the Org, sharing a design in depth you have previously built, walking through the challenges and end result.

- Behavioral: 45 Minute Onsite Interview - You will meet with leaders and discuss how you work in startup environments, and communicate and partner with other teams in ever evolving situations. This is where we evaluate communicate, partnerships, and working in ambiguity.

Your recruiter will be your main point of contact and prepare you for interviews. You’ll meet 4 to 6 people from across the business. (We make sure that you have time in each interview to ask them questions). If we don’t give an offer, we’ll provide feedback!

Why work at Flawless? You will be working in an environment based on trust, autonomy and collaboration, and this is a great opportunity for someone who wants to be part of a growing company in its most exciting stage of development. You can play a part in shaping the future of a company that’s caring, creative and collaborative.

In addition to this, you'll also receive:

- Autonomy

- A hybrid working environment

- Competitive Salary

- Incentivized Stock Options

Flawless is proud to emphasize an equal opportunity, safe environment for people to do their best work. We are committed to providing equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.