Research Engineer Internship - Audio Driven Facial Animation

2 Months ago • All levels

Job Summary

Job Description

Flawless, an AI company, is seeking a Research Engineer Intern specializing in Audio Driven Facial Animation for a 3-month contract with a possible extension. The intern will work on challenging problems in deep learning, including audio-driven 3D facial animation, GAN models, speech-based modeling, and multimodal fusion. They will be part of a passionate team tackling cutting-edge research and development. The work environment is based on trust, autonomy, and collaboration, offering a great opportunity to contribute to the company's exciting growth phase. Responsibilities include working with a team of world-class individuals to develop innovative solutions. This is a chance to play a role in shaping the future of a caring, creative, and collaborative company.

Must have:

Masters degree in related field
1-2+ years of experience in Python with deep learning frameworks
Proficiency in math and statistical methods
Experience in audio-visual learning and multimodal fusion
Excellent communication skills for team collaboration

Good to have:

PhD in related field
Research experience and publications in major venues
Experience with speech modeling and synthesis

Perks:

Autonomy
A hybrid working environment
Competitive Salary
Incentivized Stock Options

10 skills required

10 skills required for this role

Add these skills to join the top 1% applicants for this job

tensorflow

seo

computer-vision

deep-learning

python

pytorch

communication

storytelling

real-time-vfx

video-editing

Job Details

"The AI company that's revolutionizing Hollywood"Flawless is shattering the boundaries of traditional filmmaking with its groundbreaking suite of Gen AI film editing tools. Our mission is to empower filmmakers with cutting-edge technology that allows creativity without compromise, expands storytelling possibilities, and delivers unparalleled visual and emotional experiences. We are also setting new standards in ethical AI by creating the Artistic Rights Treasury (A.R.T.), a rights management solution designed to protect artists and rights holders within the Entertainment landscape.

Reports to: Edward Seo - Research Scientist - Audio Driven Facial Animation

What we are looking for: Flawless are looking for a Research Engineer Intern - Audio Driven Facial Animation for a 3 month contract with option to extend. You will be working in an environment based on trust, autonomy and collaboration, and this is a great opportunity for someone who wants to be part of a growing company in its most exciting stage of development. You can play a part in shaping the future of a company that’s caring, creative and collaborative.

As a Research Engineer Intern on the ADFA team at Flawless, you will work with a close-knit, passionate group of world-class individuals tackling some of the most challenging problems in deep learning, including audio-driven 3D facial animation, GAN models for visual speech synthesis, speech-based modeling, multi-modal fusion for audio-visual learning, and a much more.

Our work in automated visual translation is just the beginning, we’re developing countless exciting products based on the application of our proprietary, cornerstone research.

Qualifications

Masters degree - active student or recent graduate researcher in 3D Computer Vision, Speech Synthesis, Computer Graphics, or related field
1-2+ years of experience in Python with proficiency in deep learning frameworks such as PyTorch or Tensorflow
High degree of proficiency in math and statistical methods for signal processing
Experience with to audio-visual learning, multimodal fusion, and/or 3D audio-driven face animation
Outstanding communication skills to collaborate in a team with Scientist, Research/ML Engineers and VFX artists.

Preferred Qualifications

PhD researcher in 3D Computer Vision, Speech Synthesis, Computer Graphics, or related field
Demonstrable research experience with a publication record in major 3D Computer Vision, Speech Processing, and Computer Graphics venues and journals like CVPR, SIGGRAPH, or NeurIPS
Experience with speech modeling and speed synthesis with deep neural networksGenerative and cross-domain attention models for 3D visual speech synthesis applications

Interview Process:

At Flawless, our team and interview process want to help you show your best self. We’ll dive into past projects and simulate working together. Our interview process is four rounds with some casual Zoom (or in-person) coffee in between to get to know each other:

- Recruiting Screen: 30-45 minute call with our recruiting team (We want to discuss your background, interests and motivations as well as the practical details and make sure that Flawless would be a good fit for you)

- Hiring Manager Screen: 45-60 minute zoom interview - you will meet with our VP of Research to discuss your technical expertise.

- Coding Interview: - 60 min live coding test. This will be a technical paired-programming task with one of our science team. This is designed to be an open/pairing type exercise to assess your ability to parse simple requirements, translate those into code, and demonstrate your fluency with hands on coding.

- Domain Depth AI/ML: 60 onsite interview where you will meet 1-2 members of the Applied/Research science teams, through a screen share format talking through experience in deep learning architecture, and machine learning principles.

- Behavioral: 45 Minute Onsite Interview - You will meet with leaders and discuss how you work in startup environments, and communicate and partner with other teams in ever evolving situations. This is where we evaluate communicate, partnerships, and working in ambiguity.

Your recruiter will be your main point of contact and prepare you for interviews. You’ll meet 4 to 6 people from across the business. (We make sure that you have time in each interview to ask them questions). If we don’t give an offer, we’ll provide feedback!

Why work at Flawless? You will be working in an environment based on trust, autonomy and collaboration, and this is a great opportunity for someone who wants to be part of a growing company in its most exciting stage of development. You can play a part in shaping the future of a company that’s caring, creative and collaborative.

In addition to this, you'll also receive:

- Autonomy

- A hybrid working environment

- Competitive Salary

- Incentivized Stock Options

Flawless is proud to emphasize an equal opportunity, safe environment for people to do their best work. We are committed to providing equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.