Research Engineer — 3D Reconstruction and Rendering

1 Month ago • All levels • 3D Art • $175,000 PA - $280,000 PA

Job Summary

Job Description

Sesame is building lifelike computers that can see, hear, and collaborate naturally. They are seeking a Research Engineer focused on 3D Reconstruction and Rendering to create photorealistic digital twins of facial regions. This role is crucial for advancing their conversational AI by bridging speech with the physical world. The engineer will work with founders and leaders from major tech companies, specializing in both classical techniques like multiview geometry and photogrammetry, and modern machine learning tools such as neural rendering. Responsibilities include designing capture systems, developing reconstruction pipelines, implementing rendering algorithms, building end-to-end systems, and inventing new approaches to facial reconstruction and appearance modeling.
Must have:
  • Experience with 3D reconstruction, rendering, or appearance modeling
  • Understanding of multiview geometry, camera calibration, and light transport
  • Ability to navigate high-ambiguity problem spaces
  • Familiarity with large-scale datasets
  • Excellent communication and collaboration skills
  • Bachelor's degree in a relevant field
Good to have:
  • Master's or Ph.D. in a relevant discipline
  • Experience with neural rendering models (NeRF, etc.)
  • Proficiency in PyTorch or JAX
Perks:
  • 401k matching
  • 100% employer-paid health, vision, and dental benefits
  • Unlimited PTO and sick time
  • Flexible spending account matching (medical FSA)

Job Details

About Sesame

Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice companions part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive.

About the Role

Vision understanding is a critical addition to conversational AI, bridging the gap between speech and the physical world. We‘re looking for a skilled engineer or researcher to build photorealistic digital twins of the facial region, serving as a foundational layer in our vision development infrastructure. The ideal candidate will be fluent in classical techniques—such as multiview geometry, photogrammetry, and reflectance modeling—while also comfortable leveraging modern machine learning tools, from fine-tuning neural rendering models to integrating off-the-shelf pipelines. You’ll collaborate with research, hardware, and product teams to build high-fidelity capture and rendering systems that combine physical accuracy with visual realism.

Responsibilities:

  • Collaborate with hardware and optics teams to design and operate facial capture systems (e.g., light stages, multi-camera rigs).

  • Develop offline reconstruction pipelines using captured data that produce subject-specific digital twins with high geometric and photometric fidelity.

  • Implement algorithms to render individuals under novel viewpoints, lighting conditions, and facial configurations using dense multiview data.

  • Build end-to-end systems—from capture and calibration to data curation, rendering evaluations, and deployment.

  • Evaluate existing techniques from graphics, vision, and ML literature; prototype and adapt them to meet our unique objectives.

  • Where needed, invent new approaches that push the boundaries of facial reconstruction and appearance modeling.

Required Qualifications:

  • Demonstrated experience with 3D reconstruction, photorealistic rendering, or appearance modeling from captured data.

  • Strong understanding of multiview geometry, camera calibration, and physical light transport.

  • Ability to navigate and deliver results in high-ambiguity, open-ended problem spaces.

  • Familiarity with large-scale dataset handling, including multi-camera datasets.

  • Excellent communication skills and the ability to work collaboratively across disciplines.

  • Bachelor’s degree or higher in computer graphics, vision, imaging, machine learning, or a related field.

Preferred Qualifications:

  • Master’s or Ph.D. in a relevant discipline.

  • Hands-on experience training or adapting neural rendering models (e.g., NeRF, relighting networks, inverse rendering).

  • Proficiency in PyTorch, JAX, or other modern ML frameworks.

Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities—contact careers@sesame.com for assistance.

Full-time Employee Benefits: 

  • 401k matching

  • 100% employer-paid health, vision, and dental benefits 

  • Unlimited PTO and sick time 

  • Flexible spending account matching (medical FSA) 

Benefits do not apply to contingent/contract workers

Similar Jobs

QuinStreet - Mid UI Developer (Contractor - 12 months)

QuinStreet

Pune, Maharashtra, India (Remote)
1 Month ago
Site Core - License Compliance Manager

Site Core

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Weeks ago
Qualcomm - Sr Lead Engineer - DFT

Qualcomm

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Solace - Product Designer

Solace

United States (Remote)
2 Months ago
Moloco - Agency Senior Growth Manager

Moloco

London, England, United Kingdom (On-Site)
3 Months ago
two point studios  - Senior 3D Artist

two point studios

Farnham, England, United Kingdom (Hybrid)
4 Months ago
Sperasoft - 3D Hard-surface Artist (Stylization)

Sperasoft

Yerevan, Yerevan, Armenia (On-Site)
2 Months ago
gyb games - Senior 3D Artist

gyb games

Istanbul, İstanbul, Türkiye (On-Site)
3 Months ago
EFinancialCareers - Freelance 3D Artist for Anime-Inspired Avatars

EFinancialCareers

Metro Manila, Philippines (On-Site)
1 Year ago
Beresnev Games - 3D Generalist

Beresnev Games

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

oportun - Senior Software Engineer -R12814

oportun

India (Remote)
3 Weeks ago
Sonar Source - Engineering Director

Sonar Source

Geneva, Geneva, Switzerland (On-Site)
6 Months ago
2K - Staff Applied Scientist - Economy

2K

Novato, California, United States (Hybrid)
1 Month ago
lifechruh - Director of Church Generosity

lifechruh

Edmond, Oklahoma, United States (On-Site)
3 Months ago
The Globel Talent Co - Senior Photo Retoucher - Fashion

The Globel Talent Co

Cape Town, Western Cape, South Africa (Remote)
4 Months ago
zeta - Site Delivery Manager / Site Lead

zeta

Hyderabad, Telangana, India (On-Site)
7 Months ago
NinjaVan - Intern, Human Resources

NinjaVan

Subang Jaya, Selangor, Malaysia (On-Site)
10 Months ago
Ion - Application Support Analyst

Ion

Milan, Lombardy, Italy (Hybrid)
10 Months ago
eBay - Watch maker

eBay

Moonachie, New Jersey, United States (On-Site)
2 Months ago
Universal Music Group - Director, Sales Operations

Universal Music Group

Santa Monica, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

zoox - Machine Learning Engineer, 3D Simulation

zoox

Foster City, California, United States (Hybrid)
2 Weeks ago
Spaulding Ridge - Business Development Representative

Spaulding Ridge

Chicago, Illinois, United States (Hybrid)
2 Weeks ago
Gupta Media - Media Analyst

Gupta Media

Boston, Massachusetts, United States (On-Site)
3 Months ago
Microsoft - Senior Applied Scientist

Microsoft

Redmond, Washington, United States (On-Site)
3 Months ago
Pinterest - Sr. Employee Relations Specialist

Pinterest

San Francisco, California, United States (Remote)
3 Weeks ago
UPF Industries  - Automotive Packaging Engineer - Metal

UPF Industries

Newnan, Georgia, United States (On-Site)
3 Months ago
Tekion Corp - Senior Manager of Data, ML, and AI Product Management

Tekion Corp

Pleasanton, California, United States (On-Site)
5 Months ago
Lambda - Senior HPC Systems Architect

Lambda

San Jose, California, United States (Hybrid)
1 Month ago
smarsh - Executive Assistant

smarsh

Boca Raton, Florida, United States (On-Site)
1 Month ago
Saronic Technologies - Material Lab Inspector

Saronic Technologies

Austin, Texas, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

3D Art Jobs

Osome studios - 3D Artist Intern

Osome studios

Lyon, Auvergne-Rhône-Alpes, France (On-Site)
1 Month ago
kooapps - 3D Artist OJT

kooapps

Makati City, Metro Manila, Philippines (On-Site)
1 Year ago
Humanitarian Operations - 3D Artist Intern

Humanitarian Operations

Edinburgh, Scotland, United Kingdom (On-Site)
3 Weeks ago
Poly Slash  - 3D Game Designer/Modeler

Poly Slash

Lahore, Punjab, Pakistan (On-Site)
3 Months ago
Playgendary - 3D Generalist (Casual)

Playgendary

Limassol, Limassol, Cyprus (Remote)
6 Months ago
Critical mass - Senior Product Engineer - 3D

Critical mass

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Entlgd  - Lead 3D Foliage Artist

Entlgd

Yerevan, Yerevan, Armenia (Hybrid)
3 Months ago
Critical mass - Senior Product Engineer - 3D

Critical mass

Chicago, Illinois, United States (On-Site)
1 Month ago
Unada labs - 3D Visualizer

Unada labs

Ahmedabad, Gujarat, India (On-Site)
5 Months ago
mad over games - Unity 3D Developer

mad over games

San Jose, California, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Sesame

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug