Machine Learning Engineer

2 Months ago • 3 Years + • Research Development • $160,000 PA - $250,000 PA

Job Summary

Job Description

Tavus is seeking a Machine Learning Engineer to develop and optimize their cutting-edge Conversational Video Interface (CVI). This role involves building and enhancing real-time, multimodal AI systems for lifelike digital twins that engage in natural conversations. You will collaborate with cross-functional teams, integrating AI models for avatar rendering, conversational pacing, and visual perception. A key focus is ensuring low-latency performance for natural, real-time interactions and maintaining API infrastructure for seamless integration into client applications. The company is backed by top investors and is focused on creating the future of human-AI interaction.
Must have:
  • Bachelor's or Master's degree in Computer Science or related field
  • 3+ years of experience in software engineering
  • Proficiency in Python, C++, or JavaScript
  • Experience with TensorFlow or PyTorch
  • Familiarity with WebRTC and streaming protocols
  • Experience integrating ML models in production
  • Strong analytical and problem-solving skills
Good to have:
  • Experience with digital avatars
  • Understanding of multilingual support
  • Experience with cloud platforms (AWS, GCP, Azure)
Perks:
  • Flexible work schedule
  • Unlimited Paid Time Off
  • Competitive healthcare
  • Gear stipends
  • Offers Equity

Job Details

About Us

At Tavus, we're building the human layer of AI. Our mission is to make human-AI interaction as natural as face-to-face interaction, enabling the human touch where it has been previously unscalable. We achieve this through pioneering research in multi-modal AI models for human perception and understanding, combined with state-of-the-art human avatar rendering and communication models. Our models power everything from text-to-video AI avatars to real-time conversational video experiences across industries like healthcare, recruiting, sales, education, and more. By enabling AI to see, hear, and communicate with human-like authenticity, we're creating the foundation for the next generation of AI employees, assistants, and companions.

We're a Series A company backed by top investors, including Sequoia, Y Combinator, and Scale VC. Join us in driving the future of human-AI interaction. Check it out for yourself 😎

The Role

As a Machine Learning Engineer at Tavus, you'll be at the forefront of developing our cutting-edge Conversational Video Interface (CVI). This role involves building and optimizing real-time, multimodal AI systems that enable lifelike digital twins to engage in natural conversations. You'll collaborate with cross-functional teams to enhance the CVI's capabilities, ensuring seamless integration of vision, speech, and emotional intelligence components.

Your Mission 🚀

  • Develop and Optimize CVI Components: Design and implement core components of the CVI, including WebRTC/video conferencing, vision processing, speech recognition (ASR), text-to-speech (TTS), and replica video output.

  • Integrate Multimodal AI Models: Work with in-house models like Phoenix-3 for lifelike avatar rendering, Sparrow-0 for conversational pacing, and Raven-0 for visual perception to create cohesive, responsive digital twins.

  • Ensure Low-Latency Performance: Optimize the CVI pipeline to achieve sub-600ms utterance-to-utterance latency, delivering real-time, natural conversations.

  • Collaborate with Cross-Functional Teams: Work closely with AI researchers, product managers, and UX designers to align technical development with user needs and product goals.

  • Maintain and Enhance API Infrastructure: Develop and maintain APIs that allow developers to easily integrate Tavus's CVI into their applications, ensuring scalability and reliability.

Requirements

  • Educational Background: Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.

  • Technical Experience: 3+ years of experience in software engineering, with a focus on real-time systems, multimedia processing, or AI integration.

  • Programming Skills: Proficiency in languages such as Python, C++, or JavaScript, and experience with frameworks like TensorFlow or PyTorch.

  • Knowledge of Multimedia Protocols: Familiarity with WebRTC, streaming protocols, and video/audio processing techniques.

  • AI Integration: Experience integrating machine learning models into production systems, particularly in areas related to speech, vision, or natural language processing.

  • Problem-Solving Abilities: Strong analytical skills and the ability to troubleshoot complex systems.

Bonus if you have:

  • Experience with Digital Avatars: Background in developing or working with digital human representations or avatars.

  • Multilingual Support: Understanding of building systems that support multiple languages and cultural nuances.

  • Cloud Infrastructure: Experience with deploying and managing applications on cloud platforms like AWS, GCP, or Azure.

Benefits

When you join Tavus, you’re joining a family. Our work is driven by our team, and our success is shared by all. This position has a flexible work schedule, unlimited PTO, competitive healthcare and gear stipends, as well as, of course, plenty of fun! At the end of the day, we want Tavus to be a place for you to learn, directly drive impact, and be with a team you love.

To learn more about our team culture, and benefits, check out our hiring page!

Tavus is growing fast, and we’d like you to grow with us! Are you excited to get your hands dirty? Drop your resume and we’ll be in touch!

We are not looking for cultural fits, we are looking for culture creators. In fact, diversity is what drives our success – it’s at the core of how we hire, communicate, and work. We are inclusive to all and combine our diverse backgrounds, skill sets, and thinking to build the best experiences for our clients.

Similar Jobs

Single Store - Senior/Staff Product Manager, Cloud Security

Single Store

Pune, Maharashtra, India (On-Site)
3 Months ago
Philips - Head of Digital Strategy

Philips

Cambridge, Massachusetts, United States (On-Site)
2 Months ago
Workato - Group Product Manager (Agent Frameworks)

Workato

London, England, United Kingdom (On-Site)
4 Weeks ago
bytedance - Music Product Counsel - Global Legal

bytedance

San Jose, California, United States (On-Site)
9 Months ago
Riot Games - Principal Publishing Product Manager, WildRift KR

Riot Games

Seoul, South Korea (On-Site)
2 Months ago
Egnyte - Sr Software Engineer - AI

Egnyte

India (Remote)
9 Months ago
Notion - User Researcher

Notion

New York, United States (On-Site)
1 Month ago
Apple - Senior Applied ML Engineer, Wallet & Payments

Apple

New York, New York, United States (On-Site)
1 Month ago
Mistral AI - AI Scientist

Mistral AI

Palo Alto, California, United States (Remote)
1 Year ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Miro - Enterprise Customer Success Manager

Miro

Austin, Texas, United States (On-Site)
2 Weeks ago
smarsh - Product Security Engineer – Lead

smarsh

United Kingdom (Remote)
3 Weeks ago
zeta - Software Development Engineer II Backend (orchestra)

zeta

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Realworld one - Senior Account Manager

Realworld one

Freiburg, Lower Saxony, Germany (On-Site)
9 Months ago
Scopely - Technical Lead of Analytics Engineering

Scopely

Barcelona, Catalonia, Spain (Hybrid)
8 Months ago
JDA - Director Solutions Marketing – Government

JDA

Boston, Massachusetts, United States (Remote)
1 Year ago
Unity - Senior Technical Recruiter

Unity

Montreal, Quebec, Canada (On-Site)
3 Months ago
Capgemini - Treasurer Data

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Luxoft - Partnerships and Customer Success Lead

Luxoft

(Remote)
8 Months ago
Blinkhealth - Patient Care Coordinator

Blinkhealth

Pittsburgh, Pennsylvania, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Opendoor - Director, Total Rewards

Opendoor

San Francisco, California, United States (Hybrid)
1 Month ago
Nagarro - Senior Staff Engineer / Reltio MDM Developer

Nagarro

Atlanta, Georgia, United States (Hybrid)
3 Weeks ago
Patreon - Staff Product Designer, Podcast Tools

Patreon

San Francisco, California, United States (Hybrid)
4 Months ago
LegalZoom - Sales Enablement Specialist

LegalZoom

Las Vegas, Nevada, United States (On-Site)
3 Weeks ago
Sailpoint - AVP, Enterprise West

Sailpoint

California, United States (Remote)
2 Months ago
Jane Street - VDI Engineer

Jane Street

New York, United States (On-Site)
2 Months ago
Apple - Principal Research Scientist

Apple

Cupertino, California, United States (On-Site)
2 Months ago
OKX - Associate General Counsel, U.S. Licensing Maintenance

OKX

New York, United States (Hybrid)
3 Weeks ago
DataVisor - Director of Strategic Accounts - US Eastern Region

DataVisor

United States (Remote)
2 Months ago
Roblox - Senior / Principal Inference Engineer - ML Platform

Roblox

San Mateo, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Match Group - Software Engineer III, Machine Learning Trust and Safety

Match Group

Palo Alto, California, United States (Hybrid)
3 Months ago
CyberArk - Dev AI Transformation Lead

CyberArk

Israel (Hybrid)
2 Months ago
Krafton - Research Scientist - GenAI (5+ years)

Krafton

Seoul, South Korea (On-Site)
3 Weeks ago
Apple - AIML - Machine Learning Engineer, Answers, Knowledge & Intelligence (AKI)

Apple

Santa Clara, California, United States (On-Site)
1 Month ago
Stylumia - Senior Machine Learning Engineer - Time Series & Computer Vision

Stylumia

Bengaluru, Karnataka, India (Hybrid)
11 Months ago
flip fit - Machine Learning Engineer

flip fit

(Remote)
7 Months ago
zoox - Senior AI Developer Productivity Engineer

zoox

Foster City, California, United States (On-Site)
6 Months ago
bytedance - Machine Learning Engineer - MLDev

bytedance

San Jose, California, United States (On-Site)
4 Months ago
Apple - Machine Learning Engineering Manager (Computer Vision)

Apple

Seattle, Washington, United States (On-Site)
3 Months ago
Globalization Partners - Senior AI Engineer

Globalization Partners

(Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Remote)

San Francisco, California, United States (Remote)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Tavus

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug