Senior Applied Research Scientist - Foundation Model

5 Months ago • All levels • Research Development • $180,000 PA - $200,000 PA

Job Summary

Job Description

Ambient.ai is seeking a Senior Applied Research Scientist to develop next-generation vision-language models (VLMs) optimized for edge devices in physical security scenarios. The role involves designing, training, and deploying VLMs that understand video, images, and text in real-time, with an emphasis on efficiency, robustness, and real-world performance on resource-constrained edge infrastructure. The scientist will lead full-cycle model development, including pre-training, fine-tuning on image-language data, and applying distillation and compression techniques for deployment. This is a hands-on, cross-functional role impacting threat prevention and false alarm reduction across enterprise environments.
Must have:
  • Develop & Optimize VLMs for Edge devices
  • Own full training pipeline (pre-training & fine-tuning)
  • Apply model compression & optimization techniques
  • Leverage & extend open-source models
  • Collaborate with engineering and product teams
  • Stay current with AI research
  • Ph.D. or Master's in CS, EE, or related field
  • Proficient in Python and deep learning frameworks
  • Hands-on experience with CNNs, Transformers, ViT
  • Strong problem-solving skills
  • Startup experience preferred
Good to have:
  • Experience with foundation or multimodal models
  • Experience with large-scale training pipelines
Perks:
  • Stock options for company ownership
  • Comprehensive health + welfare package
  • Flexible time off
  • Winter Break
  • Latest tech and swag
  • Opportunities to connect with co-workers

Job Details

Who we are:
Ambient.ai is a unified, AI-powered physical security platform helping the world’s leading enterprises reduce risk, improve operational efficiency, and gain critical insights. Seven of the top 10 U.S. technology companies, along with multiple Fortune 500 organizations, rely on Ambient.ai to modernize their physical security infrastructure.

Our platform uses advanced AI and computer vision to seamlessly integrate with existing camera and sensor systems, enabling real-time monitoring and proactive threat detection. By reducing false alarms by over 95%, Ambient.ai allows security teams to focus on real threats and prevent incidents before they occur.

Founded in 2017 and backed by Andreessen Horowitz, Y Combinator, and Allegion Ventures, Ambient.ai is a Series B company on a mission to make every security incident preventable.

We’ve found that in-person time meaningfully supports collaboration, creativity, and team alignment. Our engineering, product, design, and marketing teams work from our Redwood City office 3 days per week. All other Bay Area employees join on Fridays to stay connected and close out the week together.

Ready to learn more? Connect with us on LinkedIn and YouTube

About the role:

Ambient.ai is seeking a Senior Applied Research Scientist to develop next-generation vision-language models optimized for edge devices. For physical security scenarios, you’ll design, train, and deploy VLMs that understand video, images, and text in real time. This role emphasizes efficiency, robustness, and real-world performance on resource-constrained edge infrastructure.

You’ll lead full-cycle model development, from pre-training and fine-tuning on image-language data to applying distillation and compression techniques for deployment. This is a hands-on, cross-functional role in which your work will directly impact our ability to prevent threats and reduce false alarms across enterprise environments.

What you'll do:

  • Develop & Optimize VLMs for Edge: Design and optimize transformer-based vision-language models to understand images and text, ensuring real-time performance on compute-constrained edge devices.

  • Pre-training & Fine-tuning: Own the full training pipeline—from pre-training on image-text data to fine-tuning for Ambient.ai’s physical security use cases (e.g., activity or object recognition from camera feeds).

  • Model Compression & Optimization: Apply techniques like distillation, quantization, and pruning to reduce model size and latency, enabling efficient edge deployment without major accuracy loss.

  • Leverage Open-Source & Innovate: Use and extend state-of-the-art open-source models. Prototype new architectures and training methods to advance Ambient.ai’s multimodal AI research.

  • Cross-Team Collaboration: Work with engineering and product teams to integrate models into the platform. Iterate based on real-world feedback and deployment data to improve performance.

  • Research and Experimentation: Stay current with vision, NLP, and multimodal AI research. Design experiments to test new algorithms and continually enhance our core AI systems.

What you'll bring:

  • Ph.D. or Master’s in CS, EE, or related field, with a strong foundation in AI/ML (Ph.D. preferred or Master’s with strong experience).

  • Proficient in Python and deep learning frameworks like PyTorch or TensorFlow. Comfortable with large-scale training pipelines.

  • Hands-on experience with CNNs, Transformers, and Vision Transformers (ViT). Strong understanding of vision-language models and how to fine-tune or adapt them.

  • Proven skills in model training and optimization, including fine-tuning on large datasets and applying distillation, quantization, or similar techniques. Experience with foundation or multimodal models is a plus.

  • Strong problem-solving ability: quick prototyping, diagnosing failure cases, and iterating on solutions.

  • Startup experience preferred: Comfortable with ambiguity, fast iteration, and owning projects end-to-end.

Salary and Equity:

At Ambient.ai, we take a market-based approach to compensation. Final offers are based on job-related skills, experience, location, and internal equity.

Base salary is just one part of our total rewards package, including stock options and the opportunity to share in the company’s growth.

The starting base salary range for this role in Redwood City: $180,000 - $200,000

Why join us:

  • We are creating an entirely new category within a 180+ billion-dollar physical security industry and looking for team members who are also passionate about our mission to prevent every security incident possible 

  • We partner with an incredible customer roster of F500 companies, including Adobe, TikTok, Gap and SentinelOne

  • Regular Full-time employees receive stock options for the opportunity to share ownership in the success of our company 

  • Comprehensive health + welfare package (Medical, Dental, Vision, Life, EAP, Legal Services, 401k plan)

  • We offer flexible time off to rest and recharge, including Winter Break (time off between Christmas and New Year’s for most roles, depending on customer demand)

  • The latest tech and awesome swag will be delivered to your door

  • Enjoy a full range of opportunities to connect with your awesome co-workers

  • We love to hike, are foodies, and love music! Check out our most recent Ambient Spotify Playlist

#LI-Hybrid

Ambient.ai is proud to be an Equal Opportunity Employer.  Ambient does not unlawfully discriminate on the basis of race, color, religion, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), gender identity, gender expression, national origin, ancestry citizenship, age, physical or mental disability, legally protected medical condition, family care status, military or veteran status, marital status, registered domestic partner status, sexual orientation, genetic information, or any other basis protected by local, state, or federal laws. Ambient is an E-Verify participant.

Similar Jobs

Nice - Senior Services Engineer, GIS

Nice

Pune, Maharashtra, India (Hybrid)
2 Months ago
Canva - Backend Software Engineer - Gen AI, Design Generation Experience

Canva

Melbourne, Victoria, Australia (Remote)
4 Months ago
Nintendo - Specialist Ambassador - Nintendo San Francisco Store

Nintendo

San Francisco, California, United States (On-Site)
9 Months ago
Nice - Office & Events Manager

Nice

Park City, Utah, United States (Hybrid)
1 Month ago
Crunchyroll - Senior Software Engineer - Data

Crunchyroll

Hyderabad, Telangana, India (On-Site)
8 Months ago
Snappr - AI Operations Team Lead

Snappr

Metro Manila, Philippines (On-Site)
1 Year ago
A-Team - Head of AI Revenue & Partnerships

A-Team

New York, United States (Remote)
2 Weeks ago
rivos - Deep Learning Libraries Engineer

rivos

Santa Clara, California, United States (Hybrid)
1 Year ago
Alpha Sense - Senior Software Engineer (AI Applications)

Alpha Sense

Pune, Maharashtra, India (On-Site)
1 Month ago
Scale AI - Machine Learning Research Scientist/ Engineer, Agents

Scale AI

San Francisco, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

WongDoody - PRODUCT SERVICE DESIGNER, TAIWAN

WongDoody

Taipei City, Taiwan (On-Site)
9 Months ago
Tesla - Mechanical Engineer, Technical Services

Tesla

Brandenburg, Germany (On-Site)
6 Months ago
USE Insider - Customer Success Manager - US

USE Insider

United States (On-Site)
9 Months ago
Nice - Workforce Real-Time Analyst

Nice

Manila, Metro Manila, Philippines (Hybrid)
2 Months ago
Visa - Client Care Associate

Visa

Almaty, Almaty Region, Kazakhstan (Hybrid)
3 Months ago
Marsh McLennan - Technical Analyst

Marsh McLennan

Stockholm, Stockholm County, Sweden (Hybrid)
2 Months ago
quience - Retail Facilities & Workplace Manager

quience

San Francisco, California, United States (On-Site)
3 Weeks ago
Thales - Discipline Manager (Functional Engineering Manager)

Thales

Singapore (On-Site)
3 Months ago
Zinnia - Revenue Operations Manager (GTM Systems)

Zinnia

Bridgewater, New Jersey, United States (Hybrid)
1 Month ago
Riot Games - Principal Software Engineer, Backend Architecture

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Redwood City, California, United States

Adobe - Principal Engineering Program Manager

Adobe

San Jose, California, United States (On-Site)
3 Months ago
Axon - Senior Technical Analyst – Revenue & Financial Reporting

Axon

Sterling, Virginia, United States (Hybrid)
1 Month ago
Internet Brands - HR and Recruiting Operations Lead

Internet Brands

El Segundo, California, United States (On-Site)
4 Months ago
Philips - Sales, Territory Manager - Coronary Image-Guided Therapy Devices

Philips

Tucson, Arizona, United States (On-Site)
2 Months ago
Saviynt - Account Executive

Saviynt

Kansas City, Kansas, United States (Remote)
9 Months ago
Jane Street - Alternative Data Researcher, Equities

Jane Street

New York, United States (On-Site)
3 Months ago
Sagecor - Systems Administrator IV

Sagecor

Annapolis Junction, Maryland, United States (On-Site)
2 Years ago
Rippling - Account Executive, Mid Market

Rippling

Austin, Texas, United States (On-Site)
1 Year ago
Infosys - Lead Java Fullstack Developer

Infosys

Charlotte, North Carolina, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

Xsolla - Machine Learning Engineer

Xsolla

Montreal, Quebec, Canada (Remote)
3 Months ago
Dream Sports - Lead ML Scientist

Dream Sports

Mumbai, Maharashtra, India (On-Site)
3 Months ago
ISS Stoxx - ESG Research Analyst - Norm-Based Research

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
2 Years ago
Resemble AI - Deep Learning Speech Researcher

Resemble AI

Mountain View, California, United States (On-Site)
1 Year ago
ALTEN - Stage Innovation: Artificial Intelligence / Simulation Engineer

ALTEN

Toulouse, Occitanie, France (On-Site)
1 Month ago
Ness - AI Enablement Engineer (Microsoft Co-pilot and Power Automate)

Ness

Guadalajara, Jalisco, Mexico (Remote)
1 Month ago
bytedance - Researcher - Interdisciplinary

bytedance

New York, New York, United States (On-Site)
4 Months ago
zipdev - Voice AI Prompt Engineer

zipdev

Mexico (Remote)
1 Month ago
bytedance - Algorithm Optimization Specialist / Machine Learning Engineer- Pico- San Jose

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Nintendo - Intern – Machine Learning Software Engineer (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Texas, United States (On-Site)

Redwood City, California, United States (On-Site)

New York, New York, United States (On-Site)

Redwood City, California, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (On-Site)

Boston, Massachusetts, United States (Remote)

View All Jobs

Get notified when new jobs are added by Ambient.ai

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug