Applied Scientist Intern (Audio Language Modeling)

3 Weeks ago • All levels • Audio • $60,000 PA - $96,000 PA

Job Summary

Job Description

Reality Defender is seeking an Applied Scientist Intern specializing in Audio Language Modeling. The intern will explore and conceptualize novel methods for deepfake detection and audio understanding using various modalities like speech and text. Responsibilities include performing fundamental and applied research to advance audio deepfake detection, building generalized models, collaborating with scientists and engineers, and summarizing, publishing, and presenting research findings. The ideal candidate is pursuing a PhD in machine learning, deep learning, natural language processing, or speech processing, with at least 2 years of experience in training/fine-tuning large models, particularly audio language models, speech foundation models, and multi-modal foundation models. Experience with end-to-end ML model building pipelines and distributed multi-GPU training is also required. Prior publications in reputable ML/Audio/NLP research venues are a plus.
Must have:
  • PhD program in ML/DL, NLP, or Speech Processing
  • 2+ years training large audio language models
  • End-to-end ML model building pipeline experience
  • Familiarity with distributed multi-GPU training
Good to have:
  • Experience with multi-modal foundation models
  • Publications in ML/Audio/NLP research venues

Job Details

About Reality Defender

Reality Defender provides accurate, multi-modal AI-generated media detection solutions to enable enterprises and governments to identify and prevent fraud, disinformation, and harmful deepfakes in real time. A Y Combinator graduate, Comcast NBCUniversal LIFT Labs alumni, and backed by DCVC, Reality Defender is the first company to pioneer multi-modal and multi-model detection of AI-generated media. Our web app and platform-agnostic API built by our research-forward team ensures that our customers can swiftly and securely mitigate fraud and cybersecurity risks in real time with a frictionless, robust solution.

Youtube: Reality Defender Wins RSA Most Innovative Startup

Why we stand out:

  • Our best-in-class accuracy is derived from our sole, research-backed mission and use of multiple models per modality

  • We can detect AI-generated fraud and disinformation in near- or real time across all modalities including audio, video, image, and text.

  • Our platform is designed for ease of use, featuring a versatile API that integrates seamlessly with any system, an intuitive drag-and-drop web application for quick ad hoc analysis, and platform-agnostic real-time audio detection tailored for call center deployments.

  • We’re privacy first, ensuring the strongest standards of compliance and keeping customer data away from the training of our detection models.

Role and Responsibilities

  • Explore and conceptualize novel methods to leverage different modalities (e.g., speech, text) for deepfake detection and relevant audio understanding tasks.

  • Perform fundamental and applied research to advance the current state-of-the-art on audio deepfake detection.

  • Build models with generalizability to unseen generative methods - Collaborate with scientists and engineers across the organization

  • Summarize, publish, and present research findings

About You

  • Currently enrolled in a PhD program with specialization in machine learning/deep learning, natural language processing, and/or speech processing.

  • 2+ years of experience with training/fine-tuning large models, esp. audio language models, speech foundation models, multi-modal foundation models.

  • Experience with end-to-end model building pipeline for ML tasks: dataset curation/cleaning, model implementation, benchmarking, and result analysis

  • Familiarity with distributed multi-GPU training Prior experience with publications in reputable ML/Audio/NLP research venues, e.g. NeurIPS, Interspeech, ICASSP, ACL, EMNLP.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in New York, New York, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Audio Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

New York, New York, United States (Remote)

New York, New York, United States (On-Site)

New York, New York, United States (Remote)

View All Jobs

Get notified when new jobs are added by Reality Defender

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug