Senior Research Engineer (Data)

1 Hour ago • 3 Years + • Artificial Intelligence • Data Analyst

About the job

Summary

This Senior Research Engineer (Data) role focuses on spearheading data acquisition and management systems for advanced AI research. Responsibilities include architecting and maintaining efficient data pipelines for sourcing, processing, and organizing large datasets used in generative AI models. The role requires partnering with research teams to improve model performance by identifying and leveraging novel data sources, developing robust data pipelines (including deduplication and filtering), collaborating with annotation teams to enhance dataset quality, applying advanced methodologies like self-supervised active learning, and leading research projects to improve data quality for video generation models. The ideal candidate will have 3+ years of experience managing large-scale datasets in fields like computer vision or NLP, strong Python and PyTorch skills, and experience with large-scale data processing tools like SQL or Spark.
Must have:
  • 3+ years experience managing large datasets
  • Strong Python & PyTorch proficiency
  • Experience with SQL or Spark
  • Expertise in designing distributed systems
  • Data pipeline development & maintenance
Perks:
  • Competitive equity packages
  • Comprehensive benefits plan
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

We are seeking a Senior Software Engineer to spearhead our data acquisition and management systems, critical to our advanced AI research. In this role, you will architect and maintain efficient pipelines for sourcing, processing, and organizing the extensive datasets that fuel our generative AI models. Your expertise will have a direct and transformative impact on the quality and capabilities of our technology.

Responsibilities

  • Partner with research teams to understand and address model performance gaps by identifying and leveraging novel data sources.
  • Develop and implement robust data pipelines for acquisition, deduplication, filtering, and pre-training dataset preparation.
  • Collaborate with annotation operations teams to design innovative data filtering strategies and enhance dataset quality.
  • Apply and integrate advanced methodologies such as self-supervised active learning to scale data systems.
  • Lead research projects to improve data quality and drive advancements in video generation models.

Qualifications

  • Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
  • Experience: 3+ years of experience in managing and curating large-scale datasets, particularly in fields like computer vision, NLP, robotics, or self-driving technologies.

Key Skills:

  • Strong proficiency in Python and familiarity with deep learning frameworks such as PyTorch.
  • Experience with large-scale data processing tools, such as SQL or Spark.
  • Hands-on expertise in designing and working with distributed systems.
  • Proven ability to thrive in a fast-paced, research-focused environment and deliver end-to-end project solutions.

Note: This position is not intended for recent graduates.

Compensation

The salary range for this role in California is $175,000–$250,000 per year. Actual base pay may vary based on factors such as job-related expertise, skills, experience, and candidate location. Additionally, we provide competitive equity packages through stock options and a comprehensive benefits plan.

View Full Job Description
$175.0K - $250.0K/yr (Outscal est.)
$212.5K/yr avg.
Palo Alto, California, United States

About The Company

An idea-to-video platform that brings your creativity to motion.

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

California, United States (On-Site)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug