Staff Software Engineer — AI Platform

3 Months ago • 8 Years + • Devops

Job Summary

Job Description

As a Staff AI Platform Engineer, you will design and implement core AI pipelines that drive SnorkelFlow’s AI capabilities. You will lead technical direction, mentor team members, and collaborate across teams to align the AI Platform with product goals. This role requires experience with large language models (LLMs) and deep expertise in AI development, designing and deploying systems leveraging LLMs and traditional NLP solutions for production workflows. Responsibilities include leading AI pipeline development, developing LLM-based systems, and overseeing backend services for managing LLM calls and API interactions. You will also establish observability standards and collaborate cross-functionally to deliver scalable solutions.
Must have:
  • 8+ years in AI development with hands-on experience in production systems
  • Strong expertise in Python and deep learning frameworks such as PyTorch
  • Experience leading technical projects and mentoring engineers
  • Proficiency with CI/CD pipelines for machine learning workflows
  • Deep understanding of LLM architectures, fine-tuning, and deployment methodologies
  • Strong communication skills, with an emphasis on scalable and reliable system design
Good to have:
  • Expertise in NLP and familiarity with libraries such as Hugging Face Transformers
  • Familiarity with multimodal AI concepts, including vision and audio tasks
  • Experience working with APIs and foundational model providers
  • Knowledge of MLOps tools and practices, such as MLflow, Kubernetes, or Ray
  • Experience building APIs or SDKs for AI services
Perks:
  • A leadership role with the opportunity to influence the technical direction of SnorkelFlow
  • Competitive salary and benefits tailored to your experience
  • Hybrid work environment with 3 days per week at our Redwood City HQ and SF Office
  • "No Meeting" Tuesdays and Thursdays to focus on deep work
  • The chance to work on cutting-edge infrastructure and drive impactful change in an innovative, fast-paced environment

Job Details

We’re on a mission to democratize AI by building the definitive AI data development platform. The AI landscape has gone through incredible change between 2016, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

As a Staff AI Platform Engineer, you will play a pivotal role in designing and implementing the core AI pipelines that drive SnorkelFlow’s AI capabilities. You will act as a technical leader, setting architectural direction, mentoring team members, and collaborating across verticals to ensure the AI Platform aligns with product goals and organizational strategy.

This role requires hands-on experience with large language models (LLMs), requiring deep expertise in AI development, especially in designing and deploying systems that leverage LLMs and more traditional NLP solutions for production workflows.

Main Responsibilities

Technical Leadership

  • Provide technical direction for the design and development of AI pipelines, ensuring scalability, robustness, and extensibility.
  • Serve as a mentor and guide for engineers on the AI Platform team, fostering growth and technical excellence.
  • Identify and drive high-impact projects aligned with business objectives and product needs.

AI Pipeline Development

  • Architect, design, and maintain AI pipelines for labeling, embeddings, training, and deploying models into production.
  • Lead the development and optimization of MLFlow pipelines for deployment.
  • Build and deploy foundational models that serve as the backbone for SnorkelFlow’s core product capabilities.
  • Partner with the Compute Platform team to ensure seamless integration with orchestration tools and infrastructure.

LLM Tooling development:

  • Develop and deploy LLM-based systems for production workflows, focusing on efficiency, scalability, and reproducibility.
  • Create AI training framework pipelines that will allow LLM usage in applications, including fine-tuning, pruning, distillation, and foundational model training.
  • Integrate APIs from providers such as OpenAI, Anthropic, and Gemini into SnorkelFlow’s pipelines.

Backend Development

  • Oversee the integration of backend services for managing LLM calls and API interactions.
  • Collaborate with the Data Platform team to define data requirements and ensure smooth interoperability.
  • Work with the Application team to design and implement APIs that power application workflows.

Observability and Monitoring

  • Establish observability standards for AI pipelines, including tools and dashboards for monitoring model performance and debugging.
  • Define key metrics for system health and optimization.

Cross-Functional Collaboration

  • Act as a thought leader, collaborating with Data Platform, Compute Platform, Application, Product and other internal teams to deliver cohesive, scalable solutions.
  • Partner with stakeholders to translate product goals into technical roadmaps and

Required Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related field.
  • 8+ years of experience with a good portion of them in AI development, including hands-on work with AI in production systems.
  • Strong expertise in Python and deep learning frameworks such as PyTorch.
  • Proven experience leading technical projects and mentoring engineers.
  • Proficiency with CI/CD pipelines for machine learning workflows.
  • Deep understanding of LLM architectures, fine-tuning, and deployment methodologies.
  • Strong communication skills, with an emphasis on scalable and reliable system design.

Preferred Qualifications

  • Expertise in NLP and familiarity with libraries such as Hugging Face Transformers, spaCy, scikit-learn, or XGBoost.
  • Familiarity with multimodal AI concepts, including vision and audio tasks.
  • Experience working with APIs and foundational model providers such as OpenAI, Anthropic, or Gemini.
  • Knowledge of MLOps tools and practices, such as MLflow, Kubernetes, or Ray.
  • Experience building APIs or SDKs for AI services.

What We Offer

  • A leadership role with the opportunity to influence the technical direction of SnorkelFlow.
  • Competitive salary and benefits tailored to your experience.
  • Hybrid work environment with 3 days per week at our Redwood City HQ and SF Office.
  • "No Meeting" Tuesdays and Thursdays to focus on deep work.
  • The chance to work on cutting-edge infrastructure and drive impactful change in an innovative, fast-paced environment.

 

Be Your Best At Snorkel
 
Snorkel AI is on a mission to make machine learning practical for everyone, and it starts with building a team that welcomes, represents and gives opportunity to all. We work at the frontier of AI and software engineering, and believe that underrepresented communities need to play a part in shaping the future of these fields. At Snorkel AI, we actively work to create an environment that values end-to-end ownership, diverse forms of impact, and opportunities for personal growth.
 
Snorkelers are supported by an amazing team and an amazing set of benefits. For Full-time employees, we offer comprehensive medical, dental, and vision plans for Snorkelers and their families, plus a yearly wellness stipend. Our 401k program lets Snorkelers plan for their future and our parental leave program lets new parents take up to 20 weeks of paid time off. Learn more about these benefits and more — like our workstation setup allowance — on our Careers page.
 
Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.
 
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Similar Jobs

HP - NA Consumer PC 4P Category Business Developer

HP

Spring, Texas, United States (On-Site)
1 Week ago
The Walt Disney Company - Sr Software Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
Meta - Software Engineer (Leadership) - Machine Learning

Meta

Paris, Île-de-France, France (On-Site)
8 Months ago
Shield AI - Staff Software Engineer, Embedded Applications (R3331)

Shield AI

Boston, Massachusetts, United States (On-Site)
1 Week ago
GT HQ - Senior Product Manager

GT HQ

Ukraine (Remote)
3 Weeks ago
Boomi  - Software Principle Engineer - Platform Architecture Service

Boomi

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Apple - AIML- Software Engineer, ML Platform & Infrastructure

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Shipt - Staff React Native Platform Engineer

Shipt

Birmingham, Alabama, United States (Hybrid)
2 Weeks ago
Palo Alto Networks - Senior Consulting Director, Cloud Security, Proactive Services (Unit 42)

Palo Alto Networks

Santa Clara, California, United States (Remote)
2 Weeks ago
Apple - NLP Solutions Software Engineer

Apple

Austin, Texas, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Toast - Hardware Quality Engineer

Toast

Boston, Massachusetts, United States (Hybrid)
1 Week ago
endava - .NET Developer with AWS experience

endava

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
Apple - Client Software Engineer, Frontend Web/iOS/macOS - iCloud

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Roblox - Moderation Escalation Specialist

Roblox

Gurugram, Haryana, India (Remote)
1 Month ago
Abridge - Partner Success Director, Key Accounts

Abridge

New York, New York, United States (Hybrid)
2 Months ago
Adtran - Software Development Engineer

Adtran

Huntsville, Alabama, United States (On-Site)
1 Week ago
PayPal - Sr. Director of Product - SmartWallet

PayPal

San Jose, California, United States (Hybrid)
2 Months ago
The Walt Disney Company - Senior Marketing Data Scientist

The Walt Disney Company

Burbank, California, United States (On-Site)
4 Months ago
Shield AI - Staff Electrical Engineer

Shield AI

Dallas, Texas, United States (On-Site)
1 Week ago
Mendix - Support Engineer

Mendix

Rotterdam, South Holland, Netherlands (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

bytedance - Research Scientist Graduate (High-Performance Computing (Inference Optimization) - Vision AI Platform)

bytedance

San Jose, California, United States (On-Site)
4 Months ago
Roblox - Senior Engineering Director, Developer Monetization

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
Open Systems Technologies - Assistant Manager (06791) - FT Hours - 8100 Highway 6 N

Open Systems Technologies

Houston, Texas, United States (On-Site)
1 Week ago
Self - Manager, Engineering

Self

Austin, Texas, United States (Remote)
2 Weeks ago
Ramp - Senior Applied Scientist | Credit Risk

Ramp

New York, United States (Hybrid)
1 Week ago
Pokemon - Bilingual Project Manager (Japanese/English)

Pokemon

Bellevue, Washington, United States (Hybrid)
2 Months ago
Publicis Groupe - Supervisor, Media Planning

Publicis Groupe

Chicago, Illinois, United States (Hybrid)
1 Week ago
Magic School - International & Channel Partnerships Manager

Magic School

United States (Remote)
2 Weeks ago
Palo Alto Networks - Revenue Operations Manager

Palo Alto Networks

Santa Clara, California, United States (On-Site)
1 Month ago
ChainGuard - Enterprise Account Executive

ChainGuard

Minnesota, United States (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Devops Jobs

cirrus logic - DevOps Engineer – CI/CD & Software Automation

cirrus logic

Austin, Texas, United States (Hybrid)
3 Months ago
Rippling - Senior Software Engineer (Backend) - HRIS Platform

Rippling

San Francisco, California, United States (On-Site)
2 Months ago
bytedance - GPU/AI Application Platform Engineer Intern (Server Platform)

bytedance

San Jose, California, United States (On-Site)
3 Months ago
Rackspace Technology - Senior GCP Cloud Engineer

Rackspace Technology

United States (Remote)
4 Months ago
Thousand Eyes - Senior Software Engineer, Cloud and Enterprise Agents

Thousand Eyes

San Francisco, California, United States (On-Site)
2 Months ago
Capgemini - Senior DevOps Architect

Capgemini

Pune, Maharashtra, India (On-Site)
2 Weeks ago
London stock Exchange - Senior Cloud Engineer

London stock Exchange

St. Louis, Missouri, United States (On-Site)
2 Months ago
NCR Atleos - Site Reliability Engineer III

NCR Atleos

Gurugram, Haryana, India (On-Site)
3 Weeks ago
endava - Senior Cloud Operations Engineer - AWS

endava

Cluj-Napoca, Cluj County, Romania (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

New York, New York, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Redwood City, California, United States (Hybrid)

Washington, District Of Columbia, United States (Remote)

Redwood City, California, United States (Hybrid)

New York, United States (Hybrid)

London, England, United Kingdom (On-Site)

View All Jobs

Get notified when new jobs are added by Snorkel AI

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug