Sr. Engineering Manager - AI Observability Platform

2 Minutes ago • 5 Years + • Research Development • $217,000 PA - $288,400 PA

Job Summary

Job Description

At Databricks, we empower data teams to solve challenging problems by building and operating a premier data and AI infrastructure platform. This role focuses on the AI Quality Observability Platform, addressing the need for robust evaluation and monitoring of GenAI Agents in production. The team leverages LLMs and custom models to assess response quality, applying advanced analytics for actionable insights. The Senior Engineering Manager will lead product strategy and development for GenAI Quality Observability, driving Agent Monitoring to General Availability, building a scalable AI Quality Observability platform, and collaborating with cross-functional teams to enhance customer experience.
Must have:
  • Lead product strategy and development for GenAI Quality Observability.
  • Drive Agent Monitoring product from Beta to General Availability.
  • Build scalable AI Quality Observability platform for multiple products.
  • Innovate and optimize for highest quality and performance.
  • Collaborate with cross-functional teams for scalable solutions.
  • Engage with customers to understand needs and enhance experience.
  • 5+ years experience working on AI.
  • Experience building highly-available cloud services.
  • Building, growing, and managing high performance teams.
  • Defining and meeting SLOs for highly-available systems.
  • Ability to attract and hire engineers.
Good to have:
  • Knowledge of database internals
  • BS in Computer Science (Masters or PhD Preferred)
Perks:
  • Annual performance bonus
  • Equity

Job Details

Join Databricks: Pioneering the Future of Data and AI

At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems—from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks

About the Role:

Enterprise customers demand high-quality GenAI Agents. Yet, without a robust platform to evaluate and monitor these agents in production, continuous improvement is impossible.The AI Quality Observability Platform team tackles this challenge by leveraging LLMs and custom models to evaluate responses for correctness, relevance, and custom-defined metrics. We apply advanced analytics techniques to deliver actionable insights that drive quality improvements. We help customers build, optimize, and monitor GenAI applications at scale. We've integrated our evaluation and monitoring capabilities into MLflow to streamline observability and model quality tracking. With our AI Agent Evaluation suite GA, MLflow3 launched, Agent Monitoring and Agent Bricks in Beta, we are ready to take this product to the next level—and we need a senior engineering leader to drive it.

The impact you will have:

  • Lead the product strategy and development for the GenAI Quality Observability.
  • Drive the Agent Monitoring product from Beta to General Availability.
  • Build a highly scalable AI Quality Observability platform that powers multiple products, including Agent Bricks, Lakehouse Monitoring, and beyond.
  • Innovate and optimize to ensure the highest quality and performance.
  • Collaborate with cross-functional teams to deliver scalable solutions.
  • Engage with customers to understand their needs and enhance their experience.

What we look for:

  • 5+ years of experience working on AI
  • Experience building highly-available cloud services
  • Building, growing, and managing high performance teams
  • Experience in defining and meeting SLOs for highly-available systems
  • Ability to attract and hire engineers who meet the Databricks hiring standards
  • Knowledge of database internals (highly Preferred)
  • BS in Computer Science (Masters or PhD Preferred)

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in San Francisco, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research Development Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Mountain View, California, United States (On-Site)

Bellevue, Washington, United States (On-Site)

Berlin, Berlin, Germany (On-Site)

Dallas, Texas, United States (On-Site)

Aarhus, Denmark (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Databricks

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug