Sr. Engineering Manager, ML Serving Platform

About Pinterest:

Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product.

Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible.

The ML Platform team provides foundational tools and infrastructure used by hundreds of ML engineers across Pinterest, including recommendations, ads, visual search, growth/notifications, trust and safety. We aim to ensure that ML systems are efficient, healthy (production-grade quality) and fast (for modelers to iterate upon).

Pinterest is seeking a Sr. Engineering Manager to lead the team that builds the serving and deployment infrastructure for all ML models at Pinterest. Systems include:

• Ultra-high-performance C++ model inference engine for production recommendations and content ranking systems. TorchScript + CUDA Graph models on GPU inference, serving 500+M inferences/second.
• Production GenAI & LLM model inference stack for emerging use cases.
• Model routing, deployment, monitoring.
• Feature fetching, caching, and logging.

What you’ll do:

• Lead the team to deliver continual improvements in advanced model architectures, cost-efficient resource utilization, and ML developer productivity.
• Set technical direction for the team based on company and org priorities.
• Coach and develop talent on the team.

What we’re looking for:

• Experience managing platform engineering teams with many cross-organizational customers
• Experience building large-scale distributed serving systems
• Experience with ML inference technologies for online serving at Web scale
• Experience developing engineering platforms: deep customer understanding
• Bachelor’s degree in Computer Science, a related field or equivalent experience