Storage Protocols Engineering Manager

1 Month ago • 10 Years + • Software Development & Engineering • $330,000 PA - $495,000 PA

Job Summary

Job Description

We are seeking an experienced Software Engineering Manager with a history in the development of storage protocols and distributed storage systems. You will lead a team of Storage Software Engineers and Distributed Systems Engineers in the design, development, and optimization of cutting-edge distributed storage solutions. Your team will build high-performance, scalable, and reliable implementations of object, block, and file protocols, specifically tailored for AI training and inference workloads. This role offers a unique opportunity to work at the intersection of large-scale distributed systems and the rapidly evolving field of artificial intelligence infrastructure, building foundational infrastructure for advanced AI research and products.
Must have:
  • Grow/Hire, lead, and mentor a top-talent team of high-performing software engineers focused on delivering distributed storage protocols.
  • Foster a high-velocity culture of innovation, technical excellence, and collaboration.
  • Conduct regular one-on-one meetings, provide constructive feedback, and support career development for team members.
  • Drive outcomes by managing project priorities, deadlines, and deliverables using Agile methodologies.
  • Drive the technical vision and strategy for our distributed storage protocols (e.g., S3, NFS, iSCSI) and their underlying distributed systems.
  • Oversee the development of highly optimized storage solutions designed to meet the performance demands of AI/ML workloads.
  • Lead the team in tackling complex distributed systems challenges, including concurrency, consistency, fault tolerance, and data durability.
  • Guide engineering team in problem identification, requirements gathering, solution ideation, and stakeholder alignment on engineering RFCs.
  • Deeply understand the performance bottlenecks of existing storage systems and guide the team in developing innovative solutions.
  • Lead the team in supporting customers.
  • Work closely with AI/ML research and products teams to understand customer storage needs and translate them into technical requirements.
  • Work closely with the product engineering team to deliver high quality products to customers.
  • Collaborate with product management to define the product roadmap and prioritize features.
  • Work closely with HPC Architecture, Networking, Compute, and Storage Engineering teams to deploy high-performance distributed storage protocols.
  • Partner with fleet engineering and platforms teams to ensure seamless deployment, monitoring, and maintenance of distributed storage protocols.
  • Work in lock-step with the Storage Engineering team to provide reliable storage products on top of physical storage solutions.
  • Stay current with the latest trends and research in distributed systems, storage technologies, and AI/ML hardware/software advancements.
  • Work with the Lambda product team to uncover new trends in the AI inference and training product category.
  • Encourage and support the team in exploring new technologies and approaches to improve system performance and efficiency.
  • 10+ years of experience in software development, with at least 5+ years in a management or lead role in storage software engineering.
  • Demonstrated experience leading a team of software engineers on complex, cross-functional projects in a fast-paced startup environment.
  • Extensive hands-on experience in designing and implementing distributed storage systems.
  • Experience with storage protocols serving storage volumes at a scale greater than 20PB.
  • Experience developing and tuning distributed storage protocols across scaling challenges using namespacing, sharding, and caching strategies.
  • Familiarity with deploying and running applications on Kubernetes or other container orchestration systems.
  • Strong project management skills, leading high-confidence planning, project execution, and delivery of team outcomes on schedule.
  • Experience building a high-performance team through deliberate hiring, upskilling, planned skills redundancy, performance-management, and expectation setting.
Good to have:
  • Demonstrated delivery of distributed storage protocols in a CSP, NCP, HPC-infrastructure integrator, or AI-infrastructure company.
  • Experience with storage protocols serving storage volumes at a scale greater than 100PB.
  • Implementation of distributed storage protocols backed by a variety of storage solutions, performance-tuned for AI/ML workloads.
  • Experience driving cross-functional engineering management initiatives (coordinating deployments, strategic planning, coordinating large projects).
  • Deep expertise in object storage (e.g., S3), block storage (e.g., iSCSI), or file storage (e.g., NFS, SMB, Lustre).
  • Strong programming skills in languages such as C++, Go, Rust, or Python.
  • In-depth knowledge of operating system internals, including file systems, caching, and I/O scheduling.
  • Experience working with AI/ML training and inference frameworks (e.g., TensorFlow, PyTorch).
  • Understanding of the unique data access patterns and performance requirements of AI workloads.
  • Proven ability to design and debug highly concurrent and fault-tolerant systems.
  • Experience driving organizational improvements (processes, systems, etc.).
  • Experience training, or managing managers.
Perks:
  • Generous cash & equity compensation
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and Commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible Paid Time Off Plan that we all actually use

Job Details

Lambda is the #1 GPU Cloud for ML/AI teams training, fine-tuning and inferencing AI models, where engineers can easily, securely and affordably build, test and deploy AI products at scale. Lambda’s product portfolio includes on-prem GPU systems, hosted GPUs across public & private clouds and managed inference services – servicing government, researchers, startups and Enterprises world-wide.

If you'd like to build the world's best deep learning cloud, join us.

*Note: This position requires presence in our San Francisco office location 4 days per week; Lambda’s designated work from home day is currently Tuesday.

Engineering at Lambda is responsible for building and scaling our cloud offering. Our scope includes the Lambda website, cloud APIs and systems as well as internal tooling for system deployment, management and maintenance.

In the world of distributed AI, raw GPU and CPU horsepower is just a part of the story. High-performance networking and storage are the critical components that enable and unite these systems, making groundbreaking AI training and inference possible.

The Lambda Infrastructure Engineering organization forges the foundation of high-performance AI clusters by welding together the latest in AI storage, networking, GPU and CPU hardware.

Our expertise lies at the intersection of:

  • High-Performance Distributed Storage Solutions and Protocols: We engineer the protocols and systems that serve massive datasets at the speeds demanded by modern clustered GPUs.
  • Dynamic Networking: We design advanced networks that provide multi-tenant security and intelligent routing without compromising performance, using the latest in AI networking hardware.
  • Compute Virtualization: We enable cutting-edge virtualization and clustering that allows AI researchers and engineers to focus on AI workloads, not AI infrastructure, unleashing the full compute bandwidth of clustered GPUs.

About the Role:

We are seeking an experienced Software Engineering Manager with a history in the development of storage protocols and distributed storage systems to lead a team of Storage Software Engineers and Distributed Systems Engineers in the design, development, and optimization of cutting-edge distributed storage solutions. Your team will be responsible for building high-performance, scalable, and reliable implementations of object, block, and file protocols, specifically tailored to serve performance demanding AI training and inference workloads. This is a unique opportunity to work at the intersection of large-scale distributed systems and the rapidly evolving field of artificial intelligence infrastructure. You will be building the foundational infrastructure that powers some of the most advanced AI research and products in the world.

What You’ll Do

Team Leadership & Management:

  • Grow/Hire, lead, and mentor a top-talent team of high-performing software engineers focused on delivering distributed storage protocols.
  • Foster a high-velocity culture of innovation, technical excellence, and collaboration.
  • Conduct regular one-on-one meetings, provide constructive feedback, and support career development for team members.
  • Drive outcomes by managing project priorities, deadlines, and deliverables using Agile methodologies.

Technical Strategy & Execution:

  • Drive the technical vision and strategy for our distributed storage protocols (e.g., S3, NFS, iSCSI) and their underlying distributed systems.
  • Oversee the development of highly optimized storage solutions designed to meet the performance demands of AI/ML workloads (e.g., high throughput, low latency, optimization for AI workload access patterns).
  • Lead the team in tackling complex distributed systems challenges, including concurrency, consistency, fault tolerance, and data durability across multiple data centers.
  • Guide engineering team in problem identification, requirements gathering, solution ideation, and stakeholder alignment on engineering RFCs.
  • Deeply understand the performance bottlenecks of existing storage systems and guide the team in developing innovative solutions to overcome them.
  • Lead the team in supporting customers.

Cross-Functional Collaboration:

  • Work closely with AI/ML research and products teams to understand customers storage needs and translate them into technical requirements.
  • Work closely with the product engineering team to deliver high quality products to customers to meet their unique needs.
  • Collaborate with product management to define the product roadmap and prioritize features.
  • Work closely with HPC Architecture, Networking, Compute, and Storage Engineering teams to deploy high-performance distributed storage protocols to serve AI/ML workloads.
  • Partner with fleet engineering and platforms teams to ensure seamless deployment, monitoring, and maintenance of the distributed storage protocols.
  • Work in lock-step with the Storage Engineering team to provide reliable storage products on top of a variety of physical storage solutions.

Innovation & Research:

  • Stay current with the latest trends and research in distributed systems, storage technologies, and AI/ML hardware/software advancements.
  • Work with the Lambda product team to uncover new trends in the AI inference and training product category.
  • Encourage and support the team in exploring new technologies and approaches to improve system performance and efficiency.

You

Experience:

  • 10+ years of experience in software development, with at least 5+ years in a management or lead role in storage software engineering.
  • Demonstrated experience leading a team of software engineers on complex, cross-functional projects in a fast-paced startup environment.
  • Extensive hands-on experience in designing and implementing distributed storage systems.
  • Experience with storage protocols serving storage volumes at a scale greater than 20PB.
  • Experience developing and tuning distributed storage protocols across scaling challenges using namespacing, sharding, and caching strategies.
  • Familiarity with deploying and running applications on Kubernetes or other container orchestration systems (e.g., AWS ECS, Hashicorp Nomad).
  • Strong project management skills, leading high-confidence planning, project execution, and delivery of team outcomes on schedule.

Technical Skills:

  • Knowledge in one or more of the following storage protocols: object storage (e.g., S3), block storage (e.g., iSCSI), or file storage (e.g., NFS, SMB, Lustre).
  • Professional individual contributor experience in languages such as C++, Go, Rust, or Python.
  • Familiarity with modern storage technologies (e.g., NVMe, RDMA) and their role in optimizing performance.
  • Experience with containerization technologies (e.g., Docker, Kubernetes) and their integration with storage solutions.

Distributed Systems Knowledge:

  • Solid understanding of distributed systems concepts, including consensus algorithms (e.g., Raft, Paxos), distributed caching, failure recovery, consistency models (e.g., eventual consistency), fault tolerance, data replication, load balancing, and distributed consensus algorithms

People Management:

  • Experience building a high-performance team through deliberate hiring, upskilling, planned skills redundancy, performance-management, and expectation setting.

Nice to Have

Experience:

  • Demonstrated delivery of distributed storage protocols in a CSP (Cloud Service Provider), NCP (Neo-Cloud provider), HPC-infrastructure integrator, or AI-infrastructure company.
  • Experience with storage protocols serving storage volumes at a scale greater than 100PB.
  • Implementation of distributed storage protocols backed by a variety of storage solutions, performance-tuned for AI/ML workloads.
  • Experience driving cross-functional engineering management initiatives (coordinating deployments, strategic planning, coordinating large projects).

Technical Skills:

  • Deep expertise in one or more of the following storage protocols: object storage (e.g., S3), block storage (e.g., iSCSI), or file storage (e.g., NFS, SMB, Lustre).
  • Strong programming skills in languages such as C++, Go, Rust, or Python.
  • In-depth knowledge of operating system internals, including file systems, caching, and I/O scheduling.

AI/ML Domain Knowledge:

  • Experience working with AI/ML training and inference frameworks (e.g., TensorFlow, PyTorch).
  • Understanding of the unique data access patterns and performance requirements of AI workloads.

Distributed Systems Knowledge:

  • Proven ability to design and debug highly concurrent and fault-tolerant systems.

People Management:

  • Experience driving organizational improvements (processes, systems, etc.)
  • Experience training, or managing managers.

Salary Range Information

The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

  • Founded in 2012, ~400 employees (2025) and growing fast
  • We offer generous cash & equity compensation
  • Our investors include Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, US Innovative Technology, Gradient Ventures, Mercato Partners, SVB, 1517, Crescent Cove.
  • We are experiencing extremely high demand for our systems, with quarter over quarter, year over year profitability
  • Our research papers have been accepted into top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG
  • Health, dental, and vision coverage for you and your dependents
  • Wellness and Commuter stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible Paid Time Off Plan that we all actually use

A Final Note:

You do not need to match all of the listed expectations to apply for this position. We are committed to building a team with a variety of backgrounds, experiences, and skills.

Equal Opportunity Employer

Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Similar Jobs

Ion - Software Developer/Engineer - Graduate Development Program

Ion

Turin, Piedmont, Italy (On-Site)
10 Months ago
Gameopedia - AI/Agent Engineer

Gameopedia

Norway (Hybrid)
4 Months ago
NCR Voyix - Software Engineer III / Java Full Stack Developer

NCR Voyix

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Rackspace Technology - Bid Manager V - IN

Rackspace Technology

India (Remote)
4 Weeks ago
Single Store - AI & Automation Analyst

Single Store

Pune, Maharashtra, India (On-Site)
1 Month ago
Sigma Software - Threat Detection and Script Engineer

Sigma Software

Argentina (On-Site)
3 Months ago
Accenture - Software Development Engineer

Accenture

Pune, Maharashtra, India (On-Site)
1 Month ago
Bright Edge - Engineering Manager

Bright Edge

Hyderabad, Telangana, India (Remote)
1 Year ago
Globalization Partners - Senior Software Engineer

Globalization Partners

Ireland (Remote)
3 Months ago
Alphawave Semi - Staff Engineer II - Physical Design

Alphawave Semi

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Coupa - Customer Solution Partner

Coupa

State Of São Paulo, Brazil (Hybrid)
2 Months ago
hogarth - Freelance Senior Project Manager

hogarth

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Canva - AI Research Lead - Generative AI

Canva

Adelaide, South Australia, Australia (Remote)
1 Month ago
appier - Technical Solution Engineer - MMP

appier

Tokyo, Japan (On-Site)
3 Months ago
Apple - AIML - Senior Engineering Program Manager, FM Evaluation

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Domo - Escalation Lead

Domo

American Fork, Utah, United States (On-Site)
1 Month ago
Marsh McLennan - Carrier Relationship Management - Reinsurance

Marsh McLennan

London, England, United Kingdom (Hybrid)
3 Months ago
Publicis Groupe - Project Manager

Publicis Groupe

London, England, United Kingdom (Hybrid)
1 Month ago
frozenbyte games - Game Developer

frozenbyte games

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
HCL Tech - Design Lead PDMS, Plant Modeling, Piping

HCL Tech

Minnesota, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Xplor Technologies - Sales Development Representative (SDR)

Xplor Technologies

Denver, Colorado, United States (Remote)
1 Month ago
Landor - Growth Manager

Landor

New York, United States (Hybrid)
1 Month ago
Unity - Vice President, Corporate Legal

Unity

San Francisco, California, United States (On-Site)
2 Months ago
Square - Associate Engineer, IT

Square

Lisle, Illinois, United States (On-Site)
1 Month ago
hogarth - Senior Financial Analyst - Rev Ops

hogarth

New York, United States (Hybrid)
2 Months ago
Synechron - Tableau Developer

Synechron

Rutherford, New Jersey, United States (On-Site)
2 Months ago
Riot Games - Principal Analytics Engineer - Product Insights

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago
Kavalirio - Sr. Specialist Project Engineers L4/ L5

Kavalirio

Camden, Arkansas, United States (On-Site)
3 Months ago
Drive mode - Senior Software Engineer - Mobile (Android)

Drive mode

Mountain View, California, United States (Hybrid)
1 Year ago
Fandom  - Sr Analyst, Revenue Analytics

Fandom

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

Onehouse - Staff Software Engineer, Open Source

Onehouse

Sunnyvale, California, United States (Hybrid)
1 Year ago
Illumina - Engineer 2 - Process Development

Illumina

San Diego, California, United States (On-Site)
1 Month ago
Open Systems Technologies - Electrical Engineer IV

Open Systems Technologies

Kansas City, Missouri, United States (On-Site)
1 Month ago
Playtika - Incident Engineer (NOC/SLS)

Playtika

Ukraine (On-Site)
9 Months ago
Ansys - Senior Application Engineer

Ansys

Ann Arbor, Michigan, United States (On-Site)
2 Months ago
Aisera - Forward Deployed Engineer

Aisera

United States (Remote)
1 Month ago
CAE - Hardware Engineer

CAE

Little Rock, Arkansas, United States (On-Site)
1 Month ago
Nagarro - Associate Principal Engineer, Delivery

Nagarro

New York, New York, United States (On-Site)
10 Months ago
Glean - Technical Support Engineer

Glean

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Roblox - Senior Software Engineer, Shopping

Roblox

San Mateo, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

Atlanta, Georgia, United States (On-Site)

San Francisco, California, United States (Remote)

San Francisco, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

San Francisco, California, United States (Hybrid)

San Jose, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Lambda

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug