Senior Software Engineer, Filesystem

WEKA is architecting a new approach to the enterprise data stack built for the AI era. The WEKA® Data Platform sets the standard for AI infrastructure with a cloud and AI-native software solution that can be deployed anywhere. It transforms legacy data silos into data pipelines that make GPUs, AI, and other performance-intensive workloads run faster, work more efficiently, and consume less energy.WEKA is a pre-IPO, growth-stage company on a hyper-growth trajectory. We’ve raised $375M in capital with dozens of world-class venture capital and strategic investors. We help the world’s most innovative enterprises and research organizations, including 12 of the Fortune 50, reach discoveries, insights, and outcomes faster and more sustainably.We’re passionate about helping our customers overcome complex data challenges to accelerate their innovation and help grow their businesses. If you share our passion, we invite you to join us on this exciting journey.

What makes a Wekkie?

If you have a positive “can-do” attitude, a relentless curiosity about all things tech, and you thrive on pushing limits and breaking barriers, you’ll fit right in at Weka!

We’re a super friendly bunch who support each other, promote best practices, and we always encourage collaboration and sharing ideas. Even on rainy days, our sunny spirits shine through. And as we grow, we’re inviting those who are like us to join in the fun!

What You'll Be Doing

The filesystem group is a high-powered team responsible for implementing algorithms at scales of 100s of PBs. The team also manages the core filesystem components, including blocks and metadata management, snapshots, RAID logic, object-store tiering, unique cloud disaster recovery features, and more. And most importantly, they skillfully handle the most delicate part of the Weka solution – our customers’ data.

As a Senior Software Engineer, You’ll

• Design and develop distributed file system components to support data management features such as snapshots, replication, tiering, and advanced data reduction algorithms;
• Participate in the design, architecture, and implementation of next-generation storage architecture;
• Assist in technically managing initial storage implementations including proofs-of-concept;
• Diagnose bottlenecks and implement clean and performant solutions to achieve unbeatable performance;
• Design algorithms and data structures to make sure customer data is safe and coherent across our solution in a wide variety of failure modes; and
• Constantly revisit the architecture, algorithms, and methodologies to improve productivity, reliability, and maintainability.
  
  

Requirements

• Over 10 years of expertise in low-level, high-performance programming using C, C++, and Rust.
• A thorough understanding of concurrency, inter-process communication, threading models, and synchronization concepts, including significant experience with complex multithreaded software design
• Experience identifying, reproducing, and resolving complex software defects, including root cause isolation, tracing through large source codebases, and implementing long-term fixes as well as short-term workarounds
• 10+ years of hands-on experience with Linux development and debugging, along with a broad knowledge and understanding of Linux internals
  
  

It's Nice If You Have

• Experience in data-path design and development
• Experience with development of highly-distributed systems
• Deep familiarity with concepts and features from the storage industry, including snapshots, replication, transparent data migration, and data reduction techniques
• Experience with ZFS, XFS, or other file systems or with enterprise storage solutions
• Experience working with the Linux filesystem community
• Contribution, upstreaming, or maintaining of filesystem code
• Experience playing a significant role in the implementation of a concurrent, long-running performant server
  
  

Concerned that you don’t meet every qualification above?

Studies have shown that women and people of color may be less likely to apply for jobs if they don’t meet every qualification specified. At WEKA, we are committed to building a diverse, inclusive and authentic workplace. If you are excited about this position but are concerned that your past work experience doesn’t match up perfectly with the job description, we encourage you to apply anyway – you may be just the right candidate for this or other roles at WEKA.

WEKA is an equal opportunity employer that prohibits discrimination and harassment of any kind. We provide equal opportunities to all employees and applicants for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.