Data Infrastructure Engineer (India)

4 Months ago • 2-4 Years • Backend Development • Data Analyst

Job Summary

Job Description

Join Onehouse's Data Infrastructure team to productionize next-gen data tech, optimize Apache Hudi, and build high-performance systems. Strong object-oriented design skills (Java/C++) and distributed system experience are required. Experience with databases, query engines, or Spark is a plus.
Must have:
  • Object-Oriented Design
  • Java/C++ Skills
  • Distributed Systems
  • Relational Databases
Good to have:
  • Database Systems
  • Query Engines
  • Spark Codebases
  • Optimization Math
Perks:
  • Equity Compensation
  • Health & Well-being

Job Details

About the job

About Onehouse

Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver the industry’s most interoperable data lakehouse through a cloud-native managed service built on Apache Hudi. Onehouse enables organizations to ingest data at scale with minute-level freshness, centrally store it, and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML).

We are a team of self-driven, inspired, and seasoned builders that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off a fresh $35M Series B backed by Craft, Greylock and Addition Ventures, we're now at $68M total funding and looking for rising talent to grow with us and become future leaders of the team. Come help us build the world's best fully managed and self-optimizing data lake platform!

The Community You Will Join

When you join Onehouse, you're joining a team of passionate professionals tackling the deeply technical challenges of building a 2-sided engineering product. Our engineering team serves as the bridge between the worlds of open source and enterprise: contributing directly to and growing Apache Hudi (already used at scale by global enterprises like Uber, Amazon, ByteDance etc) and concurrently defining a new industry category - the transactional data lake. The Data Infrastructure team is the grounding heartbeat to all of this. We live and breathe databases, building cornerstone infrastructure by working under Hudi's hood to solving incredibly complex optimization and systems problems.

The Impact You Will Drive:

  • As a foundational member of the Data Infrastructure team, you will productionize the next generation of our data tech stack by building the software and data features that actually process all of the data we ingest.
  • Accelerate our open source enterprise flywheel by working on the guts of Apache Hudi's transactional engine and optimizing it for diverse Onehouse customer workloads.
  • Act as a SME to deepen our teams' expertise on database internals, query engines, storage and/or stream processing.

  • A Typical Day:

    • Design new concurrency control and transactional capabilities that maximize throughput for competing writers.
    • Design and implement new indexing schemes, specifically optimized for incremental data processing and analytical query performance.
    • Design systems that help scale and streamline metadata and data access from different query/compute engines.
    • Solve hard optimization problems to improve the efficiency (increase performance and lower cost) of distributed data processing algorithms over a Kubernetes cluster.
    • Leverage data from existing systems to find inefficiencies, and quickly build and validate prototypes.
    • Collaborate with other engineers to implement and deploy, safely rollout the optimized solutions in production.


    What You Bring to the Table:

    • Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform).
    • Experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases.
    • You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions.
    • An ability to prioritize across feature development and tech debt with urgency and speed.
    • An ability to solve complex programming/optimization problems.
    • An ability to quickly prototype optimization solutions and analyze large/complex data.
    • Robust and clear communication skills.
    • Nice to haves (but not required):
    • Experience working with database systems, Query Engines or Spark codebases.
    • Experience in optimization mathematics (linear programming, nonlinear optimization).
    • Existing publications of optimizing large-scale data systems in top-tier distributed system conferences.
    • PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects.


    How We'll Take Care Of You

    • Equity Compensation; our success is your success with eligible participation in our company equity plan
    • Health & Well-being; we'll invest in your physical and mental well-being by reimbursing up to 20,000 INR for your monthly insurance premium
    • Financial Future; we'll invest in your financial well-being by making this role eligible for the provident fund of which Onehouse will contribute up to 1800 INR/month
    • Location; we are a remote-friendly company (internationally distributed across N. America + India), though some roles will be subject to in-person requirements in alignment with the needs of the business
    • Generous Time Off; unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 17 paid company holidays
    • Food & Meal Allowance; weekly lunch stipend, in-office snacks/drinks
    • Equipment; we'll provide you with the equipment you need to be successful and a one-time $500 (USD) stipend for your initial office/desk setup
    • Child Bonding!; 26 weeks off for birthing and 12 weeks for surrogate and adoptive parents - fully paid so you can focus your energy on your newest addition


    House Values

    One Team

    Optimize for the company, your team, self - in that order. We may fight long and hard in the trenches, take care of your co-workers with empathy. We give more than we take to build the one house, that everyone dreams of being part of.

    Tough & Persevering

    We are building our company in a very large, fast-growing but highly competitive space. Life will get tough sometimes. We take hardships in the stride, be positive, focus all energy on the path forward and develop a champion's mindset to overcome odds. Always day one!

    Keep Making It Better Always

    Rome was not built in a day; If we can get 1% better each day for one year, we'll end up thirty-seven times better. This means being organized, communicating promptly, taking even small tasks seriously, tracking all small ideas, and paying it forward.

    Think Big, Act Fast

    We have tremendous scope for innovation, but we will still be judged by impact over time. Big, bold ideas still need to be strategized against priorities, broken down, set in rapid motion, measure, refine, repeat. Great execution is what separates promising companies from proven unicorns.

    Be Customer Obsessed

    Everyone has the responsibility to drive towards the best experience for the customer, be an OSS user or a paid customer. If something is broken, own it, say something, do something; never ignore. Be the change that you want to see in the company.

    Similar Jobs

    Swiss Re - Senior Site Reliability Engineer

    Swiss Re

    Bengaluru, Karnataka, India (On-Site)
    3 Months ago
    PwC - Senior Associate_Java Full Stack Developer_Data & Analytics_Advisory_Bangalore

    PwC

    Bengaluru, Karnataka, India (On-Site)
    4 Months ago
    Assystems - Senior Software Engineer

    Assystems

    Gurugram, Haryana, India (On-Site)
    3 Months ago
    Axinous - Principal Site Reliability Engineer (Security Clearance)

    Axinous

    San Jose, California, United States (Hybrid)
    1 Month ago
    The Walt Disney Company - Sr. Manager, Software Engineering

    The Walt Disney Company

    New York, New York, United States (On-Site)
    1 Month ago
    CloudHire - Principal Backend Engineer - TypeScript

    CloudHire

    Telangana, India (Remote)
    3 Weeks ago
    Netflix - Distributed Systems Engineer (L4), Content Engineering

    Netflix

    California, United States (Remote)
    3 Weeks ago
    Wargaming - Server Developer (World of Tanks)

    Wargaming

    Warsaw, Masovian Voivodeship, Poland (Hybrid)
    2 Months ago
    bosh group india - Backend Developer-Support Engineer

    bosh group india

    Bengaluru, Karnataka, India (On-Site)
    1 Week ago
    Patreon - Senior Backend Engineer, Notifications

    Patreon

    New York, New York, United States (Hybrid)
    4 Months ago

    Get notifed when new similar jobs are uploaded

    Similar Skill Jobs

    Netflix - Software Engineer, Platform Modernization Engineering - L4

    Netflix

    Los Gatos, California, United States (On-Site)
    3 Weeks ago
    Microsoft - Senior reliability Engineer

    Microsoft

    Bengaluru, Karnataka, India (On-Site)
    1 Month ago
    Microsoft - Software Engineer

    Microsoft

    Bucharest, Bucharest, Romania (On-Site)
    4 Weeks ago
    Epic Games - Backend Engineer

    Epic Games

    (On-Site)
    1 Month ago
    NVIDIA - Senior Software Engineer - HPC

    NVIDIA

    Santa Clara, California, United States (On-Site)
    1 Month ago
    ByteDance - Software Engineer, Cloud Native Platform

    ByteDance

    San Jose, California, United States (On-Site)
    3 Months ago
    Meetelise - Senior Software Engineer

    Meetelise

    New York, New York, United States (On-Site)
    3 Months ago
    Nagarro - Senior Staff Engineer, Hybris

    Nagarro

    India (Remote)
    4 Months ago
    Zoox - Senior/Staff Backend Software Engineer - Product

    Zoox

    Foster City, California, United States (On-Site)
    3 Months ago
    PwC - AES SAP BTP & Integrations Senior Associate Consult

    PwC

    Bengaluru, Karnataka, India (On-Site)
    2 Months ago

    Get notifed when new similar jobs are uploaded

    Jobs in Bengaluru, Karnataka, India

    HOUZLOOK - Interior Designer

    HOUZLOOK

    Bhubaneswar, Odisha, India (On-Site)
    4 Months ago
    Assystems - Design Engineer

    Assystems

    Chennai, Tamil Nadu, India (On-Site)
    3 Months ago
    ION - UK Holdings - India - 859

    ION

    Mumbai, Maharashtra, India (On-Site)
    4 Months ago
    Infoblox - Senior Software Engineer - C++ AND Azure

    Infoblox

    Bengaluru, Karnataka, India (On-Site)
    4 Months ago
    PwC - IN_Senior Associate_Change Management _Advisory corporate _Advisory_Bangalore

    PwC

    Bengaluru, Karnataka, India (On-Site)
    3 Months ago
    Sporty Group - IN Associate - Operations Support

    Sporty Group

    Mumbai, Maharashtra, India (On-Site)
    8 Months ago
    Framestore - LEAD ANIMATOR

    Framestore

    Mumbai, Maharashtra, India (On-Site)
    8 Months ago
    Hitachi - Artificial Intelligence - JBU

    Hitachi

    Chennai, Tamil Nadu, India (On-Site)
    4 Months ago
    PwC - IN_Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

    PwC

    Kolkata, West Bengal, India (On-Site)
    4 Months ago
    RSMS Architects   - Architectural Drafter

    RSMS Architects

    New Delhi, Delhi, India (On-Site)
    4 Months ago

    Get notifed when new similar jobs are uploaded

    Backend Development Jobs

    ByteDance - Backend Software Engineer, Office Intelligence

    ByteDance

    Dubai, Dubai, United Arab Emirates (On-Site)
    3 Months ago
    Meta - Software Engineer, Infrastructure

    Meta

    Boston, Massachusetts, United States (On-Site)
    3 Months ago
    Zeta - Lead Software Development Engineer_Backend (Aura)

    Zeta

    Bengaluru, Karnataka, India (On-Site)
    4 Months ago
    Riot Games - Senior Software Engineer, VALORANT - Store

    Riot Games

    Los Angeles, California, United States (On-Site)
    2 Months ago
    Patterned Learning Career - Senior .NET Backend Engineer

    Patterned Learning Career

    (Remote)
    6 Days ago
    Social Discovery Group - Senior Backend Engineer (.NET)

    Social Discovery Group

    Tbilisi, Tbilisi, Georgia (Remote)
    1 Week ago
    Xsolla - PHP Backend Developer

    Xsolla

    Baku, Azerbaijan (Hybrid)
    4 Weeks ago
    King - Senior Unity Developer

    King

    Barcelona, Catalonia, Spain (On-Site)
    2 Weeks ago
    Passion Gaming - Back End Engineer PHP

    Passion Gaming

    Gurugram, Haryana, India (On-Site)
    5 Months ago
    Paytm - Backend - Technical Lead

    Paytm

    Noida, Uttar Pradesh, India (On-Site)
    4 Months ago

    Get notifed when new similar jobs are uploaded

    About The Company

    Bengaluru, Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    Bengaluru, Karnataka, India (Hybrid)

    View All Jobs

    Get notified when new jobs are added by Onehouse

    Level Up Your Career in Game Development!

    Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

    Job Common Plug