Open Source Engineer

1 Year ago • 3 Years +

Job Summary

Job Description

Onehouse is looking for an Open Source Engineer to troubleshoot, resolve and analyze Apache Hudi issues. The role involves providing best practices guidance, contributing to automation and tooling, and collaborating with the engineering team. The engineer will also identify and contribute to bug fixes, evangelize Apache Hudi, and participate in on-call rotations. This role offers an opportunity to become a leader in the data community. Responsibilities include troubleshooting, code-level analysis, providing guidance on performance and usage of Apache Hudi, helping the Engineering/Product Team with detailed troubleshooting guides, contributing to automation and tooling programs and contributing to open source project.
Must have:
  • 3+ years of experience working directly with customers on technical engagements.
  • 3+ years of experience with major cloud providers like AWS, GCP, or Azure.
  • Strong verbal and writing communication skills with a track record of simplifying technical explanations.
  • 3+ years of deep experience with Apache Spark and knowledge on Spark’s runtime internals.
  • Hand-on technical experience building, operating, and troubleshooting data engineering pipelines.
  • Working knowledge of modern data tools and frameworks like Apache Spark, Kafka, Flink, Presto/Trino, Hive, DBT, Airflow, Parquet, Avro, ORC.
  • Familiarity with some cloud data services like EMR, Redshift, Kinesis, Glue, Dataproc, BigQuery, Databricks, HDInsight, Synapse.
  • Ability to collaborate with multiple stakeholders internally and externally.
Good to have:
  • Experience with modern data lakehouse technologies like Apache Hudi, Iceberg or Delta Lake.
  • Experience in contributing to an open source project.
Perks:
  • Equity Compensation
  • Health & Well-being reimbursement up to 20,000 INR for insurance premium.
  • Financial Future with provident fund contribution.
  • Remote-friendly company, with some roles subject to in-person requirements.
  • Unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 17 paid company holidays
  • Weekly lunch stipend, in-office snacks/drinks
  • Equipment provided, and a one-time $500 (USD) stipend for office/desk setup
  • 26 weeks off for birthing and 12 weeks for surrogate and adoptive parents - fully paid

Job Details

About Onehouse Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver the industry’s most interoperable data lakehouse through a cloud-native managed service built on Apache Hudi. Onehouse enables organizations to ingest data at scale with minute-level freshness, centrally store it, and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML). We are a team of self-driven, inspired, and seasoned builders that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off a fresh $35M Series B backed by Craft, Greylock and Addition Ventures, we're now at $68M total funding and looking for rising talent to grow with us and become future leaders of the team. Come help us build the world's best fully managed and self-optimizing data lake platform! The Community You Will Join When you join Onehouse, you're joining a team of passionate professionals tackling the deeply technical challenges of building a 2-sided engineering product. As the founding member of our solutions support team, you will have a large impact on the direction of our product. The solutions engineering team is the critical first line of defense to keeping our customers happy, directly interacting with the community to hear the pain points, challenges and opportunities to grow the projects. We envision this role with a strong growth opportunity to step up and build a support team as we grow. Onehouse is fundamentally dedicated to evolving and uplifting the open source community, and your role will enable you to become a leader and influencer in the broader data community as a whole. A Typical Day:
  • Troubleshoot, resolve and suggest deep code-level analysis of Apache Hudi with Spark and Flink to address complex issues raised by OpenSource user/Onehouse customer
  • Provide best practices guidance around Apache Hudi runtime performance and usage of Apache Hudi core libraries and APIs for custom-built solutions
  • Help the Engineering/Product Team with detailed troubleshooting guides and runbook
  • Contribute to automation and tooling programs to make daily troubleshooting efficient.
  • Work with the Data Engineers and Engineering Team and spread awareness of upcoming features and releases.
  • Identify Apache Hudi bugs /contribute possible workarounds
  • Evangelize Apache Hudi and expand its ecosystem by open source contributions to Hudi integrations with other open source projects in this space.
  • Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests
  • Participate in weekly on call rotation to help the Open source community.Deliver advanced technical and operational support for open-source users and customers.
  • Triage, escalate, and resolve issues with a sense of urgency and commitment to and deliver advanced technical and operational support for open-source users and customers.
What You Bring to the Table:
  • 3+ years of experience working directly with customers on technical engagements.
  • 3+ years of experience with major cloud providers like AWS, GCP or Azure.
  • Strong verbal and writing communication skills with a track record of simplifying technical explanations.
  • 3+ years of deep experience with Apache Spark and knowledge on Spark’s runtime internals, query tuning, performance tuning, troubleshooting and debugging Spark solutions.
  • Hand-on technical experience building, operating, and troubleshooting data engineering pipelines.
  • Working knowledge of a few modern data tools and frameworks like Apache Spark, Kafka, Flink, Presto/Trino, Hive, DBT, Airflow, Parquet, Avro, ORC.
  • Familiarity with some cloud data services like EMR, Redshift, Kinesis, Glue, Dataproc, BigQuery, Databricks, HDInsight, Synapse.
  • Ability to collaborate with multiple stakeholders internally and externally.
Nice to haves (but not required):
  • Experience with modern data lakehouse technologies like Apache Hudi, Iceberg or Delta Lake.
  • Experience in contributing to an open source project.
How We'll Take Care of You -Equity Compensation; our success is your success with eligible participation in our company equity plan - Health & Well-being; we'll invest in your physical and mental well-being by reimbursing up to 20,000 INR for your monthly insurance premium - Financial Future; we'll invest in your financial well-being by making this role eligible for the provident fund of which Onehouse will contribute up to 1800 INR/month - Location; we are a remote-friendly company (internationally distributed across N. America + India), though some roles will be subject to in-person requirements in alignment with the needs of the business - Generous Time Off; unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 17 paid company holidays - Food & Meal Allowance; weekly lunch stipend, in-office snacks/drinks - Equipment; we'll provide you with the equipment you need to be successful and a one-time $500 (USD) stipend for your initial office/desk setup - Child Bonding!; 26 weeks off for birthing and 12 weeks for surrogate and adoptive parents - fully paid so you can focus your energy on your newest addition House Values One Team Optimize for the company, your team, self - in that order. We may fight long and hard in the trenches, take care of your co-workers with empathy. We give more than we take to build the one house, that everyone dreams of being part of. Tough & Persevering We are building our company in a very large, fast-growing but highly competitive space. Life will get tough sometimes. We take hardships in the stride, be positive, focus all energy on the path forward and develop a champion's mindset to overcome odds. Always day one! Keep Making It Better Always Rome was not built in a day; If we can get 1% better each day for one year, we'll end up thirty-seven times better. This means being organized, communicating promptly, taking even small tasks seriously, tracking all small ideas, and paying it forward. Think Big, Act Fast We have tremendous scope for innovation, but we will still be judged by impact over time. Big, bold ideas still need to be strategized against priorities, broken down, set in rapid motion, measure, refine, repeat. Great execution is what separates promising companies from proven unicorns. Be Customer Obsessed Everyone has the responsibility to drive towards the best experience for the customer, be an OSS user or a paid customer. If something is broken, own it, say something, do something; never ignore. Be the change that you want to see in the company.

Similar Jobs

Ziff Davis - Sr. Data Engineer

Ziff Davis

Malaga, Western Australia, Australia (Remote)
4 Months ago
buildstsaff - Full Stack Developer

buildstsaff

Irvine, California, United States (On-Site)
6 Years ago
Microsoft - Azure Data & AI Specialist

Microsoft

(On-Site)
2 Weeks ago
Egnyte - Staff Software Engineer

Egnyte

Mountain View, California, United States (Hybrid)
5 Months ago
OLIVER Agency - GenAI Strategist (BAIS)

OLIVER Agency

Manila, Metro Manila, Philippines (Hybrid)
1 Day ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Enphase Energy - Data Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Egnyte - DevOps Engineer

Egnyte

India (Remote)
2 Months ago
Inworld AI - IT Security & Compliance Lead

Inworld AI

Mountain View, California, United States (Hybrid)
1 Month ago
Ness Digital - Big Data Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
1 Month ago
The Walt Disney Company - Principal Machine Learning Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
2 Weeks ago
Netflix - Data Engineer 5 - Playback

Netflix

United States (Remote)
2 Weeks ago
Everyday Health Group - UX Designer - Lose It!

Everyday Health Group

United States (Remote)
4 Weeks ago
PwC - L&D Senior Associate

PwC

Makati, Metro Manila, Philippines (On-Site)
7 Months ago
Rackspace Technology - Principal MLOps Engineer

Rackspace Technology

Toronto, Ontario, Canada (Remote)
1 Month ago
Syniverse - Lead Quality Assurance

Syniverse

Bengaluru, Karnataka, India (Hybrid)
8 Hours ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Assystems - Structure Design Coordinator

Assystems

Indore, Madhya Pradesh, India (On-Site)
6 Months ago
Google - EDA/CAD Custom Tool Development Engineer

Google

Bengaluru, Karnataka, India (On-Site)
3 Days ago
KPIT - Connected Vehicle_Diplay Driver Engineer

KPIT

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Sportskeeda - Content Writer - College Basketball/NBA & WNBA

Sportskeeda

India (On-Site)
3 Weeks ago
Sitetracker - People Ops Generalist

Sitetracker

Bengaluru, Karnataka, India (Hybrid)
1 Year ago
Google - Content Strategist, Multimodal Content, gTech Ad Customer Support

Google

Hyderabad, Telangana, India (On-Site)
1 Week ago
PwC - Manager

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
Mindtickle - Demand Generation Manager - II

Mindtickle

Pune, Maharashtra, India (Hybrid)
1 Month ago
Boomi - Principal Software Engineer - Domain Architect

Boomi

India (On-Site)
1 Day ago
YouGov - Verbatim Analyst Executive

YouGov

Bengaluru, Karnataka, India (On-Site)
10 Hours ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Sunnyvale, California, United States (Hybrid)

Sunnyvale, California, United States (Hybrid)

Sunnyvale, California, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Sunnyvale, California, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Onehouse

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug