Staff Software Engineer, Data Platform

1 Month ago • 7 Years + • $217,000 PA - $303,900 PA

Job Summary

Job Description

As a Staff Software Engineer on the Data Warehouse Platform team, you will be responsible for solving large-scale data platform and efficiency challenges. You will work within and across teams to create and improve scalable, fault-tolerant, self-serve systems. The role involves building a user-friendly Data Warehouse platform, which seeks to abstract technical details away from users, and driving improved Data Warehouse efficiency. You will also be expected to contribute to the team's long-term strategy, own the data warehouse, refine and maintain offline data technologies, and mentor other engineers. This involves a deep understanding of user intent, developing clear interfaces, and building business-level abstractions on top of technologies like Kubernetes, BigQuery, and Airflow. The role requires excellent communication skills to collaborate with stakeholders across various teams.
Must have:
  • 7+ years of coding experience in production
  • Excellent communication skills with stakeholders
  • Experience with object-oriented programming languages
  • Degree in Computer Science or equivalent
  • Experience with Kubernetes, BigQuery, Airflow, etc.
  • Experience developing user-friendly platform technologies
  • Experience solving large-scale efficiency problems
Perks:
  • Comprehensive Healthcare Benefits and Income Replacement Programs
  • 401k Match
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Reddit Global Days Off
  • Generous paid Parental Leave
  • Paid Volunteer time off

Job Details

Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 101M+ daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit redditinc.com.

The Data Warehouse Platform team is looking to hire a Staff software Engineer who is excited to solve large scale data platform and efficiency challenges.

Reddit’s mission is to bring community and belonging to everyone in the world. Reddit is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communities daily, it is home to the most open and authentic conversations on the internet. From pets to parenting, skincare to stocks, there’s a community for everybody on Reddit. For more information, visit redditinc.com.

Our community of users generates over 100B analytics events per day, each of which is ingested into a data warehouse that sees 55,000+ daily queries. We utilize this data to enable both batch and streaming based data analytics at the company. Critical teams such as ads, feed generation, and ML experimentation rely on the Data Warehouse to generate revenue for Reddit.

As a staff engineer, you will work within and across teams to create and improve scalable, fault tolerant, self-serve systems. You will also create and execute a strategy to ensure a high level of end-to-end data quality and help shape the data culture across all of Reddit!

Key projects associated with this role include:

  1. Building a user-friendly Data Warehouse platform at Reddit, which seeks to abstract technical details away from users of the warehouse and enable non-technical individuals to perform data analytics in a self-service manner. This project will involve gaining a deep understanding of user intent, developing clear interfaces and contracts for the platform, and building business-level abstractions on top of Kubernetes, BigQuery, and Airflow technologies.
  2. Driving improved Data Warehouse efficiency to flatten the rate of growth for analytics expenditure at Reddit. This may include, among other tasks: developing clear frameworks for priority tiering and cost attribution, introducing retention policies and data warehousing best practices, and analyzing alternative data storage solutions for some of the company’s most intensive batch workloads.

In your day-to-day, you can expect to:

  • Contribute to developing the team and organization’s long term strategy
  • Own the data warehouse that stores 100B+ daily events and exposes them to teams across Reddit for analytics and machine learning purposes.
  • Refine and maintain our offline data technologies and associated tooling to support the analysis of hundreds of millions of users.
  • Mentor other engineers on how to design, build, and evangelize services used by hundreds of engineers across Reddit

Who you might be:

  • 7+ years of coding experience in a production setting writing clean, maintainable, and well-tested code.
  • Excellent communication skills to collaborate with stakeholders in engineering, data science, machine learning, and product.
  • Experience with object-oriented programming languages such as Go, Python, Scala, or Java.
  • Degree in Computer Science or equivalent technical field. 
  • Experience working with Kubernetes, BigQuery, Airflow, Terraform, Helm, Prometheus, Debezium, and CI/CD.
  • Experience developing user friendly platform technologies.
  • Experience solving large scale efficiency problems.

Benefits:

  • Comprehensive Healthcare Benefits and Income Replacement Programs
  • 401k Match
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Reddit Global Days Off
  • Generous paid Parental Leave  
  • Paid Volunteer time off

#LI-remote, #LI-JS5

Similar Jobs

Veeam Software - Backend Developer

Veeam Software

Seattle, Washington, United States (Remote)
1 Month ago
Adglobe - Project Manager

Adglobe

Tokyo, Japan (Hybrid)
3 Years ago
PayPal - Sr. Spark/Scala Engineer

PayPal

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
Iron Mountain - Senior Technical Delivery Architect

Iron Mountain

Truganina, Victoria, Australia (On-Site)
1 Month ago
bytedance - Backend Software Engineer - Customer Service Platform - Seattle

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

HCL Tech - Senior Developer

HCL Tech

Colorado, United States (On-Site)
2 Weeks ago
Qualcomm - Display Software Engineer, Senior Staff

Qualcomm

San Diego, California, United States (On-Site)
2 Weeks ago
PayPal - MTS 1, Machine Learning Scientist

PayPal

Bengaluru, Karnataka, India (Hybrid)
1 Week ago
Rockstar Games - Senior Data Engineer

Rockstar Games

Carlsbad, California, United States (On-Site)
1 Month ago
Version1 - Java Support Consultant

Version1

London, England, United Kingdom (On-Site)
2 Months ago
bytedance - Software Engineer Graduate (Multi Cloud CDN) - 2025 Start (BS/MS)

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
Loyalty Juggernaut - Mobile Engineer (Android)

Loyalty Juggernaut

Hyderabad, Telangana, India (On-Site)
2 Months ago
bytedance - Site Reliability Engineer, SealSuite

bytedance

Singapore (On-Site)
2 Months ago
Thales - Experienced Software Architect

Thales

Brest, Brittany, France (On-Site)
3 Weeks ago
Zazz - Java Developer

Zazz

(Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in United States

Gigamon - Territory Account Manager

Gigamon

Birmingham, Alabama, United States (On-Site)
2 Months ago
Rolls-Royce - Senior Electronics Design Engineer

Rolls-Royce

Indianapolis, Indiana, United States (Hybrid)
1 Week ago
GameChanger - Staff Backend Engineer, Video Enablement

GameChanger

United States (Remote)
2 Months ago
bytedance - Machine Learning Engineer - MLDev

bytedance

San Jose, California, United States (On-Site)
2 Months ago
Dentsu Aegis - Senior Manager, SEO

Dentsu Aegis

Detroit, Michigan, United States (Remote)
2 Weeks ago
fluence - Director, Product Management

fluence

Houston, Texas, United States (Hybrid)
3 Weeks ago
Toku - Director of Finance

Toku

United States (Remote)
1 Month ago
Ziff Davis - Events Manager, Consumer and B2B

Ziff Davis

Los Angeles, California, United States (Hybrid)
1 Month ago
ElevenLabs - Sales Development Representative

ElevenLabs

San Francisco, California, United States (Remote)
2 Months ago
UPF Industries  - Electrician Maintenance Mechanic

UPF Industries

Bartow, Florida, United States (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

France (Remote)

United States (Remote)

United States (Remote)

Vancouver, British Columbia, Canada (Remote)

India (Remote)

United Kingdom (Remote)

United States (Remote)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Reddit

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug