Lead Data Engineer

2 Months ago • 10 Years + • Data Analysis • $172,000 PA - $237,000 PA

Job Summary

Job Description

The Lead Data Engineer role involves designing and implementing Philo's data platform strategy, providing technical leadership, setting technical standards, mentoring engineers, and collaborating with cross-functional teams. This role requires designing scalable data pipelines, managing team workloads, implementing data governance, and driving technical decisions. The company is looking for a Lead Data Engineer to help them with data infrastructure challenges to support critical business functions across streaming services. You will be working closely with other engineers, data scientists, analysts, and stakeholders to build and deploy scalable data solutions that power the entire service.
Must have:
  • 10+ years of experience in data engineering
  • 3+ years leading data engineering teams
  • Expertise in AWS data services, Redshift, dbt, orchestration tools
  • Strong track record of designing and implementing data platforms
  • Excellent communication skills
Good to have:
  • Experience in media/streaming industry
  • Knowledge of data modeling and dimensional design
  • Experience with data governance and compliance
  • Background in implementing data quality frameworks
Perks:
  • Full health, dental and vision coverage for you and your family
  • 401(k) plan with employer contributions
  • Flexible working hours
  • Up to 20 weeks of fully paid parental leave
  • Unlimited paid time off for vacation and sick leave
  • $2,000 annual vacation bonus
  • $5,250 annually for professional development and educational assistance
  • $1,250 annual home office + TV stipend during first year of employment ($250 annually thereafter)
  • $500/month ($6,000/year) bonus for employees who commit to working at least 3 days per week in our offices, plus generous commuter benefits ($315/month towards transit, rideshare, bike rental, or parking at our HQ office in San Francisco)
  • Free Gympass subscription
  • Dog-friendly office

Job Details

Philo: a streaming service for TV and movie lovers

At Philo, we’re a group of technology and product people who set out to build the future of television, marrying the best in modern technology with the most compelling medium ever invented — in short, we’re building the TV experience that we’ve always wanted for ourselves. In practice this means leveraging cloud delivery, modern tech stacks, machine learning, and hand-crafted native app experiences on all of our platforms. We aim to deliver a rock solid experience on the streaming basics, while cooking up next generation multi-screen and multi-user playback experiences.

Data at Philo

Data underpins everything we do at Philo: making informed business decisions; analyzing and improving the quality of our streaming experience; running product experiments to optimize our signup flows and improve user journeys; and making it effortless for our users to find the perfect thing to watch. Philo serves over a billion streams to its users every year, generating a wealth of data that we leverage at all levels of the organization. Philo’s data pipeline processes nearly 8 trillion events per year into our petabyte scale data lake, where we run over 30k ETL and BI queries every day to bring data-driven insights to our team.

On the Data Engineering team, we’re looking for people who are comfortable working on complex data infrastructure challenges that support critical business functions across our streaming services. You’ll be working closely with other engineers, data scientists, analysts, and stakeholders to build and deploy scalable data solutions that power our entire service. In addition, you’ll work with departments across the organization to understand their data needs and deliver high-performance, reliable data systems to help the entire team thrive.

We are passionate about building robust, scalable data infrastructure and providing high-quality data infrastructure for the entire company, using both cutting-edge technologies and proven engineering practices in close collaboration with every department. To complete our work, we build on modern tools including AWS-native services, DBT, Segment, Redshift, AWS SageMaker, AWS Glue, Avo, BigEye and more.

Some of the recent projects our Data Engineering team members have worked on include data warehouse cluster upgrades, per-query infra cost optimization, implementation of Apache Iceberg data storage, and evaluating alternative data warehouse technologies.

The Role

We're seeking an experienced Lead Data Engineer to join our team at Philo. This role will be responsible for designing and implementing our long-term Data Platform Strategy while providing technical leadership to take our data engineering practices to the next level. The ideal candidate will be strongly opinionated about data stack architecture and how to enhance velocity across the entire Data Team at Philo.

Responsibilities:

  • Lead the design and implementation of Philo's data platform architecture
  • Set technical standards and best practices for data engineering work
  • Mentor and coach data engineers in best practices for data pipeline design, performance optimization, and AWS cloud services
  • Collaborate with cross-functional teams to understand data platform needs and translate business requirements into technical solutions
  • Design scalable data pipelines and infrastructure
  • Manage team workload, priorities, and delivery timelines
  • Implement data governance, security, and quality control processes
  • Drive technical decisions with a focus on long-term sustainability

Key Qualifications:

  • 10+ years of professional experience in data engineering, ideally with a few years working on high-volume data platforms
  • 3+ years of experience leading data engineering teams in cloud-native environments
  • Deep expertise in modern data stack technologies, particularly AWS data services, Redshift, dbt, orchestration tools like Airflow and Dagster, Python, and SQL
  • Strong track record of designing and implementing data platforms
  • Experience mentoring junior engineers and raising team capabilities through technical documentation and knowledge sharing
  • Excellent communication skills with technical and non-technical stakeholders, simplifying complex data concepts for various business audiences
  • Experience managing cloud-based data platforms (AWS/GCP/Azure)

Ideal Qualifications:

  • Experience in media/streaming industry with understanding of video delivery analytics and metrics
  • Knowledge of data modeling and dimensional design
  • Experience with data governance and compliance requirements
  • Background in implementing data quality frameworks

More about Philo

At Philo, we’re a company that puts people first—both our subscribers and our team. Our philosophy is to empower our colleagues to do their best work while supporting each other in pursuing shared goals. We value pragmatism, pride in our work, and passion. Transparency and openness are fundamental to our company culture. We are committed to diversity and inclusion as we grow the Philo team and shape the future of TV. We believe that a diverse set of voices and perspectives on our team enables us to innovate faster and create the best experience for our subscribers.

Philo offers access to top-rated networks, including AMC, BET, CMT, Comedy Central, Discovery, Food Network, Hallmark, HGTV, History, Investigation Discovery, Lifetime, MTV, Nickelodeon, OWN, VH1, WE tv, and more, along with groundbreaking originals and blockbuster movies included with AMC+. Our service also includes 80+ free channels and premium add-ons like STARZ and MGM+.

Our extensive library boasts over 75,000 titles, and our unlimited DVR allows users to save their favorite shows and movies for up to a year, skipping ads for a seamless viewing experience. Stream on up to three devices simultaneously, whether on your phone, tablet, laptop, or TV using Roku, Apple TV, Fire TV, Samsung TV, Android TV, Vizio TV, or Chromecast.

Philo is headquartered in San Francisco, with offices in New York and Cambridge, MA. Our leadership team includes a co-founder of Facebook and alums from Meraki and HBO, backed by NEA and industry partners like Discovery, Viacom, AMC, and A&E.

Join us at Philo and be part of a team that's shaping the future of TV!

Status: Full-time
Location: San Francisco, CA, Brooklyn, NY, Cambridge, MA, or remote
Compensation: Includes annual salary between $172K-$237K depending on experience and location, company stock options, and health benefits

We value a diverse and inclusive workplace and we welcome people of different backgrounds, experiences, skills, and perspectives. Philo is an equal opportunity employer. We believe that everyone does their best work when they are supported by each other and the company, and we offer a generous set of benefits to make sure the Philo team is happy and healthy. Here is a sampling of the benefits we offer our team:

  • Full health, dental and vision coverage for you and your family
  • 401(k) plan with employer contributions (we match 100% of deferrals up to 3% of pay and 50% of the next 2% of pay)
  • Flexible working hours
  • Up to 20 weeks of fully paid parental leave
  • Unlimited paid time off for vacation and sick leave
  • $2,000 annual vacation bonus (we pay you to take a two week vacation)
  • $5,250 annually for professional development and educational assistance
  • $1,250 annual home office + TV stipend during first year of employment ($250 annually thereafter)
  • $500/month ($6,000/year) bonus for employees who commit to working at least 3 days per week in our offices, plus generous commuter benefits ($315/month towards transit, rideshare, bike rental, or parking at our HQ office in San Francisco)
  • Free Gympass subscription — an all-in-one corporate benefit that gives employees the largest selection of gyms, studios, classes, training and wellness apps
  • Dog-friendly office
  • And much more!

For California Residents: Philo’s CCPA Notice at Collection – Employees, Applicants, Owners, Directors, Officers and Contractors

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Similar Jobs

bytedance - Finance Business Partner - Global Monetization

bytedance

San Jose, California, United States (On-Site)
2 Months ago
Sailpoint - Business Systems Analyst (Workday)

Sailpoint

Pune, Maharashtra, India (Hybrid)
1 Month ago
Philips - Systems Engineer

Philips

New Kensington, Pennsylvania, United States (On-Site)
2 Months ago
Granicus - Program Manager, Enterprise PMO

Granicus

Costa Rica (Remote)
3 Months ago
Riot Games - Senior Manager, Accounting

Riot Games

Shanghai, China (On-Site)
1 Month ago
OKX - Senior Data Scientist - Risk

OKX

San Jose, California, United States (On-Site)
1 Week ago
bytedance - Backend Software Engineer, Data Engineering

bytedance

Singapore (On-Site)
8 Months ago
Silicon Labs - Senior Data Engineer

Silicon Labs

Budapest, Hungary (On-Site)
1 Month ago
Capgemini - Business Analyst

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
Toast - Senior Security Data Engineer

Toast

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Crowd Strick - Specialist Sales Manager, NG SIEM

Crowd Strick

United Kingdom (Remote)
2 Months ago
Microsoft - Principal Product Designer

Microsoft

Mountain View, California, United States (Hybrid)
3 Months ago
Zelis  - Senior DevOps Engineer

Zelis

Hyderabad, Telangana, India (On-Site)
2 Months ago
AiDash - Senior Engineering Manager - Devops

AiDash

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Wooga - Senior/Lead Monetization Manager

Wooga

Berlin, Berlin, Germany (Hybrid)
3 Weeks ago
Riot Games - Senior Service Designer, Player Support

Riot Games

Singapore (On-Site)
3 Months ago
Passive Logic - Senior Software Verification Engineer

Passive Logic

Holladay, Utah, United States (On-Site)
2 Months ago
Sonar Source - Product Manager - Data & AI

Sonar Source

Geneva, Geneva, Switzerland (Hybrid)
1 Month ago
Flexera Software - Product Owner

Flexera Software

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
luxsoft - Test Engineer Backend

luxsoft

Serbia (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Francisco, California, United States

Apple - Asset, Infrastructure & Reliability Manager

Apple

Austin, Texas, United States (On-Site)
3 Weeks ago
Toast - Mandarin Bilingual Hawaii Emerging Markets Account Executive

Toast

Honolulu, Hawaii, United States (On-Site)
6 Months ago
Interactive Brokers - Senior Cloud Platform Engineer

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
2 Months ago
GoMotive - Account Executive, Public Sector

GoMotive

United States (Remote)
1 Week ago
Internet Brands - Marketing Project Manager

Internet Brands

El Segundo, California, United States (On-Site)
2 Months ago
GoMotive - Regional Vice President, Strategic Networks

GoMotive

United States (Remote)
2 Months ago
Snap Mobile INC - Account Executive

Snap Mobile INC

Grand Rapids, Michigan, United States (On-Site)
2 Months ago
CD PROJEKT RED - Senior QA Engineer

CD PROJEKT RED

Boston, Massachusetts, United States (Hybrid)
2 Months ago
GoMotive - Director of Strategic Accounts, Western U.S.

GoMotive

United States (Remote)
1 Week ago
Joyride Games - UI/UX Designer

Joyride Games

Palo Alto, California, United States (Remote)
1 Year ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Sleeper - Mid-Level Data Scientist / Quant - Risk & Trading

Sleeper

Las Vegas, Nevada, United States (Remote)
4 Weeks ago
Progress - Data Scientist

Progress

Sofia, Sofia City Province, Bulgaria (Hybrid)
1 Month ago
Meta - Data Engineer, Product Analytics

Meta

Los Angeles, California, United States (On-Site)
8 Months ago
zeta - Data Reliability Engineer II

zeta

Hyderabad, Telangana, India (On-Site)
9 Months ago
Rackspace Technology - Customer Data Engineer II

Rackspace Technology

India (Remote)
3 Months ago
Redhorse Corp - Data Scientist

Redhorse Corp

United States (Remote)
3 Weeks ago
Discord - Senior Financial Analyst, Business Partnership

Discord

San Francisco, California, United States (On-Site)
1 Month ago
Veeam Software - Senior Data Analyst, Talent Acquisition

Veeam Software

San José Province, Costa Rica (On-Site)
1 Week ago
Toast - Senior Data Scientist

Toast

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Go Fund Me - Staff Data Analyst

Go Fund Me

San Francisco, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Philo is building the future of television. Our product lets you watch your favorite shows on all the devices you care about, with seamless playback, insightful discovery, and effortless sharing. In short, we’re building the TV experience that we’ve always wanted for ourselves. We’re a company that puts people first — both our subscribers and our team. At Philo, our philosophy is to empower our colleagues to do their best work while supporting each other in pursuing shared goals. We value pragmatism, pride in our work, and passion.

San Francisco, California, United States (Remote)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Philo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug