Sr Data Engineer - Data Activation & Sharing

1 Month ago • 5 Years + • Data Analyst

About the job

Job Description

The Sr. Data Engineer will join the Data Activation team, responsible for securely sharing data with internal and external partners. Responsibilities include interfacing with stakeholders, designing data models and ETLs, working with big data technologies (Spark, Snowflake), writing test scripts and automating processes, participating in code reviews and scrum meetings, ensuring QA sign-off, providing post-go-live support, and contributing to the product sign-off process. The role requires strong SQL skills, experience with distributed systems (Spark), cloud databases (Snowflake preferred), AWS technologies (S3 minimum), and data integration tools (Airflow).
Must have:
  • 5+ years data engineering experience
  • Strong SQL skills
  • Spark (Databricks, Scala/Python)
  • Snowflake experience
  • AWS (S3 minimum)
  • Data integration tools (Airflow)
Good to have:
  • Master's Degree
  • Experience with other cloud databases (Redshift, BigQuery)

Job Summary:

About Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming our media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to enhance flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working here:

  • Building the future of Disney’s media: DE&E Technologists are designing and building the infrastructure that will power our media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

We are looking for a Sr. Data Engineer to join the Data Activation team who can operate across the enterprise to ensure on-time, high-quality delivery of products and features that directly drive our business.

The Data Activation team, within the Product & Data Engineering business unit, is responsible for sharing data with internal customers and external 3rd party partners in a secure and reliable fashion, ensuing that “chain-of-custody” of our sensitive data is maintained at every step of the process.

Responsibilities                   

  • Interfacing with the key stakeholders to understand the business requirements

  • Designing and developing necessary data models, ETL's, reports, etc. as per requirements

  • Working with big data technologies such as Spark and cloud database technologies like Snowflake

  • Writing test scripts and automating where possible (using tools such as but not limited to Pyspark, bash scripting, python)

  • Participating in code reviews

  • Ensuring code is checked in as per company guidelines

  • Participating in weekly scrum meetings and daily stand up meetings

  • Contributing to ensure correct status in burn down charts

  • Ensuring QA sign off is obtained, fix any bugs as discovered

  • Supporting product signoff process and fix any issues / bugs discovered

  • Providing post go-live support for addressing any P1 issues

Preferred Qualifications

  • 5+ years of data engineering experience developing large data pipelines

  • Strong SQL skills and ability to create queries to extract data and build performant datasets

  • Hands-on experience with distributed systems such as Spark (via Databricks using Scala or Python) to query and process data.  

  • Experience with at least one major MPP (elastic map reduce) or cloud database technology (Snowflake, Redshift, Big Query).  Snowflake experience is strongly preferred.

  • Experience with AWS Cloud technologies (S3 at a minimum)

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

Required Education

  • Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience.

  • Master’s Degree a plus

Additional Information

#DISNEYTECH


The hiring range for this position in New York, NY is $138,900 to $186,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
View Full Job Description
$138.9K - $186.2K/yr (Outscal est.)
$162.6K/yr avg.
New York, New York, United States

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Minato City, Tokyo, Japan (On-Site)

Minato City, Tokyo, Japan (On-Site)

Orange, California, United States (On-Site)

Vancouver, British Columbia, Canada (Hybrid)

Lake Buena Vista, Florida, United States (On-Site)

Minato City, Tokyo, Japan (On-Site)

Lake Buena Vista, Florida, United States (On-Site)

Santa Monica, California, United States (On-Site)

Munich, Bavaria, Germany (On-Site)

Celebration, Florida, United States (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Similar Jobs

Luxoft - JIRA Developer

Luxoft, United States (On-Site)

Anavation - Lead Systems Engineer/Architect

Anavation, United States (On-Site)

Gaming Innovation Group  - Infrastructure Engineer

Gaming Innovation Group , (Hybrid)

DAZN - Senior Linux Engineer

DAZN, India (On-Site)

Eightfold - Lead Engineer- Backend

Eightfold, India (Hybrid)

Wargaming - Game Data Analyst (World of Tanks)

Wargaming, Lithuania (On-Site)

Inxite Out - Data Scientist II

Inxite Out, India (Hybrid)

Luxoft - Data Engineer

Luxoft, India (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PlayStation Global - Production Operations Engineer

PlayStation Global, United States (Hybrid)

Saviynt - Engineer, CloudOps

Saviynt, United States (On-Site)

Publicis Groupe - Specialist Infrastructure - Azure

Publicis Groupe, India (On-Site)

Wizcorp - Unreal Engine Programmer

Wizcorp, Japan (Remote)

The Walt Disney Company - Sr Systems Engineer

The Walt Disney Company, United States (On-Site)

Take-Two Interactive - Senior Site Reliability Engineer

Take-Two Interactive, Canada (Hybrid)

Luxoft - Functional Calypso Analyst

Luxoft, Saudi Arabia (On-Site)

Playrix - Lead QA Engineer (Resources Team)

Playrix, Montenegro (Remote)

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Netflix - Finance Program Manager

Netflix, United States (Hybrid)

Eleven Labs - Commercial Account Executive

Eleven Labs, United States (Remote)

Eleven Labs - AI Safety Engineer

Eleven Labs, United States (Remote)

Match Group - Senior Platform Engineer

Match Group, United States (Hybrid)

WebMD - Associate Editor, Oncology

WebMD, United States (On-Site)

Netflix - Machine Learning Engineer

Netflix, United States (On-Site)

Epic Games - Lead Level Designer

Epic Games, United States (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Avalanche Studios Group - Senior Analytics Engineer

Avalanche Studios Group, Sweden (On-Site)

The Walt Disney Company - Associate Manager, Consumer Insights

The Walt Disney Company, Hong Kong (On-Site)

Brightly Software - Lead Data Scientist

Brightly Software, India (On-Site)

Unity - Program Manager Customer Success Analytics

Unity, United Kingdom (On-Site)

EY - GCR UK - Advanced Analyst

EY, India (On-Site)

Publicis Groupe - Digital Analyst

Publicis Groupe, New Zealand (On-Site)

Luxoft - Senior Data Engineer

Luxoft, (Remote)

Patreon - Staff Data Scientist, Growth

Patreon, United States (Hybrid)

Maersk Careers - Senior Data Engineer

Maersk Careers, India (On-Site)

Get notifed when new similar jobs are uploaded