Sr Data Engineer - Data Activation & Sharing

3 Months ago • 5 Years + • Data Analyst • $138,900 PA - $186,200 PA

Job Summary

Job Description

The Sr. Data Engineer will join the Data Activation team, responsible for securely sharing data with internal and external partners. Responsibilities include interfacing with stakeholders, designing data models and ETLs, working with big data technologies (Spark, Snowflake), writing test scripts and automating processes, participating in code reviews and scrum meetings, ensuring QA sign-off, providing post-go-live support, and contributing to the product sign-off process. The role requires strong SQL skills, experience with distributed systems (Spark), cloud databases (Snowflake preferred), AWS technologies (S3 minimum), and data integration tools (Airflow).
Must have:
  • 5+ years data engineering experience
  • Strong SQL skills
  • Spark (Databricks, Scala/Python)
  • Snowflake experience
  • AWS (S3 minimum)
  • Data integration tools (Airflow)
Good to have:
  • Master's Degree
  • Experience with other cloud databases (Redshift, BigQuery)

Job Details

Job Summary:

About Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming our media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to enhance flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working here:

  • Building the future of Disney’s media: DE&E Technologists are designing and building the infrastructure that will power our media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

About The Role

We are looking for a Sr. Data Engineer to join the Data Activation team who can operate across the enterprise to ensure on-time, high-quality delivery of products and features that directly drive our business.

The Data Activation team, within the Product & Data Engineering business unit, is responsible for sharing data with internal customers and external 3rd party partners in a secure and reliable fashion, ensuing that “chain-of-custody” of our sensitive data is maintained at every step of the process.

Responsibilities                   

  • Interfacing with the key stakeholders to understand the business requirements

  • Designing and developing necessary data models, ETL's, reports, etc. as per requirements

  • Working with big data technologies such as Spark and cloud database technologies like Snowflake

  • Writing test scripts and automating where possible (using tools such as but not limited to Pyspark, bash scripting, python)

  • Participating in code reviews

  • Ensuring code is checked in as per company guidelines

  • Participating in weekly scrum meetings and daily stand up meetings

  • Contributing to ensure correct status in burn down charts

  • Ensuring QA sign off is obtained, fix any bugs as discovered

  • Supporting product signoff process and fix any issues / bugs discovered

  • Providing post go-live support for addressing any P1 issues

Preferred Qualifications

  • 5+ years of data engineering experience developing large data pipelines

  • Strong SQL skills and ability to create queries to extract data and build performant datasets

  • Hands-on experience with distributed systems such as Spark (via Databricks using Scala or Python) to query and process data.  

  • Experience with at least one major MPP (elastic map reduce) or cloud database technology (Snowflake, Redshift, Big Query).  Snowflake experience is strongly preferred.

  • Experience with AWS Cloud technologies (S3 at a minimum)

  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

Required Education

  • Bachelor’s Degree in Computer Science, Information Systems or related field, or equivalent work experience.

  • Master’s Degree a plus

Additional Information

#DISNEYTECH


The hiring range for this position in New York, NY is $138,900 to $186,200 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Similar Jobs

Luxoft - JIRA Developer

Luxoft

Plano, Texas, United States (On-Site)
3 Months ago
Anavation - Lead Systems Engineer/Architect

Anavation

Reston, Virginia, United States (On-Site)
4 Months ago
Gaming Innovation Group  - Infrastructure Engineer

Gaming Innovation Group

(Hybrid)
2 Months ago
DAZN - Senior Linux Engineer

DAZN

Hyderabad, Telangana, India (On-Site)
4 Months ago
Eightfold - Lead Engineer- Backend

Eightfold

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
PwC - Senior (Manager) Kwantitatief Consultant Pensioen

PwC

Amsterdam, North Holland, Netherlands (Hybrid)
4 Months ago
Wargaming - Game Data Analyst (World of Tanks)

Wargaming

Vilnius, Vilnius County, Lithuania (On-Site)
3 Months ago
Inxite Out - Data Scientist II

Inxite Out

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Luxoft - Data Engineer

Luxoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PlayStation Global - Production Operations Engineer

PlayStation Global

Carlsbad, California, United States (Hybrid)
3 Months ago
Zynga - Senior Software Engineer (Backend) - Gram Games

Zynga

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
Saviynt - Engineer, CloudOps

Saviynt

Atlanta, Georgia, United States (On-Site)
4 Months ago
Publicis Groupe - Specialist Infrastructure - Azure

Publicis Groupe

Gurugram, Haryana, India (On-Site)
4 Months ago
Wizcorp - Unreal Engine Programmer

Wizcorp

Tokyo, Japan (Remote)
4 Months ago
The Walt Disney Company - Sr Systems Engineer

The Walt Disney Company

Orlando, Florida, United States (On-Site)
3 Months ago
Take-Two Interactive - Senior Site Reliability Engineer

Take-Two Interactive

Vancouver, British Columbia, Canada (Hybrid)
2 Months ago
Vimeo - Sr. Application Security Engineer

Vimeo

Bengaluru, Karnataka, India (Remote)
4 Months ago
Luxoft - Functional Calypso Analyst

Luxoft

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
3 Months ago
Playrix - Lead QA Engineer (Resources Team)

Playrix

Montenegro (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Netflix - Finance Program Manager

Netflix

Los Gatos, California, United States (Hybrid)
3 Months ago
Eleven Labs - Commercial Account Executive

Eleven Labs

Boston, Massachusetts, United States (Remote)
4 Months ago
WebFX - Digital Marketing Specialist - Account Manager- Ft Myers, FL

WebFX

Fort Myers, Florida, United States (On-Site)
4 Months ago
Eleven Labs - AI Safety Engineer

Eleven Labs

New York, New York, United States (Remote)
4 Months ago
Match Group - Senior Platform Engineer

Match Group

New York, New York, United States (Hybrid)
4 Months ago
WebMD - Associate Editor, Oncology

WebMD

Newark, New Jersey, United States (On-Site)
3 Months ago
Meta - Harmful Content Project Manager, Integrity Operations

Meta

Washington, District Of Columbia, United States (On-Site)
3 Months ago
ByteDance - Senior Software Engineer - Development Infrastructure Team

ByteDance

Mountain View, California, United States (On-Site)
3 Months ago
Netflix - Machine Learning Engineer

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
Epic Games - Lead Level Designer

Epic Games

Cary, North Carolina, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Avalanche Studios Group - Senior Analytics Engineer

Avalanche Studios Group

Stockholm, Stockholm County, Sweden (On-Site)
3 Months ago
The Walt Disney Company - Associate Manager, Consumer Insights

The Walt Disney Company

Hong Kong (On-Site)
3 Months ago
Brightly Software - Lead Data Scientist

Brightly Software

Noida, Uttar Pradesh, India (On-Site)
4 Months ago
Captions - Machine Learning Engineering, Training Data Infrastructure

Captions

San Francisco, California, United States (On-Site)
3 Months ago
Unity - Program Manager Customer Success Analytics

Unity

Brighton And Hove, England, United Kingdom (On-Site)
5 Months ago
EY - GCR UK - Advanced Analyst

EY

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Publicis Groupe - Digital Analyst

Publicis Groupe

New Zealand (On-Site)
3 Months ago
Luxoft - Senior Data Engineer

Luxoft

(Remote)
3 Months ago
Patreon - Staff Data Scientist, Growth

Patreon

San Francisco, California, United States (Hybrid)
5 Months ago
Maersk Careers - Senior Data Engineer

Maersk Careers

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

From classic animated features and exhilarating theme park attractions to cutting edge sports coverage, and the hottest shows on television, The Walt Disney Company has been making magic since 1923, creating unforgettable stories that connect with audiences around the world. And we’re just getting started!

The key to our success…. The Cast, Crew, Imagineers and Employees who honor Disney’s rich legacy by stretching the bounds of imagination to create the never-before-seen, bringing unparalleled entertainment experiences to people of all ages. Begin a career that delivers unparalleled creative content and experiences to audiences around the world and just imagine the stories you could be part of…

What is #LifeAtDisney like? It’s a series of magical moments with cast members and employees developing and telling our stories in the most innovative ways. Whether it’s a day spent as a Disney VoluntEAR, or celebrating the release of a new interactive experience, retail product or movie, our days are filled with the knowledge that we are creating entertainment experiences the whole family can enjoy. Follow @DisneyCareers on Facebook, Twitter and Instagram for a peek behind-the-curtain, and discover how you could connect to a world of stories with Disney!

Burbank, California, United States (On-Site)

Burbank, California, United States (On-Site)

Los Angeles, California, United States (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

Hong Kong (On-Site)

Amsterdam, North Holland, Netherlands (On-Site)

Minato City, Tokyo, Japan (On-Site)

Minato City, Tokyo, Japan (On-Site)

View All Jobs

Get notified when new jobs are added by The Walt Disney Company

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug