Data Engineer

3 Months ago • 5-8 Years • Research & Development • DevOps

Job Summary

Job Description

Nielsen's OpIntel team seeks a detail-oriented Data Engineer to design, develop, test, and support complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse). This role involves understanding end-to-end data environments, working with upstream and downstream systems, and adopting standard platform tools (GitLab, Airflow, Jenkins). The successful candidate will work with AWS cloud infrastructure in a DevOps capacity, automating deployment and scaling of EMR, EC2, and S3. Responsibilities include participating in technical planning, requirements gathering, and supporting testing and UAT phases. The role involves close collaboration with offshore team members and contributes to ensuring the accuracy of Nielsen's TV, Digital/Internet, and Radio measuring systems.
Must have:
  • Python & SQL for data pipelines
  • OLAP & S3 data architecture design
  • AWS DevOps experience
  • Spark experience
  • Software development & testing
Good to have:
  • Test Automation
  • CI/CD Pipeline Development

Job Details

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

Nielsen is seeking an organized, detail oriented, team player, to join the OpIntel team in the role of Data Engineer. Nielsen’s Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidates will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.

Qualifications:

    • Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus
    • 5 years of experience in: software development technology using Python and SQL to write data pipelines/ETL/ELT, designing OLAP and S3 object store data architecture
    • 3 years of experience with/in: AWS DevOps, Python,Spark
    • Some experience with/in: Test Automation, CICD Pipeline Development

Roles and Responsibilities

    • Design, develop, test and support highly complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse) by providing necessary design and technical expertise.
    • Understand the big picture in an End-to-End data environment and understand upstream system data and downstream consumption requirements.
    • Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
    • Work on AWS cloud infrastructure in a DevOps capacity, including automating the deployment and scaling of EMR, EC2, S3.
    • Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation.
    • Demonstrate development best practices to guarantee the quality and sustainability of software deliverables.
    • Support Testing and UAT phases and participate in Deployment.
    • As a Software Engineer on Nielsen Engineering’s OpIntel Team, you will be part of a collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members in the software development lifecycle process.
    • You will be designing and building complex data-driven applications and processes that help
    • to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.
Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

Similar Jobs

HP - Identity and Access Management Engineer

HP

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - IN-Senior Associate_React Developer_Data &Analytics_Advisory_PAN India

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Sporty Group - QA Automation Engineer

Sporty Group

(Remote)
7 Months ago
Luxoft - Regular BSP Developer

Luxoft

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
CloudLinux - Lead SDET/QA Automation Engineer at CloudLinux (worldwide remote, work anywhere)

CloudLinux

Bucharest, Bucharest, Romania (Remote)
3 Months ago
Google - CPU Design Verification Engineer, Google Cloud

Google

(On-Site)
2 Months ago
Fabric - Principal Design Verification Engineer (contract)

Fabric

Santa Clara, California, United States (On-Site)
4 Months ago
Fluence - Chief Battery Energy Storage System (BESS) Engineer

Fluence

Erlangen, Bavaria, Germany (Hybrid)
4 Months ago
Tencent - Senior Staff Researcher

Tencent

Palo Alto, California, United States (On-Site)
3 Months ago
Cirrus Logic - Summer Intern, Analog Design Engineer

Cirrus Logic

Chandler, Arizona, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Bluevine - Senior QA Automation Engineer

Bluevine

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
2 Months ago
Forescout Technologies  Inc  - QA Engineer

Forescout Technologies Inc

Ottawa, Ontario, Canada (On-Site)
2 Months ago
Warner Bros Discovery - Software Engineer II - Platform Engineering

Warner Bros Discovery

Stockholm, Stockholm County, Sweden (Hybrid)
2 Months ago
Luxoft - Regular Front-End Developer (with DevOps experience)

Luxoft

Mexico City, Mexico City, Mexico (Remote)
2 Months ago
Smarsh - Senior Platform Engineer

Smarsh

India (Hybrid)
3 Months ago
Riot Games - Senior QA Engineer - VALORANT, Foundations Engine

Riot Games

Sydney, New South Wales, Australia (On-Site)
8 Months ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
2 Months ago
Flow - Staff Software Development Engineer in Test

Flow

New York, New York, United States (Hybrid)
4 Months ago
Luxoft - Senior Android Engineer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Myntra - Manager - FP&A (Finance Analytics, Automation & Planning)

Myntra

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Armor Defense - Software Test Engineer II

Armor Defense

Pune, Maharashtra, India (On-Site)
4 Months ago
Paytm - Team Lead- Compensation & Benefit (HR)

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Applied Materials - Reward Operations

Applied Materials

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Assystems - Sr Structural engineer-bridge

Assystems

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Smaaash Entertainment   - Gaming Attendant

Smaaash Entertainment

Hyderabad, Telangana, India (On-Site)
4 Months ago
Myntra - Manager - Buying

Myntra

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Nielsen Holdings - Data Engineer-AM-TECH-DA-020

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
3 Months ago
Google - Engineering Manager, Information Retrieval

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Wariah Design Studios - Interior Design Intern

Wariah Design Studios

Navi Mumbai, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Cadence - Lead FrontEnd Methodology Engineer

Cadence

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Google - Software Engineer III, GPU Accelerator, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
3 Months ago
Meta - Research Scientist, Machine Learning (PhD)

Meta

Menlo Park, California, United States (On-Site)
3 Months ago
Zoox - Senior/Staff Software Engineer - Trajectory Generation

Zoox

Foster City, California, United States (Hybrid)
3 Months ago
Riot Games - Principal Software Engineer, Product Tech-Lead - Unpublished R&D Product

Riot Games

Dublin, County Dublin, Ireland (On-Site)
2 Months ago
Marvell - Design Verification, Senior Staff Engineer

Marvell

Toronto, Ontario, Canada (On-Site)
6582 Years ago
Google - Staff Software Engineer, Google Cloud

Google

Pune, Maharashtra, India (On-Site)
3 Months ago
Samsung Semiconductor - Senior Manager, Software Product Owner -AI/HPC

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Months ago
Zoox - Senior/Staff Software Engineer - Simulation C++ Framework

Zoox

Seattle, Washington, United States (Hybrid)
3 Months ago
ByteDance - Software Engineer, Architecture and Infrastructure

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Mexico City, Mexico City, Mexico (Remote)

Mexico City, Mexico City, Mexico (Remote)

Mexico City, Mexico City, Mexico (Remote)

New York, New York, United States (Remote)

Bengaluru, Karnataka, India (Hybrid)

Chicago, Illinois, United States (Remote)

United States (Remote)

View All Jobs

Get notified when new jobs are added by Nielsen Holdings

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug