Community

Home >

Jobs >

Data Engineer

Karnataka, India (Hybrid)

Data Engineer

2 Weeks ago • 5-8 Years • DevOps

About the job

7 skills required for this role

Add these skills to join the top 1% applicants for this job

jenkins

spark

aws

python

sql

gitlab

team-player

Job Description

Nielsen seeks a detail-oriented Data Engineer to join their OpIntel team. Responsibilities include designing, developing, testing, and supporting complex data engineering solutions for analytical data storage (AWS Data Lake, Data Warehouse). The role involves working with various Nielsen data from TV, Digital/Internet, and Radio monitoring, collaborating with offshore team members, and building data-driven applications. This position requires expertise in AWS (DevOps, EMR, EC2), Python, SQL, and experience with data pipelines/ETL/ELT, OLAP, and S3 object store data architecture. The candidate will participate in technical planning, requirements gathering, testing, and deployment phases.

Must have:

AWS (DevOps - EMR, EC2)
Python
SQL
Data pipelines/ETL/ELT
OLAP and S3 data architecture

Good to have:

Test Automation
CICD Pipeline Development
Spark

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

Nielsen is seeking an organized, detail oriented, team player, to join the OpIntel team in the role of Data Engineer. Nielsen’s Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidates will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.

Must Have: AWS (DevOps - EMR, EC2), Python, SQL.

Qualifications:

Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus
5 years of experience in: software development technology using Python and SQL to write data pipelines/ETL/ELT, designing OLAP and S3 object store data architecture
3 years of experience with/in: AWS DevOps, Python,Spark
Some experience with/in: Test Automation, CICD Pipeline Development

Roles and Responsibilities

Design, develop, test and support highly complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse) by providing necessary design and technical expertise.
Understand the big picture in an End-to-End data environment and understand upstream system data and downstream consumption requirements.
Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
Work on AWS cloud infrastructure in a DevOps capacity, including automating the deployment and scaling of EMR, EC2, S3.
Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation.
Demonstrate development best practices to guarantee the quality and sustainability of software deliverables.
Support Testing and UAT phases and participate in Deployment.
As a Software Engineer on Nielsen Engineering’s OpIntel Team, you will be part of a collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members in the software development lifecycle process.
You will be designing and building complex data-driven applications and processes that help
to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.

Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%