Community

Home >

Jobs >

Data Engineer

Karnataka, India (Hybrid)

Data Engineer

2 Months ago • 5-8 Years • Research & Development • DevOps • Undisclosed

About the job

7 skills required for this role

Add these skills to join the top 1% applicants for this job

jenkins

spark

aws

python

sql

gitlab

team-player

Job Description

Nielsen's OpIntel team seeks a detail-oriented Data Engineer to design, develop, test, and support complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse). This role involves understanding end-to-end data environments, working with upstream and downstream systems, and adopting standard platform tools (GitLab, Airflow, Jenkins). The successful candidate will work with AWS cloud infrastructure in a DevOps capacity, automating deployment and scaling of EMR, EC2, and S3. Responsibilities include participating in technical planning, requirements gathering, and supporting testing and UAT phases. The role involves close collaboration with offshore team members and contributes to ensuring the accuracy of Nielsen's TV, Digital/Internet, and Radio measuring systems.

Must have:

Python & SQL for data pipelines
OLAP & S3 data architecture design
AWS DevOps experience
Spark experience
Software development & testing

Good to have:

Test Automation
CI/CD Pipeline Development

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

Nielsen is seeking an organized, detail oriented, team player, to join the OpIntel team in the role of Data Engineer. Nielsen’s Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidates will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.

Qualifications:

Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus
5 years of experience in: software development technology using Python and SQL to write data pipelines/ETL/ELT, designing OLAP and S3 object store data architecture
3 years of experience with/in: AWS DevOps, Python,Spark
Some experience with/in: Test Automation, CICD Pipeline Development

Roles and Responsibilities

Design, develop, test and support highly complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse) by providing necessary design and technical expertise.
Understand the big picture in an End-to-End data environment and understand upstream system data and downstream consumption requirements.
Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
Work on AWS cloud infrastructure in a DevOps capacity, including automating the deployment and scaling of EMR, EC2, S3.
Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation.
Demonstrate development best practices to guarantee the quality and sustainability of software deliverables.
Support Testing and UAT phases and participate in Deployment.
As a Software Engineer on Nielsen Engineering’s OpIntel Team, you will be part of a collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members in the software development lifecycle process.
You will be designing and building complex data-driven applications and processes that help
to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.

Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%