Senior Software Engineer - Scala, Spark, Airflow, Python

4 Weeks ago • 5-5 Years • DevOps

Job Summary

Job Description

As a Senior Software Engineer at Nielsen, you'll be part of a DevOps team focusing on big data applications. Responsibilities include designing, coding, and testing applications deployed on AWS, developing automated tests integrated with CI/CD, troubleshooting data issues, defining future stories with product owners, building reusable code, promoting best practices, and collaborating with cross-functional teams. You'll work with Java, Python, SQL, Spark, Airflow, and various AWS services. Agile scrum experience is required. The role involves extensive coding (70% of time) and ensuring project alignment with business objectives.
Must have:
  • 5+ years software development experience
  • Strong AWS cloud expertise
  • Java(advanced), Python(intermediate), SQL(advanced)
  • Spark, Airflow experience
  • Agile scrum experience
  • CI/CD knowledge
Good to have:
  • AWS Certification

Job Details

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

As a  Software Engineer, you will be working as part of a DevOps team focusing on analyzing, developing, testing, and supporting Big Data applications. Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies

Responsibilities

    • Hands on developer to design, code, and test iteratively to support complex big data applications deployed on Cloud Infrastructure (AWS).
    • Plan, develop, execute and maintain automated unit, functional test cases; develop modular, robust, and maintainable automation scripts to integrate with CICD process.
    • Must have strong analytical and technical skills with passion to deep dive on data  in troubleshooting, devise techniques for problem resolution.
    • Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
    • Build platform reusable code and components that could be used by multiple project teams. 
    • Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
    • Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals

Key skills

    • 5+ years of hands-on software development with a bachelor’s degree in computer science, engineering or relevant field
    • Must have strong cloud Implementation expertise in cloud architecture.
    • Must have very good knowledge of storage, network, AWS(Compute services). Have sound knowledge in multi-zone, region-based designs.
    • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security. 
    • Extensive programming experience and desire to write and review code 70% of the time. 
    • Experience in software development using programming languages & tools/services: Java(advanced), Python (intermediate) and strong SQL programming (advanced).
    • Experience in big data processing tools/languages using Spark.
    • Experience with job orchestration tools: Apache Airflow or similar tools.
    • Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
    • Agile scrum experience in application development is required. 
    • Experience with cloud technologies: EC2, EKS, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
    • Demonstrates knowledge of CI/CD processes, testing frameworks,  practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, etc.)
    • AWS Certification is a plus.


Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

Similar Jobs

Paytm - Technical Security - Vulnerability Assessment

Paytm

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Intel Corporation - Talent Development for Semiconductors (Silicon Design)

Intel Corporation

Guadalajara, Jalisco, Mexico (On-Site)
1 Month ago
Zeta - Software Development Engineer in Test I / II

Zeta

Hyderabad, Telangana, India (On-Site)
3 Months ago
Qualcomm - Technical Artist, Staff - Gaming/VFX

Qualcomm

Hyderabad, Telangana, India (On-Site)
3 Months ago
Flutter International - Security Engineer III

Flutter International

Bengaluru, Karnataka, India (On-Site)
3 Months ago
PhonePe - Site Reliability Engineer - Azure

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Meta - Silicon CAD Infrastructure

Meta

Redmond, Washington, United States (On-Site)
2 Months ago
Rackspace Technology - Cloud Practice Engineer

Rackspace Technology

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Ubisoft - DevOps Linux Administrator

Ubisoft

Saint-Mandé, Île-de-France, France (Hybrid)
2 Days ago
Pixar Animation Studios - Build & Release Engineer

Pixar Animation Studios

Emeryville, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Software Engineer, Product

Meta

New York, New York, United States (Remote)
2 Months ago
Epic Games - Senior Technical Product Manager

Epic Games

(On-Site)
2 Days ago
Ubisoft - Scientifique principal en données ML _ Groupe Technologique Content Creation

Ubisoft

Montreal, Quebec, Canada (On-Site)
1 Month ago
Playrix - Lead Technical Designer

Playrix

Ukraine (Remote)
3 Months ago
BlackBerry QNX - BlackBerry QNX- Embedded Technical Writer (Automotive/General Embedded)

BlackBerry QNX

Telangana, India (On-Site)
3 Months ago
Intrepid Studios,  Inc  - Technical Quality Assurance Tester

Intrepid Studios, Inc

(Remote)
4 Months ago
Eleven Labs - Compliance Engineer

Eleven Labs

Barcelona, Catalonia, Spain (Remote)
3 Months ago
OpenGov - Director, Developer Experience

OpenGov

Atlanta, Georgia, United States (Hybrid)
3 Months ago
Meta - Silicon Architect

Meta

Austin, Texas, United States (On-Site)
2 Months ago
The Walt Disney Company - Lead Machine Learning Engineer

The Walt Disney Company

Washington, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Gurugram, Haryana, India

Simple Viral Games - Backend Developer

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Monsters Aliens Robots Zombies - 2D Machine Learning Technical Artist

Monsters Aliens Robots Zombies

India (Remote)
4 Months ago
Paytm - DevOps - Senior DevOps Engineer

Paytm

Bengaluru, Karnataka, India (Remote)
2 Months ago
CloudHire - Junior Recruiter

CloudHire

Delhi, India (Remote)
2 Months ago
HappyFox - Product Manager

HappyFox

Bengaluru, Karnataka, India (On-Site)
5 Months ago
InMobiInMobi - Chief Of Staff - People Strategy & Operations

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Microsoft - Software Engineer 2

Microsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Zeta - Sr. Site Reliability Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Aristocrat Gaming - Engineer II

Aristocrat Gaming

Gurugram, Haryana, India (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

DevOps Jobs

Patterned Learning Career - Senior .NET Backend Engineer

Patterned Learning Career

(Remote)
5 Days ago
The Walt Disney Company - Senior Systems Engineer, Data Services [Database Administration]

The Walt Disney Company

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
Dotdash Meredith - Senior Software Engineer, 1

Dotdash Meredith

Karnataka, India (On-Site)
4 Months ago
Revolgy - GCP Engineer

Revolgy

Prague, Czechia (Hybrid)
1 Month ago
Canva - Senior Software Engineer (Release Engineering/Python) - open to remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
3 Weeks ago
Luxoft - Senior DevOps Engineer (Azure)

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
PwC - ETIC, Azure Technical Support Engineer - Senior Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
3 Months ago
Microsoft - Senior Software Engineer - C++

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Week ago
Pixar Animation Studios - Build & Release Engineer

Pixar Animation Studios

Emeryville, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded