Jobs

Scholarships

Courses

Companies

Placements

Community

Home >

Jobs >

Senior Software Engineer - Scala, Spark, Airflow, Python

Maharashtra, India (Hybrid)

Senior Software Engineer - Scala, Spark, Airflow, Python

11 Hours ago • 5-5 Years • DevOps

About the job

15 skills required for this role

Add these skills to join the top 1% applicants for this job

python

spark

scala

aws

java

shell

jenkins

ci-cd

sonarqube

unix

sql

json

terraform

linux

junit

Job Description

As a Senior Software Engineer at Nielsen, you'll be part of a DevOps team focusing on big data applications. Responsibilities include designing, coding, and testing applications deployed on AWS; developing and maintaining automated tests integrated with CI/CD; troubleshooting data issues; collaborating with product owners and tech leads; building reusable code components; promoting best practices; and working with cross-functional teams. You'll use Java, Python, SQL, Spark, Airflow, and various AWS services (EC2, EKS, S3, Lambda, etc.). Agile methodologies are employed.

Must have:

5+ years software development experience
Strong AWS cloud expertise
Java (advanced), Python (intermediate), SQL (advanced)
Spark, Airflow experience
Agile Scrum experience

Good to have:

AWS Certification

At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.

As a Software Engineer, you will be working as part of a DevOps team focusing on analyzing, developing, testing, and supporting Big Data applications. Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies

Responsibilities

Hands on developer to design, code, and test iteratively to support complex big data applications deployed on Cloud Infrastructure (AWS).
Plan, develop, execute and maintain automated unit, functional test cases; develop modular, robust, and maintainable automation scripts to integrate with CICD process.
Must have strong analytical and technical skills with passion to deep dive on data in troubleshooting, devise techniques for problem resolution.
Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
Build platform reusable code and components that could be used by multiple project teams.
Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals

Key skills

5+ years of hands-on software development with a bachelor’s degree in computer science, engineering or relevant field
Must have strong cloud Implementation expertise in cloud architecture.
Must have very good knowledge of storage, network, AWS(Compute services). Have sound knowledge in multi-zone, region-based designs.
Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
Extensive programming experience and desire to write and review code 70% of the time.
Experience in software development using programming languages & tools/services: Java(advanced), Python (intermediate) and strong SQL programming (advanced).
Experience in big data processing tools/languages using Spark.
Experience with job orchestration tools: Apache Airflow or similar tools.
Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
Agile scrum experience in application development is required.
Experience with cloud technologies: EC2, EKS, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
Demonstrates knowledge of CI/CD processes, testing frameworks, practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, etc.)
AWS Certification is a plus.

Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%