Senior Software Engineer - Scala, Spark, Airflow, Python
Job Summary
Job Description
As a Senior Software Engineer at Nielsen, you'll be part of a DevOps team focusing on big data applications. Responsibilities include designing, coding, and testing applications deployed on AWS; developing and maintaining automated tests integrated with CI/CD; troubleshooting data issues; collaborating with product owners and tech leads; building reusable code components; promoting best practices; and working with cross-functional teams. You'll use Java, Python, SQL, Spark, Airflow, and various AWS services (EC2, EKS, S3, Lambda, etc.). Agile methodologies are employed.
Must have:
- 5+ years software development experience
- Strong AWS cloud expertise
- Java (advanced), Python (intermediate), SQL (advanced)
- Spark, Airflow experience
- Agile Scrum experience
Good to have:
- AWS Certification
15 skills required
Job Details
At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with content - wherever and whenever it’s consumed. Together, we are proudly rooted in our deep legacy as we stand at the forefront of the media revolution. When you join Nielsen, you will join a dynamic team committed to excellence, perseverance, and the ambition to make an impact together. We champion you, because when you succeed, we do too. We enable your best to power our future.
As a Software Engineer, you will be working as part of a DevOps team focusing on analyzing, developing, testing, and supporting Big Data applications. Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies
Responsibilities
- Hands on developer to design, code, and test iteratively to support complex big data applications deployed on Cloud Infrastructure (AWS).
- Plan, develop, execute and maintain automated unit, functional test cases; develop modular, robust, and maintainable automation scripts to integrate with CICD process.
- Must have strong analytical and technical skills with passion to deep dive on data in troubleshooting, devise techniques for problem resolution.
- Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
- Build platform reusable code and components that could be used by multiple project teams.
- Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
- Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals
Key skills
- 5+ years of hands-on software development with a bachelor’s degree in computer science, engineering or relevant field
- Must have strong cloud Implementation expertise in cloud architecture.
- Must have very good knowledge of storage, network, AWS(Compute services). Have sound knowledge in multi-zone, region-based designs.
- Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
- Extensive programming experience and desire to write and review code 70% of the time.
- Experience in software development using programming languages & tools/services: Java(advanced), Python (intermediate) and strong SQL programming (advanced).
- Experience in big data processing tools/languages using Spark.
- Experience with job orchestration tools: Apache Airflow or similar tools.
- Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
- Agile scrum experience in application development is required.
- Experience with cloud technologies: EC2, EKS, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
- Demonstrates knowledge of CI/CD processes, testing frameworks, practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, etc.)
- AWS Certification is a plus.
Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a nielsen.com domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @nielsen.com address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.
Similar Jobs
Budge Studios
Montreal, Quebec, Canada (On-Site)
• 5 Months ago
Meta
Seattle, Washington, United States (On-Site)
• 2 Months ago
Microsoft
Redmond, Washington, United States (On-Site)
• 2 Weeks ago
São Paulo, State Of São Paulo, Brazil (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Intel Corporation
Hillsboro, Oregon, United States (Hybrid)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Mumbai, Maharashtra, India
Wind River Systems
Bengaluru, Karnataka, India (On-Site)
• 3 Months ago
Flutter Entertainment
Hyderabad, Telangana, India (On-Site)
• 4 Months ago
Brillio
Bengaluru, Karnataka, India (Hybrid)
• 3 Months ago
Get notifed when new similar jobs are uploaded
DevOps Jobs
Rackspace Technology
Gurugram, Haryana, India (Remote)
• 3 Weeks ago
Zeta
Bengaluru, Karnataka, India (On-Site)
• 3 Months ago
SmileGate
Seongnam-si, Gyeonggi-do, South Korea (On-Site)
• 3 Weeks ago
Get notifed when new similar jobs are uploaded
