Big Data Platform Engineer - Java/Go
Job Summary
Job Description
As a Big Data Platform Engineer, you'll be part of a team working with massive datasets to enhance product quality. You'll design, build, and maintain distributed big data services, real-time systems (Java/Go/Python), and data processing architectures on AWS. Responsibilities include building automated and scalable data pipelines, analyzing production deployments, optimizing performance, and developing infrastructure to handle large-scale data processing, including streaming data. The role involves software development, data processing, and service operations, working closely with other development teams. Currently, the team is undergoing significant infrastructure changes, including dockerization.
Must have:
- Develop and maintain distributed Big Data services
- Build real-time systems in Java/Go/Python
- Design and build data processing architecture in AWS
- Build automated and scalable data pipelines
- Analyze and optimize complex distributed systems
5 skills required
Job Details
As a member of our Big Data Engineering team you’ll get the opportunity to work with data at incredible scale that helps us improve the quality of our products. Peak’s Big Data Platform fuels the process of data-driven decisions by utilising the latest big data tech stack to collect and process terabytes of incoming data on a daily basis. Our team of experienced software engineers is building large distributed systems and developing real-time services to complete the data needs.
In this role you’ll equally touch software development, data processing and service operations while working closely with our development teams. We’re looking for a dedicated software engineer to help us process terabytes of data into well-designed, high-quality batch and real-time services that are the foundation of product-related decisions at Peak.
It’s a great time to join our team as we just started working on major changes on the infrastructure, including dockerizing our architecture and other exciting stuff that we’ll find on the way.
Here’s what you’ll do
- Develop and maintain distributed Big Data services, components and tools
- Build real-time systems and tools in Java/Go/Python to support all of our products
- Design and build data processing architecture in AWS
- Build an automated and scalable data pipeline
- Analyze complex distributed production deployments and make recommendations to optimize performance
- Design and build scalable infrastructure and platform to collect and process very large amounts of data, including streaming real-time data
Desired Skills and Experiences
- Bachelor's degree in a technical field (e.g. Engineering, Computer Science, MIS or a related field of study)
- Minimum 1+ years of experience
Similar Jobs
bytedance
San Jose, California, United States (On-Site)
• 6 Months ago
Ruselle Investments
Mumbai, Maharashtra, India (On-Site)
• 3 Weeks ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Aeries technology
Mumbai, Maharashtra, India (On-Site)
• 1 Week ago
Western Digital
Prachin Buri, Thailand (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Worldwide
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Data Analysis Jobs
Trend Micro
Taipei City, Taiwan (On-Site)
• 2 Months ago
PwC
Chennai, Tamil Nadu, India (On-Site)
• 2 Weeks ago
PwC
Kolkata, West Bengal, India (On-Site)
• 10 Months ago
Illumina
Bengaluru, Karnataka, India (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
