Big Data Platform Engineer - Java/Go

3 Months ago • 1 Years + • Data Analysis

Job Summary

Job Description

As a Big Data Platform Engineer, you'll be part of a team working with massive datasets to enhance product quality. You'll design, build, and maintain distributed big data services, real-time systems (Java/Go/Python), and data processing architectures on AWS. Responsibilities include building automated and scalable data pipelines, analyzing production deployments, optimizing performance, and developing infrastructure to handle large-scale data processing, including streaming data. The role involves software development, data processing, and service operations, working closely with other development teams. Currently, the team is undergoing significant infrastructure changes, including dockerization.
Must have:
  • Develop and maintain distributed Big Data services
  • Build real-time systems in Java/Go/Python
  • Design and build data processing architecture in AWS
  • Build automated and scalable data pipelines
  • Analyze and optimize complex distributed systems

Job Details

As a member of our Big Data Engineering team you’ll get the opportunity to work with data at incredible scale that helps us improve the quality of our products. Peak’s Big Data Platform fuels the process of data-driven decisions by utilising the latest big data tech stack to collect and process terabytes of incoming data on a daily basis. Our team of experienced software engineers is building large distributed systems and developing real-time services to complete the data needs.

In this role you’ll equally touch software development, data processing and service operations while working closely with our development teams. We’re looking for a dedicated software engineer to help us process terabytes of data into well-designed, high-quality batch and real-time services that are the foundation of product-related decisions at Peak.

It’s a great time to join our team as we just started working on major changes on the infrastructure, including dockerizing our architecture and other exciting stuff that we’ll find on the way.

Here’s what you’ll do

    • Develop and maintain distributed Big Data services, components and tools
    • Build real-time systems and tools in Java/Go/Python to support all of our products
    • Design and build data processing architecture in AWS
    • Build an automated and scalable data pipeline
    • Analyze complex distributed production deployments and make recommendations to optimize performance
    • Design and build scalable infrastructure and platform to collect and process very large amounts of data, including streaming real-time data

Desired Skills and Experiences

    • Bachelor's degree in a technical field (e.g. Engineering, Computer Science, MIS or a related field of study)
    • Minimum 1+ years of experience
undefined

Similar Jobs

Nexon - Player Support Specialist (Temporary)

Nexon

El Segundo, California, United States (Hybrid)
1 Month ago
Fanatee - Product Business Analyst

Fanatee

(Remote)
2 Months ago
Scale AI - Solutions Engineer

Scale AI

Washington, District Of Columbia, United States (On-Site)
1 Month ago
bytedance - Full-Stack Software Engineer - Security Operation Center

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Silicon Labs - Engineer I - Infra SW

Silicon Labs

Hyderabad, Telangana, India (On-Site)
1 Month ago
skillz - Lead Data Engineer

skillz

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Addepar - Staff Software Engineer - Data Platform

Addepar

Pune, Maharashtra, India (Hybrid)
2 Months ago
Capgemini - Data Scientist - B

Capgemini

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
Jane Street - Data Center Engineer

Jane Street

New York, United States (On-Site)
1 Month ago
luxsoft - Murex Market Risk Business Analyst

luxsoft

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Crunchyroll - Customer Experience Operations Analyst

Crunchyroll

San Francisco, California, United States (On-Site)
5 Months ago
cyara - Senior Marketing Operations Manager

cyara

United States (Remote)
1 Month ago
SSC Technologies - Director of Product Management

SSC Technologies

San Francisco, California, United States (Hybrid)
1 Month ago
The Walt Disney Company - Senior Software Engineer - Activation Team

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
luxsoft - Android Unreal 3D HMI Developer

luxsoft

Odesa, Odesa Oblast, Ukraine (On-Site)
1 Month ago
Blinkhealth - People and Culture Partner, Pharmacy Operations

Blinkhealth

Chesterfield, Missouri, United States (On-Site)
1 Month ago
Corsair - Director, D2C eCommerce

Corsair

Milpitas, California, United States (On-Site)
3 Months ago
rivos - Data Parallel Accelerator Post-Silicon Performance Lead

rivos

Santa Clara, California, United States (Hybrid)
1 Week ago
PwC - IN-Senior Manager_GTM_Data and Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Ion - Data Associate - Wealthmonitor

Ion

Budapest, Hungary (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Synechron - Senior Business Analyst (Financial Services & Domain Expertise)

Synechron

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Ethos Life - Data Scientist

Ethos Life

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Xsolla - Product Data Analyst

Xsolla

Baku, Azerbaijan (Hybrid)
2 Months ago
Capgemini - Data Engineer

Capgemini

Gurugram, Haryana, India (On-Site)
3 Weeks ago
GameChanger - Data Platform Engineer

GameChanger

United States (Remote)
3 Months ago
Qualcomm - IT Data Engineer

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Frontier Developments - Experienced Data Analyst

Frontier Developments

Cambridge, England, United Kingdom (Hybrid)
1 Week ago
Funko - E-Commerce Cash & Data Analyst

Funko

Coventry, England, United Kingdom (On-Site)
3 Weeks ago
Mcdonalds - Business Technical Analyst

Mcdonalds

Mexico City, Mexico (On-Site)
1 Month ago
Bethesda - Lead Data Analyst

Bethesda

Rockville, Maryland, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded