Senior Data Engineer

2 Years ago • 8 Years + • Data Analysis

Job Summary

Job Description

Ninja Van is a rapidly growing late-stage logtech startup that uses cutting-edge technology to disrupt the logistics industry. We are seeking world-class talent to join our engineering team to design, develop, and maintain data streaming, processing, and storage infrastructure. Responsibilities include building tools for maintenance and monitoring, contributing to architectural decisions, leading major initiatives, and collaborating with stakeholders to deliver scalable and high-performance ETL solutions. The role also involves enhancing data capabilities through knowledge sharing, enforcing best practices, and promoting data-driven decision-making, as well as developing and enforcing data retention policies and backup strategies for redundant and secure storage.
Must have:
  • Solid computer science fundamentals
  • Excellent problem-solving skills
  • Strong understanding of distributed computing principles
  • 8+ years of experience
  • Python, PySpark, Spark, Airflow
  • Expert-level SQL knowledge
  • Relational and NoSQL databases
  • Apache Kafka
  • Hadoop v2, HDFS, MapReduce
  • Stream-processing systems (Storm, Spark Streaming)
  • Big data querying tools (Pig, Hive, Spark)
  • Data serialization frameworks (Protobuf, Thrift, Avro)
  • Bachelor's or Master's degree in Computer Science
Good to have:
  • Infrastructure-as-code (Terraform, Terragrunt, Ansible, Helm)
  • Change Data Capture (CDC) technologies (Maxwell, Debezium)

Job Details

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. 

More about us: 
- We process 250 million API requests and 3TB of data every day.
- We deliver more than 2 million parcels every day.
- 100% network coverage with 2600+ hubs and stations in 6 SEA markets (Singapore, Malaysia, Indonesia, Thailand, Vietnam and Philippines), reaching 500 million consumers.
- 2 Million active shippers in all e-commerce segments, from the largest marketplaces to the individual social commerce sellers.
- Raised more than US$500 million over five rounds.

We are looking for world-class talent to join our crack team of engineers, product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize team-first mentality, personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team, you will have a very direct impact on the success of the company.

Roles & Responsibilities

      Design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage.
      Build tools to ensure effective maintenance and monitoring of the data infrastructure.
      Contribute to key architectural decisions for data pipelines and lead the implementation of major initiatives.
      Collaborate with stakeholders to deliver scalable and high-performance solutions for data requirements, including extraction, transformation, and loading (ETL) from diverse data sources.
      Enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making.
    • Develop and enforce Ninja Van's data retention policies and backup strategies, ensuring data is stored redundantly and securely.

Requirements

    • Solid computer science fundamentals, excellent problem-solving skills, and a strong understanding of distributed computing principles.
    • At least 8+ years of experience in a similar role, with a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow.
    • Expert-level SQL knowledge and extensive experience working with both relational and NoSQL databases.
    • Advanced knowledge of Apache Kafka, along with demonstrated proficiency in Hadoop v2, HDFS, and MapReduce.
    • Hands-on experience with stream-processing systems (e.g., Storm, Spark Streaming), big data querying tools (e.g., Pig, Hive, Spark), and data serialization frameworks (e.g., Protobuf, Thrift, Avro).
    • [Good to have] Familiarity with infrastructure-as-code technologies like Terraform, Terragrunt, Ansible, or Helm. Don’t worry if you don’t have this experience—what matters is your interest in learning!
    • [Good to have] Experience with Change Data Capture (CDC) technologies such as Maxwell or Debezium.
    • Bachelor’s or Master’s degree in Computer Science or a related field from a top university.
Tech Stack
Backend: Play (Java 8+), Golang, Node.js, Python, FastAPI
Frontend: AngularJS, ReactJS
Mobile: Android, Flutter, React Native
Cache: Hazelcast, Redis
Data storage: MySQL, TiDB, Elasticsearch, Delta Lake
Infrastructure monitoring: Prometheus, Grafana
Orchestrator: Kubernetes
Containerization: Docker, Containerd
Cloud Provider: GCP, AWS
Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC
Workflow manager: Apache Airflow
Query engines: Apache Spark, Trino

Submit a job application
By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the “Notice”) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the “Company”) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice. 

Similar Jobs

Cognite - Senior Implementation Project Manager

Cognite

Houston, Texas, United States (Hybrid)
2 Months ago
Toast - Software Engineer II - Fintech Pricing

Toast

Dublin, County Dublin, Ireland (Hybrid)
1 Month ago
attentive - Engineering Manager, BI Tooling and Platform

attentive

United States (Remote)
3 Weeks ago
fortis games - Lead Marketing Analyst

fortis games

Canada (On-Site)
9 Months ago
albi online  - Technical UI Designer

albi online

Berlin, Berlin, Germany (Hybrid)
3 Months ago
Ziff Davis - Data Engineer III - Applications Engineer

Ziff Davis

Seattle, Washington, United States (On-Site)
2 Months ago
Comscore - Data Scientist

Comscore

Pune, Maharashtra, India (On-Site)
3 Weeks ago
HP - Electronics & Data Analysis Internship

HP

Sant Cugat Del Vallès, Catalonia, Spain (Hybrid)
2 Weeks ago
HCL Tech - Senior Data Scientist

HCL Tech

Washington, United States (On-Site)
1 Month ago
Mapbox - Senior Software Data Engineer , Basemap Team

Mapbox

Germany (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

London stock Exchange - Senior Manager - Risk Coverage

London stock Exchange

London, England, United Kingdom (On-Site)
2 Weeks ago
Interactive Brokers - Senior Java Developer

Interactive Brokers

Tallinn, Harju County, Estonia (On-Site)
9 Months ago
Penumbrainc - Senior Manager of Accounting Close and Operations

Penumbrainc

Alameda, California, United States (Hybrid)
9 Months ago
Growe - VIP Gamification Manager

Growe

(On-Site)
4 Weeks ago
plana technologies - Head of Platform Engineering

plana technologies

Kyiv, Kyiv City, Ukraine (Remote)
3 Weeks ago
Riot Games - Senior Game Producer - League of Legends, Summoner's Rift Environment

Riot Games

Los Angeles, California, United States (On-Site)
6 Months ago
Cubic games - Level Designer

Cubic games

Yerevan, Yerevan, Armenia (Remote)
1 Month ago
Shield AI - Senior Project Engineer (R3398)

Shield AI

Dallas, Texas, United States (On-Site)
1 Week ago
Sony Pictures Entertainment - Research Assistant/Analyst, TV Distribution, EMEA - 12 month FTC

Sony Pictures Entertainment

London, England, United Kingdom (Hybrid)
1 Week ago
Capgemini - C++ Developer/ Networking

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Hyderabad, Telangana, India

Qualcomm - Contracts Specialist

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Months ago
PhonePe - Operation Analyst RMS

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Accenture - Brand & Comm Strategy Specialist

Accenture

Mumbai, Maharashtra, India (On-Site)
3 Months ago
ISG - IT Service Management Manager

ISG

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Rippling - Senior Frontend Engineer

Rippling

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Nightfall AI - Endpoint Engineer

Nightfall AI

Bengaluru, Karnataka, India (On-Site)
9 Months ago
zeta - Assistant Company Secretary

zeta

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Salesforce - Analyst, Risk & Insurance

Salesforce

Hyderabad, Telangana, India (Hybrid)
1 Week ago
Celestial AI - Compiler Engineer (Backend)

Celestial AI

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
1 Year ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Penrose studios - Data Scientist

Penrose studios

San Francisco, California, United States (On-Site)
4 Years ago
C3 IoT - Data Scientist / Senior Data Scientist

C3 IoT

London, England, United Kingdom (On-Site)
3 Weeks ago
Apple - Senior Software Engineer (Data Quality)

Apple

Sunnyvale, California, United States (On-Site)
1 Month ago
Vendavo - Data Scientist

Vendavo

Prague, Prague, Czechia (Hybrid)
1 Month ago
Anavation - Modeling Data Engineer - Ontologist

Anavation

Lorton, Virginia, United States (Hybrid)
2 Months ago
Saxo Bank - Product Governance and Data Analyst

Saxo Bank

Tokyo, Japan (On-Site)
2 Months ago
Moonton  - Senior Data Analyst [MLBB]

Moonton

Shanghai, China (On-Site)
1 Week ago
Nasdaq - Senior Director- Data Engineer (Databricks/AWS)

Nasdaq

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Salesforce - Federal Government Account Executive – Data & Analytics (Tableau)

Salesforce

Canberra, Australian Capital Territory, Australia (On-Site)
2 Weeks ago
Mobilityware - Lead Data Analyst

Mobilityware

Irvine, California, United States (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Ho Chi Minh City, Vietnam (On-Site)

Hai Phong, Vietnam (On-Site)

Subang Jaya, Selangor, Malaysia (On-Site)

Subang Jaya, Selangor, Malaysia (On-Site)

Hai Phong, Vietnam (On-Site)

Ho Chi Minh City, Vietnam (On-Site)

Lam Dong, Vietnam (On-Site)

Ho Chi Minh City, Vietnam (On-Site)

View All Jobs

Get notified when new jobs are added by NinjaVan

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug