Staff Software Engineer (Data Analytics Platform)
Job Summary
Job Description
Ninja Van is a rapidly growing logtech startup focused on disrupting the logistics industry with innovation and cutting-edge technology. As a Staff Software Engineer on the Data Analytics Platform team, you will design and develop sophisticated data infrastructure for streaming, processing, and storage using a modern Lakehouse architecture. Responsibilities include building and maintaining data monitoring tools, leading key architectural decisions, implementing data pipeline initiatives with the latest technologies, and collaborating with stakeholders to deliver scalable data solutions. You will also ensure robust data governance and compliance, promote knowledge sharing, and lead a team of 4-5 data engineers. The company processes 250 million API requests and 3TB of data daily, delivering over 2 million parcels daily across Southeast Asia.
Must have:
- Design and develop data infrastructure for streaming, processing, and storage.
- Build and maintain tools for data monitoring and management.
- Lead key architectural decisions and implement data pipeline initiatives.
- Collaborate with stakeholders to deliver scalable data solutions.
- Promote knowledge sharing and data-driven culture.
- Ensure data governance, retention, backup, and secure storage.
- Lead a team of 4-5 data engineers.
- Over 8 years of experience in data infrastructure.
- Deep expertise in SQL and relational/NoSQL databases.
- Advanced proficiency in Apache Kafka, Hadoop ecosystem, and Spark Streaming.
Good to have:
- Familiarity with big data tools (Pig, Hive, Spark).
- Familiarity with data serialization frameworks (Protobuf, Thrift, Avro).
- Familiarity with workflow management using Apache Airflow.
- Knowledge of data catalog tools (Open Metadata, Unity Catalog).
- Experience with infrastructure as code (Terraform, Ansible).
- Experience with CDC technologies (Maxwell, Debezium).
24 skills required
Job Details
Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities.
More about us:
- We process 250 million API requests and 3TB of data every day.
- We deliver more than 2 million parcels every day.
- 100% network coverage with 2600+ hubs and stations in 6 SEA markets (Singapore, Malaysia, Indonesia, Thailand, Vietnam and Philippines), reaching 500 million consumers.
- 2 Million active shippers in all e-commerce segments, from the largest marketplaces to the individual social commerce sellers.
- Raised more than US$500 million over five rounds.
We are looking for world-class talent to join our crack team of engineers, product managers and designers. We want people who are passionate about creating software that makes a difference to the world. We like people who are brimming with ideas and who take initiative rather than wait to be told what to do. We prize team-first mentality, personal responsibility and tenacity to solve hard problems and meet deadlines. As part of a small and lean team, you will have a very direct impact on the success of the company.
Roles & Responsibilities
- Design and develop a sophisticated data infrastructure for streaming, processing, and storage, aligned with a modern Lakehouse architecture.
- Build and maintain tools for effective data monitoring and management using best practices in data engineering.
- Lead key architectural decisions and implement significant data pipeline initiatives using the latest technologies.
- Collaborate with various stakeholders to deliver scalable and performant data solutions, supporting all aspects of data handling from extraction to loading.
- Promote knowledge sharing within the team, encouraging best practices for a data-driven culture.
- Ensure robust data governance and compliance with developed data retention, backup strategies, and secure storage solutions.
- Leading a team of 4-5 data engineers
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science or related field from a top university.
- Over 8 years of experience in data infrastructure, with a proven track record in building scalable and high-performance data systems.
- Deep expertise in SQL and extensive experience with relational and NoSQL databases.
- Advanced proficiency in Apache Kafka, Hadoop ecosystem, and stream-processing systems like Spark Streaming.
- Familiarity with big data tools (Pig, Hive, Spark), data serialization frameworks (Protobuf, Thrift, Avro), and workflow management using Apache Airflow.
- Knowledge of data catalog tools such as Open Metadata and Unity Catalog is highly desirable.
- Experience with infrastructure as code (e.g., Terraform, Ansible) and CDC technologies (e.g., Maxwell, Debezium) is advantageous.
Tech Stack
Backend: Play (Java 8+), Golang, Node.js, Python, FastAPI
Frontend: AngularJS, ReactJS
Mobile: Android, Flutter, React Native
Cache: Hazelcast, Redis
Data storage: MySQL, TiDB, Elasticsearch, Delta Lake
Infrastructure monitoring: Prometheus, Grafana
Orchestrator: Kubernetes
Containerization: Docker, Containerd
Cloud Provider: GCP, AWS
Data pipelines: Apache Kafka, Spark Streaming, Maxwell/Debezium, PySpark, TiCDC
Workflow manager: Apache Airflow
Query engines: Apache Spark, Trino
Submit a job application
By applying to the job, you acknowledge that you have read, understood and agreed to our Privacy Policy Notice (the “Notice”) and consent to the collection, use and/or disclosure of your personal data by Ninja Logistics Pte Ltd (the “Company”) for the purposes set out in the Notice. In the event that your job application or personal data was received from any third party pursuant to the purposes set out in the Notice, you warrant that such third party has been duly authorised by you to disclose your personal data to us for the purposes set out in the the Notice.
Similar Jobs
Samsung Semiconductor
San Jose, California, United States (On-Site)
• 3 Months ago
AECOM
Atlanta, Georgia, United States (On-Site)
• 2 Weeks ago
Addepar
Edinburgh, Scotland, United Kingdom (On-Site)
• 1 Month ago
Roblox
San Mateo, California, United States (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
HP
Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
• 1 Month ago
bytedance
Seattle, Washington, United States (On-Site)
• 5 Months ago
Synechron
Pune, Maharashtra, India (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
Jobs in Hyderabad, Telangana, India
Get notifed when new similar jobs are uploaded
Data Analysis Jobs
Coherent corp.
Sherman, Texas, United States (On-Site)
• 1 Month ago
bytedance
Singapore (On-Site)
• 4 Months ago
Axon
Scottsdale, Arizona, United States (On-Site)
• 1 Month ago
bytedance
San Jose, California, United States (On-Site)
• 4 Months ago
Get notifed when new similar jobs are uploaded
