Software Engineer, Data Backend(Data Platform)

5 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

ION - Software Developer/Engineer - Graduate Development Program

ION

Milan, Lombardy, Italy (On-Site)
6 Months ago
Google - Senior Software Engineer, Databases Site Reliability Engineering

Google

Dublin, County Dublin, Ireland (On-Site)
2 Weeks ago
GamePoint - Game Server Engineer (Java)

GamePoint

The Hague, South Holland, Netherlands (On-Site)
4 Months ago
Zoox - Senior/Staff Backend Software Engineer - Product

Zoox

Foster City, California, United States (On-Site)
6 Months ago
Cognite - Solution Architect

Cognite

Tokyo, Japan (On-Site)
6 Months ago
Microsoft - Senior Software Engineer / Software Engineer - Backend

Microsoft

Dublin, County Dublin, Ireland (On-Site)
1 Week ago
Diligent Corporation - Senior Site Reliability Engineer

Diligent Corporation

Sydney, New South Wales, Australia (On-Site)
6 Months ago
Meta - Production Engineer

Meta

Menlo Park, California, United States (Remote)
5 Months ago
Google - Staff Software Engineer, Google Distributed Cloud

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Devrev - Member of Technical Staff – Search & Recommendation Systems

Devrev

Bengaluru, Karnataka, India (On-Site)
1 Day ago
Ness Digital - Big Data Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
1 Month ago
The Workshop - Data Software Engineer

The Workshop

Málaga, Andalusia, Spain (Hybrid)
8 Months ago
Nagarro - Senior QA Lead (all genders)

Nagarro

Austria (Remote)
6 Months ago
Google - Software Engineer II, Education AI Platform

Google

Mexico City, Mexico City, Mexico (On-Site)
2 Weeks ago
Google - Associate Android Auto Partner Engineer, gReach Program

Google

Seoul, South Korea (On-Site)
2 Days ago
Loyalty Juggernaut - Product Engineer (Java)

Loyalty Juggernaut

Hyderabad, Telangana, India (On-Site)
8 Months ago
Wrike - Staff Backend Engineer

Wrike

Bengaluru, Karnataka, India (Hybrid)
1 Day ago
Nagarro - Staff Engineer, Java Fullstack

Nagarro

(On-Site)
6 Months ago
Google - Software Engineering Manager II, Dart Developer Experience

Google

Portland, Oregon, United States (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Google - Silicon System Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
Google - Sourcing Manager, Custom Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
Google - Software Engineer, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - System Software Engineer, GPU - New College Graduate

NVIDIA

Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Software Engineer, Google Cast and Device Media

Google

New Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - EMC Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Test Floor Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
Google - Software Engineering Manager, System Acceleration, Silicon

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - Senior System Software Engineer, GPU

NVIDIA

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Cloud Technical Solutions Engineer, Platform

Google

Taipei City, Taiwan (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Google - Software Engineer III, Android

Google

Bengaluru, Karnataka, India (On-Site)
2 Days ago
The Walt Disney Company - Staff Software Engineer – Full Stack

The Walt Disney Company

Orlando, Florida, United States (On-Site)
2 Weeks ago
Nielsen Holdings - C#, .Net + Datascience

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
6 Months ago
Nagarro - Engineer, Tech support

Nagarro

(Remote)
6 Months ago
Google - Staff Software Engineer, Cloudnet Staging

Google

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Google - Development Manager, Deals and Payments

Google

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
NOVOMATIC - .NET Developer

NOVOMATIC

Lesser Poland Voivodeship, Poland (Hybrid)
3 Weeks ago
ION - Senior Software Engineer - Full-Stack

ION

Budapest, Hungary (On-Site)
6 Months ago
Cadence - Principal Cloud Engineer

Cadence

Noida, Uttar Pradesh, India (On-Site)
7 Months ago
Meta - Software Engineering Manager, Product Infrastructure

Meta

Bellevue, Washington, United States (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded