Software Engineer, Data Backend(Data Platform)

4 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

PwC - Tester/Testerka automatyzujący/a (freelance)

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
6 Months ago
Saviynt - Consultant, Professional Services (EMEA Region)

Saviynt

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
ByteDance - Senior Backend Software Engineer - Global E-Commerce Supply Chain Billing & Settlement

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
CloudHire - Senior Scala Architect

CloudHire

Bengaluru, Karnataka, India (Remote)
6 Days ago
ION - Cloud Engineer Kubernetes

ION

Rome, Lazio, Italy (Hybrid)
5 Months ago
Google - Software Engineer II, Full Stack, Google Cloud

Google

(On-Site)
4 Months ago
CloudHire - Full Stack Developer - Angular & Node

CloudHire

Karnataka, India (Remote)
1 Week ago
Alphasense - Senior Software Engineer - Vector Search

Alphasense

New York, New York, United States (On-Site)
4 Months ago
Maxis Studios - Tools Software Engineer

Maxis Studios

Vancouver, British Columbia, Canada (On-Site)
4 Months ago
Simplify 360 - Director of AI Product Management

Simplify 360

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Passive Logic - Computational Physics Software Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
5 Months ago
ION - Software Developer/Engineer - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
5 Months ago
Fatshark AB - Senior Backend Developer

Fatshark AB

Stockholm, Stockholm County, Sweden (On-Site)
1 Month ago
Meta - Software Engineer, Machine Learning

Meta

Singapore (On-Site)
4 Months ago
DEVOTEAM - Data Driven | MLOps Engineer

DEVOTEAM

Lisbon, Lisbon, Portugal (Remote)
5 Months ago
Evolution - Data Scientist

Evolution

Warsaw, Masovian Voivodeship, Poland (Hybrid)
8 Months ago
ByteDance - Backend Engineer, Applied Machine Learning Platform - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
Bytro - Quality Assurance / QA Specialist - Gaming (f/m/x)

Bytro

Hamburg, Hamburg, Germany (Hybrid)
7 Months ago
Enphase Energy - Sr. Staff Engineer - Enlighten Cloud Backend

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
ByteDance - Software Engineer Intern (CDN/Edge/Traffic Platform)

ByteDance

San Jose, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

NVIDIA - Mixed Signal Analog Circuit Designer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Rivos - SOC Electrical Analysis Engineer - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
5 Months ago
NVIDIA - Senior Manufacturing Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
6 Days ago
WongDoody - SERVICE DESIGNER, HONG KONG

WongDoody

Taipei City, Taiwan (On-Site)
6 Months ago
Appier - Software Engineer, Site Reliability Engineering

Appier

Taipei City, Taiwan (On-Site)
4 Months ago
NVIDIA - Senior Generalist Software Engineer -- Omniverse

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Senior Mixed Signal Design Verification Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Logitech - Deputy Global Sourcing Manager - Finished Goods

Logitech

Hsinchu, Hsinchu City, Taiwan (Hybrid)
4 Months ago
NVIDIA - Mixed-Signal Circuit Design Engineer - New College Graduate

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Appier - Account Manager

Appier

Taipei City, Taiwan (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

DraftKings - Senior Software Engineer

DraftKings

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Warner Bros Games - Staff Software Engineer - Full Stack Developer

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Google - Software Engineer (For Women in Tech Candidates)

Google

State Of Minas Gerais, Brazil (On-Site)
3 Months ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

Denmark (Remote)
5 Months ago
ByteDance - Software Engineer - Low-code Platform

ByteDance

Singapore (On-Site)
1 Month ago
N-iX - Senior Java Full Stack Engineer

N-iX

Colombia (Remote)
1 Week ago
Milestone - Senior C# Developer

Milestone

Sofia, Sofia City Province, Bulgaria (Hybrid)
1 Week ago
Next Level Business Services - Java Developer

Next Level Business Services

El Segundo, California, United States (On-Site)
5 Months ago
Super - Senior Software Engineer, Payments

Super

United States (Remote)
4 Months ago
NinjaVan - Lead Software Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Remote)

San Francisco, California, United States (Remote)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Seoul, South Korea (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by Appier

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug