Software Engineer, Data Backend(Data Platform)

5 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

White Hat Gaming  - Scala Developer

White Hat Gaming

(Remote)
6 Months ago
Riot Games - Software Engineering Manager - Content Access Platform

Riot Games

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
Huuuge Games - Senior Java Software Engineer

Huuuge Games

Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Meta - QA Engineering Lead, Reality Labs (Wearables)

Meta

Los Angeles, California, United States (On-Site)
5 Months ago
ION - Senior Java Developer - Italy

ION

Collecchio, Emilia-Romagna, Italy (On-Site)
6 Months ago
ByteDance - Software Engineer Intern (CDN/Edge/Traffic Platform)

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Epic Games - Senior Web Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
Armada - Principal Engineer (Applications)

Armada

Thiruvananthapuram, Kerala, India (On-Site)
6 Months ago
Google - Senior Software Engineer, Engineering Productivity, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Software Engineer, Infrastructure

Meta

Burlingame, California, United States (Remote)
5 Months ago
Playtech - Senior Java Developer

Playtech

Sofia, Sofia City Province, Bulgaria (On-Site)
4 Weeks ago
Meta - Software Engineer, Android

Meta

San Francisco, California, United States (On-Site)
5 Months ago
Canva - Software Engineer Internship (Infrastructure)

Canva

Sydney, New South Wales, Australia (Remote)
2 Weeks ago
ByteDance - Backend Software Engineer

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
1 Week ago
The Walt Disney Company - Lead Software Engineer - Identity

The Walt Disney Company

New York, New York, United States (On-Site)
4 Days ago
Microsoft - Software Engineer 2

Microsoft

Redmond, Washington, United States (On-Site)
1 Week ago
ByteDance - Software Engineer, Video-On-Demand

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Research Scientist, Reinforcement Learning

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
NVIDIA - Senior System Software Engineer, Signing Services

NVIDIA

California, United States (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Google - Silicon Quality and Reliability Engineer

Google

Taipei City, Taiwan (On-Site)
1 Week ago
PwC - T.稅務類-企業併購 (Mergers & Acquisitions) 稅務顧問

PwC

Taipei City, Taiwan (On-Site)
3 Months ago
NVIDIA - Senior Mixed Signal Designer Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago
Google - Program Manager, New Product Introduction Operations

Google

Taipei City, Taiwan (On-Site)
4 Days ago
Trend Micro - (Sr.) Cloud Developer (Security Playbooks)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago
NVIDIA - Design Verification Engineer - PCIE

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - System Design Power Validation Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Supplier Quality Engineer, Mechanicals

Google

Taipei City, Taiwan (On-Site)
4 Days ago
Google - Senior GPU System Architect

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Week ago
Corsair - Country Sales Manager, Taiwan

Corsair

Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Microsoft - Senior Software Engineer

Microsoft

Redmond, Washington, United States (On-Site)
3 Days ago
Google - Software Engineer III, Android

Google

Bucharest, Bucharest, Romania (On-Site)
4 Days ago
Google - Software Engineer III, Mobile (iOS), YouTube

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Bally's Interactive - Senior Data Developer

Bally's Interactive

Toronto, Ontario, Canada (Hybrid)
1 Week ago
Google - Software Engineer, Cloud Console Platform, Full Stack

Google

Kirkland, Washington, United States (On-Site)
1 Week ago
Harness - Senior Software Engineer - AI Assistant

Harness

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
GameChanger  - Staff iOS Software Engineer, Gameday

GameChanger

United States (Remote)
1 Month ago
Google - Staff Software Engineer, Google Cloud Business Platforms

Google

Kirkland, Washington, United States (On-Site)
6 Days ago
Rockstar Games - Senior Full Stack Engineer (C#/React)

Rockstar Games

Andover, Massachusetts, United States (On-Site)
10 Months ago
Nagarro - Engineer, NodeJS

Nagarro

India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

San Francisco, California, United States (Remote)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Seoul, South Korea (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

Taipei City, Taiwan (On-Site)

View All Jobs

Get notified when new jobs are added by Appier

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug