Software Engineer, Data Backend(Data Platform)

2 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

Spyke Games - Game Developer

Spyke Games

İstanbul, Türkiye (On-Site)
8 Months ago
Netflix - Security Software Engineer (L4), Client Security Integrations

Netflix

United States (Remote)
3 Weeks ago
Microsoft - Software Engineer II - Frontend

Microsoft

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Paypal - Sr. Staff Software Engineer

Paypal

San Jose, California, United States (Hybrid)
3 Months ago
Infogain - Frontend React Developer (Senior)

Infogain

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Epic Games - Web Engineer

Epic Games

Cary, North Carolina, United States (On-Site)
6 Days ago
The Walt Disney Company - Principal Software Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
1 Month ago
Prose on Pixels - Interface Developer

Prose on Pixels

Chennai, Tamil Nadu, India (Hybrid)
3 Months ago
PwC - IN_Senior Associate_D365 CRM Technical_MS Dynamics_Advisory_ Mumbai

PwC

Mumbai, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Reversing Labs - Backend Software Engineer

Reversing Labs

City Of Zagreb, Croatia (Hybrid)
1 Month ago
Google - Software Engineer II, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
3 Months ago
Netflix - Distributed Systems Engineer (L5) - Data Platform

Netflix

United States (Remote)
3 Months ago
Warner Bros Games - Staff Software Engineer - Cloud Support and Operations

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
The Walt Disney Company - Senior Software Engineer - Ad Platform

The Walt Disney Company

Glendale, California, United States (On-Site)
1 Week ago
Unity - Senior Data Engineer

Unity

San Francisco, California, United States (On-Site)
2 Months ago
Netflix - Software Engineer (L4/L5) - Content Promotion & Distribution Engineering

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Hitachi - Senior Software Engineer

Hitachi

San José, San José Province, Costa Rica (Remote)
3 Months ago
ION - Principal Software Engineer, Italy

ION

Milan, Lombardy, Italy (On-Site)
4 Months ago
Kira Studio - Backend Engineer(rootPe)

Kira Studio

Bengaluru, Karnataka, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Garena - Sea Group - Infrastructure Engineer (DC Site)

Garena

Taipei City, Taiwan (On-Site)
1 Month ago
Corsair - Supply Chain Planner

Corsair

Taipei City, Taiwan (On-Site)
1 Month ago
Appier - Software Engineer, Backend Development (Graduate)

Appier

Taipei City, Taiwan (On-Site)
1 Week ago
PwC - C.顧問類-ESG經理/協理(氣候變遷&企業永續發展管理)

PwC

Taipei City, Taiwan (On-Site)
3 Months ago
Google - Senior Software Engineer, Storage Technologies, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
1 Month ago
Trend Micro - (Sr.) Software Engineer in Linux

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago
PwC - Risk & Quality - Manager

PwC

Taipei City, Taiwan (On-Site)
4 Months ago
Appier - Software Engineer, System Integration

Appier

Taipei City, Taiwan (On-Site)
2 Months ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago
Trend Micro - Sr. Engineer

Trend Micro

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Keywords Studios (Player Support) - Software Engineer III

Keywords Studios (Player Support)

Pune, Maharashtra, India (Hybrid)
8 Months ago
Google - Software Engineer, Early Career, Campus

Google

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
HiLabs - Senior Software Development Engineer - Backend

HiLabs

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Warner Bros Discovery - Staff Software Engineer - Backend (Commerce Team), Hyderabad

Warner Bros Discovery

Hyderabad, Telangana, India (On-Site)
4 Months ago
Enphase Energy - Sr. Backend resource

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
2 Months ago
CloudHire - Full Stack Developer - Remote

CloudHire

India (Remote)
3 Months ago
Next Level Business Services - Java Developer with Oracle SOA

Next Level Business Services

Cincinnati, Ohio, United States (On-Site)
3 Months ago
Tesla - Software Engineering Internship

Tesla

Athens, Greece (On-Site)
3 Hours ago
Next Level Business Services - API Developer

Next Level Business Services

New York, New York, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Seoul, South Korea (On-Site)

Taipei City, Taiwan (On-Site)

Singapore (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Appier

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug