Software Engineer, Data Backend(Data Platform)

7 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

Ion - Senior Technical Consultant - Endur

Ion

Uniondale, New York, United States (On-Site)
8 Months ago
Veeam Software - Data Analytics Engineer

Veeam Software

(Remote)
2 Months ago
Game freak - R&D Programmer: Backend

Game freak

Chiyoda City, Tokyo, Japan (On-Site)
5 Months ago
Razer - Senior API Developer

Razer

Singapore (On-Site)
9 Months ago
Assystems - Backend Developer – ETL Integration

Assystems

Gurugram, Haryana, India (On-Site)
8 Months ago
Ion - Java Developer, Budapest

Ion

Budapest, Hungary (Hybrid)
8 Months ago
Inkittt - Director of Engineering

Inkittt

San Francisco, California, United States (Hybrid)
6 Months ago
Hitachi - Senior Modern Applications Solution Architect

Hitachi

Chicago, Illinois, United States (Remote)
8 Months ago
Nagarro - Staff Engineer, .Net Fullstack

Nagarro

Mexico (Remote)
8 Months ago
Ion - Senior Software Engineer, Italy

Ion

Pisa, Tuscany, Italy (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer III, Full Stack, Google Cloud

Google

Hyderabad, Telangana, India (On-Site)
8 Months ago
Qualcomm - Senior Software Engineer

Qualcomm

Melbourne, Victoria, Australia (On-Site)
1 Month ago
Autodesk - Software Developer (Intermediate/Senior/Principal Levels)

Autodesk

Ontario, Canada (Remote)
1 Month ago
Tesla - Senior Trading Engineer, Autobidder

Tesla

North Holland, Netherlands (On-Site)
4 Months ago
Google - Software Engineer, Early Career (For Women in Tech Candidates)

Google

State Of Minas Gerais, Brazil (On-Site)
6 Months ago
Canva - Backend Software Engineer - Gen AI, Design Generation Experience

Canva

Brisbane, Queensland, Australia (Remote)
3 Months ago
Epic Games - QA Programming Specialist

Epic Games

Vancouver, British Columbia, Canada (On-Site)
4 Months ago
FalconX - Senior Trading Systems Developer – Electronic Trading (Java/Rust)

FalconX

New York, New York, United States (On-Site)
1 Month ago
Merkur gaming  - Core Java

Merkur gaming

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
Meta - Production Engineering

Meta

Cambridge, Massachusetts, United States (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Trend Micro - Sr. Software Engineer (XDR for Networks)

Trend Micro

Taipei City, Taiwan (On-Site)
9 Months ago
appier - Ad Sales, Advertising Solution

appier

Taipei City, Taiwan (On-Site)
1 Month ago
Trend Micro - (Sr.) Cloud Developer (Vision One)

Trend Micro

Taipei City, Taiwan (On-Site)
9 Months ago
WongDoody - UI DESIGNER, HONG KONG

WongDoody

Taipei City, Taiwan (On-Site)
7 Months ago
winking Entertainment - Unreal Engine Game Art Project Manager

winking Entertainment

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Software Engineer, Generative AI Blackbelt, Google Cloud Platform

Google

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - AI Algorithms Software Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
NVIDIA - Senior Silicon Photonics Test Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago
NXP - Global OSAT Package Principal Engineer

NXP

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Ansys - Senior Application Engineer

Ansys

Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Toppan Merrill - Systems Engineer

Toppan Merrill

Chennai, Tamil Nadu, India (On-Site)
9 Months ago
Technorizen Software Solutions - Exp. PHP Developer

Technorizen Software Solutions

Indore, Madhya Pradesh, India (On-Site)
11 Months ago
The Walt Disney Company - Senior Principal Software Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
2 Months ago
Nagarro - Principal Engineer, Java Fullstack

Nagarro

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
8 Months ago
GameChanger - Senior Full Stack Software Engineer, Video Platform

GameChanger

New York, New York, United States (Remote)
3 Months ago
Tesla - Senior Full Stack Developer

Tesla

Prüm, Rhineland-Palatinate, Germany (On-Site)
4 Months ago
PhonePe - Software Engineer (5-7 Yrs) - Core

PhonePe

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Next Level Business Services - SQL and C# developer

Next Level Business Services

Redmond, Washington, United States (On-Site)
8 Months ago
Google - Tech Lead, Software Engineering, People with Disabilities

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
8 Months ago
Ion - Lead Software Engineer, Italy

Ion

Turin, Piedmont, Italy (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded