Senior Software Engineer, Data Backend (Data Platform)

1 Month ago • 2 Years + • Data Analysis

Job Summary

Job Description

Appier is a SaaS company using AI to power business decision-making. As a Software Engineer, Data Backend on the Data Platform team, you will design, develop, and maintain critical data pipelines and platforms like Spark and Kafka clusters. Responsibilities include profiling and tuning the performance of critical components, providing expert advice to enhance big data systems, and establishing foundational architecture. You will be involved in making software intelligent and turning data into business insights and decisions.
Must have:
  • BS/MS in Computer Science
  • 2+ years building/operating large-scale distributed systems
  • Java/Scala development experience
  • Experience building data pipelines with Apache Spark
  • Experience managing data lakes/warehouses
  • Expertise in data structures and algorithms on Big Data platforms
  • Ability to work independently in a dynamic environment
  • Self-motivated learner and builder
Good to have:
  • Golang/Python development experience
  • JVM performance profiling/optimization
  • Experience managing Hadoop, Kafka, Flink, Trino/ClickHouse
  • Cloud service experience (AWS, GCP, Azure)
  • Open source contribution experience
  • Experience with open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

#LI-AK1

 

Similar Jobs

Roof Stacks - Senior Cyber Security Engineer

Roof Stacks

Istanbul, İstanbul, Türkiye (On-Site)
4 Months ago
level ai - National Channel Manager

level ai

United States (Remote)
2 Months ago
zeta - Associate Manager - Legal

zeta

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Ness - Experienced Technical Support Engineer with German

Ness

Košice, Košice Region, Slovakia (Remote)
1 Month ago
Cognite - (Senior) Service Lead

Cognite

Oslo, Oslo, Norway (Hybrid)
7 Months ago
HCL Tech - Senior Data Scientist

HCL Tech

Washington, United States (On-Site)
1 Month ago
VI - Data Scientist

VI

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
dun bradstreet - Senior Principal Data Scientist, AaaS

dun bradstreet

Frankfurt Am Main, Hessen, Germany (Hybrid)
2 Months ago
Dream Games - Data Engineer

Dream Games

İstanbul, Türkiye (On-Site)
3 Years ago
Nagarro - Staff Consultant ,SAP Analytics Data Manageme

Nagarro

Gurugram, Haryana, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Decagon - Director of Sales Enablement

Decagon

San Francisco, California, United States (On-Site)
4 Months ago
Salesforce - Senior Product Designer

Salesforce

San Francisco, California, United States (On-Site)
2 Weeks ago
USE Insider - Revenue Operations Specialist

USE Insider

Istanbul, İstanbul, Türkiye (On-Site)
9 Months ago
zeta - Software Development Engineer II (Backend - Credit SaaS)

zeta

Bengaluru, Karnataka, India (On-Site)
1 Year ago
DataVisor - Senior Technical Support Specialist

DataVisor

Tokyo, Japan (Hybrid)
1 Month ago
appier - Machine Learning Engineer Intern

appier

Taipei City, Taiwan (On-Site)
1 Month ago
Sailpoint - Senior Java Software Engineer

Sailpoint

Mexico City, Mexico (Remote)
1 Month ago
AiDash - Software Development Engineer - III (DevOps)

AiDash

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Jumio - Vice President of Finance

Jumio

Sunnyvale, California, United States (On-Site)
2 Weeks ago
Sonar Source - Major Account Manager - DACH

Sonar Source

Bochum, North Rhine-Westphalia, Germany (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

rivos - Physical Design Intern

rivos

Hsinchu, Hsinchu City, Taiwan (On-Site)
8 Months ago
Intel  - Display Technology Enabling Manager

Intel

Taipei City, Taiwan (On-Site)
1 Year ago
Coda - Senior/Staff Software Engineer

Coda

Taipei City, Taiwan (Hybrid)
2 Weeks ago
NVIDIA - Digital Circuit Design Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
5 Months ago
NVIDIA - Silicon Photonics Test Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
6 Months ago
Corsair gaming - Senior Engineering Project Manager

Corsair gaming

Taipei City, Taiwan (On-Site)
2 Months ago
Ansys - R&D Engineer II

Ansys

Hsinchu County, Taiwan (On-Site)
1 Month ago
cirrus logic - VP, Sales

cirrus logic

Taipei City, Taiwan (Hybrid)
2 Months ago
Qualcomm - Component Supplier Quality Engineer, Staff

Qualcomm

Hsinchu City, Taiwan (On-Site)
2 Months ago
appier - Research Scientist (Generative AI)

appier

Taipei City, Taiwan (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Jam City - BI Analyst

Jam City

Montevideo, Montevideo Department, Uruguay (Hybrid)
2 Months ago
Addepar - Senior Backend Software Engineer - Data Imports

Addepar

United States (Remote)
1 Month ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Brazil, Indiana, United States (Remote)
8 Months ago
CRB workforce  - Data Engineer

CRB workforce

Seattle, Washington, United States (On-Site)
2 Months ago
Lingokids - Senior Data Scientist (Business & Marketing)

Lingokids

Madrid, Community Of Madrid, Spain (Remote)
1 Month ago
PwC - Data Engineer Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
1 Year ago
attentive - Senior Software Engineer, Data Platform

attentive

United States (Remote)
1 Month ago
Penrose studios - Data Scientist

Penrose studios

San Francisco, California, United States (On-Site)
4 Years ago
YouGov - Lead Data Scientist, Data Integrity

YouGov

United States (Remote)
1 Month ago
Next Level Business Services - Business Analyst

Next Level Business Services

Petaluma, California, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded