Software Engineer, Data Backend(Data Platform)

6 Months ago • 2 Years + • Full Stack Development

Job Summary

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

Similar Jobs

Thales - Experienced Software Architect

Thales

Brest, Brittany, France (On-Site)
1 Week ago
Cygames - Android Engineer

Cygames

Shibuya, Tokyo, Japan (On-Site)
1 Month ago
fairmatic - Senior Software Engineer - Backend

fairmatic

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
ansira - Sr. Full Stack Developer

ansira

Colombia (Remote)
5 Days ago
AlphaSense - Senior Software Engineer

AlphaSense

United States (Remote)
1 Week ago
hitwicket-talent - Tech Lead (Back - End)

hitwicket-talent

Hyderabad, Telangana, India (On-Site)
5 Months ago
Google - Software Engineer, gReach Program for People with Disabilities

Google

Shanghai, Shanghai, China (On-Site)
1 Month ago
Google - Software Engineer III, Engineering Productivity, Google Cloud Platforms

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Ion - Java Developer, Italy

Ion

Italy (Hybrid)
7 Months ago
Bazaar Voice - Senior Software Engineer (Mobile Apps)

Bazaar Voice

Belfast, Northern Ireland, United Kingdom (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Senior Software Engineer - Payments

Riot Games

Los Angeles, California, United States (On-Site)
2 Weeks ago
Vertx Inc. - Senior Manager - Application Development

Vertx Inc.

United States (Remote)
1 Week ago
Penn Interactive - Senior Software Developer, Pricing Engine

Penn Interactive

United States (Hybrid)
2 Months ago
Next Level Business Services - Java Developer

Next Level Business Services

San Diego, California, United States (On-Site)
7 Months ago
Optiv - Sr. SOAR Engineer - Phantom

Optiv

Kansas City, Missouri, United States (Remote)
2 Weeks ago
Telastra - Senior Quality Engineer - Test Automation Specialist

Telastra

Bengaluru, Karnataka, India (On-Site)
1 Week ago
shyft labs - Devops Engineer

shyft labs

Noida, Uttar Pradesh, India (Hybrid)
3 Weeks ago
Dream Sports - SDE 3 - Frontend

Dream Sports

Mumbai, Maharashtra, India (On-Site)
7 Months ago
Internet Brands - Lead Data Engineer

Internet Brands

El Segundo, California, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Ansys - Technical Account Manager

Ansys

Taipei City, Taiwan (On-Site)
1 Week ago
NVIDIA - Senior Software Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
winking Entertainment - Financial Deputy Manager

winking Entertainment

Taipei City, Taiwan (On-Site)
2 Weeks ago
Google - Senior GPU System Architect

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - Product Test Hardware Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Months ago
NVIDIA - Mixed Signal Analog Circuit Designer (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
4 Months ago
NVIDIA - Enterprise Software Test Development Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Google - Bluetooth Firmware Engineer

Google

New Taipei, New Taipei City, Taiwan (On-Site)
1 Month ago
NVIDIA - DFX Software Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Ion - Java Junior Developer

Ion

Chișinău, Chisinau, Moldova (Hybrid)
2 Months ago
bytedance - Frontend Software Engineer - Customer Service Platform

bytedance

Singapore (On-Site)
1 Month ago
Crunchyroll - Senior Software Engineer, Video Transcoding

Crunchyroll

(Remote)
6 Months ago
WebFX - Jr. Web Developer

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
7 Months ago
CD PROJEKT RED - Software Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Epic Games - Senior Web Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
4 Months ago
Forgotten Empires - Senior Software Engineer - Age of Empires (Remote)

Forgotten Empires

Andalusia, Spain (Remote)
2 Months ago
Nagarro - Associate Staff Engineer, Hybris

Nagarro

India (Remote)
7 Months ago
Google - Staff Software Engineer

Google

Maharashtra, India (On-Site)
1 Month ago
PhonePe - Software Engineer - Backend (7-10 years), Pune

PhonePe

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded