Software Engineer, Data Backend(Data Platform)

1 Month ago • 2 Years + • Full Stack Development

About the job

Job Description

As a Software Engineer, Data Backend at Appier, you'll design, develop, and maintain data pipelines and platforms (Spark, Kafka). Responsibilities include optimizing performance, providing expert solutions for big data systems, and improving foundational architecture. You'll work with Java/Scala and contribute to critical platform components. The role requires experience in building and operating large-scale distributed systems and expertise in data structures and algorithms within big data environments.
Must have:
  • 2+ years experience in large-scale distributed systems
  • Java/Scala development experience
  • Apache Spark data pipeline experience
  • Data lake/warehouse expertise
  • Big Data platform algorithm/data structure expertise
Good to have:
  • Golang/Python experience
  • JVM performance profiling/optimization
  • Hadoop, Kafka, Flink, Trino/ClickHouse experience
  • Cloud service (AWS, GCP, Azure) experience
  • Open source contributions
  • Open table formats (Iceberg, Delta Lake, Hudi)
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain data pipelines
  • Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
  • Profile and tune performance of critical components
  • Provide expert advice and solutions to enhance the performance of big data systems and applications
  • Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 2+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in developing Java/Scala project
  • Experience in building data pipeline using Apache Spark 
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience in developing Golang/Python project
  • Experience in profiling and optimizing JVM performance
  • Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
  • Experience in cloud service (AWS, GCP, Azure)
  • Experience in contributing to open source projects (please provide your github link)
  • Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

 

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Taipei City, Taiwan (On-Site)

Singapore (On-Site)

Taipei City, Taiwan (On-Site)

Hong Kong (On-Site)

Taipei City, Taiwan (On-Site)

San Francisco, California, United States (On-Site)

San Francisco, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Appier

Similar Jobs

Luxoft - Data Engineer

Luxoft, India (On-Site)

ION - Senior SDET Engineer, New York

ION, United States (Hybrid)

Trend Micro - Senior Software Developer

Trend Micro, Canada (On-Site)

Motorola Solutions - Software Developer

Motorola Solutions, India (Hybrid)

ION - Java Developer, Budapest

ION, Hungary (Hybrid)

Nagarro - Staff Engineer, Java Fullstack

Nagarro, Mexico (Remote)

Entrata - Software Engineer

Entrata, India (Hybrid)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Data Engineer, Analytics

Meta, United States (On-Site)

Paytm - QA Automation- Senior QA Engineer

Paytm, India (On-Site)

Aristocrat Gaming - Manager - Frontend Development

Aristocrat Gaming, India (Hybrid)

Dovelp - Game Developer Intern

Dovelp, India (On-Site)

Intel Corporation - IT Analyst - Manufacturing Integration

Intel Corporation, (Remote)

BigID - Software Engineer Team Lead

BigID, Israel (On-Site)

Luxoft - Java Senior Software Developer

Luxoft, Poland (On-Site)

Luxoft - Senior Java Developer

Luxoft, Poland (Hybrid)

Meta - Software Engineer, Pathways Program

Meta, United States (On-Site)

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Netflix - Creative Manager - Taiwan

Netflix, Taiwan (On-Site)

Trend Micro - (Sr.) Threat Researcher

Trend Micro, Taiwan (On-Site)

Rivos - Analog Mixed Signal Design

Rivos, Taiwan (Hybrid)

NXP - IT Support Lead

NXP, Taiwan (On-Site)

Trend Micro - (Sr.) Software Engineer in Test

Trend Micro, Taiwan (On-Site)

Maersk Careers - Assistant Manager-Operations JJMD

Maersk Careers, Taiwan (On-Site)

Trend Micro - (Sr.) Cloud Backend Engineer

Trend Micro, Taiwan (On-Site)

Logitech - B2B assistant Key Account Manager

Logitech, Taiwan (On-Site)

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Employ - Senior Software Engineer

Employ, India (On-Site)

Blenheim Chalcot India - Frontend Developer – Vue.Js

Blenheim Chalcot India, India (On-Site)

Safe Security - Software Development Engineer II

Safe Security, India (On-Site)

Go Fund Me - Staff Software Engineer (Payments)

Go Fund Me, United States (On-Site)

Luxoft - Senior AUTOSAR Embedded Engineer

Luxoft, Sweden (On-Site)

Sigma Software - Senior Java Developer

Sigma Software, Poland (On-Site)

Beghou Consulting - Software Developer – Full Stack

Beghou Consulting, India (Hybrid)

The Walt Disney Company - Lead Software Engineer (Roku Engineer)

The Walt Disney Company, United States (On-Site)

Get notifed when new similar jobs are uploaded