Senior Software Engineer, Data Backend

13 Hours ago • 2 Years +

Job Summary

Job Description

As a Senior Software Engineer, Data Backend at Appier, you will be involved in building critical components of their data platform. Your responsibilities will include designing, developing, and maintaining data pipelines, building and optimizing data platforms like Spark and Kafka clusters, and tuning performance of critical components. You will also provide expert advice to enhance big data systems and applications, establish foundational architecture, and propose solutions for streamlined software development and monitoring. The role requires you to work effectively and independently within a dynamic environment.

Must have:

BS/MS in Computer Science
2+ years in large-scale distributed systems
Experience developing Java/Scala projects
Experience in building data pipelines using Apache Spark
Experience managing data lake or data warehouse
Expertise in data structures and algorithms on Big Data platforms
Ability to operate effectively and independently
Eagerness to learn and build

Good to have:

Experience in developing Golang/Python projects
Experience in profiling and optimizing JVM performance
Experience managing data platforms (Hadoop, Kafka, etc.)
Experience in cloud services (AWS, GCP, Azure)
Experience in contributing to open source projects
Experience in open table formats (Apache Iceberg, etc.)

14 skills required

14 skills required for this role

Add these skills to join the top 1% applicants for this job

java

algorithms

scala

github

spark

deep-learning

azure

aws

data-structures

python

hadoop

data-analytics

saas-business-models

team-management

Job Details

About Appier

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

Responsibilities

Design, develop, and maintain data pipelines
Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
Profile and tune performance of critical components
Provide expert advice and solutions to enhance the performance of big data systems and applications
Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.

About you

[Minimum qualifications]

BS/MS degree in Computer Science
2+ years of experience in building and operating large-scale distributed systems or applications
Experience in developing Java/Scala project
Experience in building data pipeline using Apache Spark
Experience in managing data lake or data warehouse
Expertise in developing data structures, algorithms on top of Big Data platforms
Ability to operate effectively and independently in a dynamic, fluid environment
Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

Experience in developing Golang/Python project
Experience in profiling and optimizing JVM performance
Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
Experience in cloud service (AWS, GCP, Azure)
Experience in contributing to open source projects (please provide your github link)
Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)

#LI-AK1