Senior Software Engineer, Data Backend (Data Platform)
Job Summary
Job Description
- BS/MS in Computer Science
- 2+ years building/operating large-scale distributed systems
- Java/Scala development experience
- Experience building data pipelines with Apache Spark
- Experience managing data lakes/warehouses
- Expertise in data structures and algorithms on Big Data platforms
- Ability to work independently in a dynamic environment
- Self-motivated learner and builder
- Golang/Python development experience
- JVM performance profiling/optimization
- Experience managing Hadoop, Kafka, Flink, Trino/ClickHouse
- Cloud service experience (AWS, GCP, Azure)
- Open source contribution experience
- Experience with open table formats (Iceberg, Delta Lake, Hudi)
15 skills required
Job Details
About Appier
Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.
About the role
Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.
Responsibilities
- Design, develop, and maintain data pipelines
- Build, manage, and optimize data platforms (e.g., Spark clusters, Kafka clusters)
- Profile and tune performance of critical components
- Provide expert advice and solutions to enhance the performance of big data systems and applications
- Establish and improve the foundational architecture for platforms, and propose solutions to streamline software development, monitoring, etc.
About you
[Minimum qualifications]
- BS/MS degree in Computer Science
- 2+ years of experience in building and operating large-scale distributed systems or applications
- Experience in developing Java/Scala project
- Experience in building data pipeline using Apache Spark
- Experience in managing data lake or data warehouse
- Expertise in developing data structures, algorithms on top of Big Data platforms
- Ability to operate effectively and independently in a dynamic, fluid environment
- Eagerness to change the world in a huge way by being a self-motivated learner and builder
[Preferred qualifications]
- Experience in developing Golang/Python project
- Experience in profiling and optimizing JVM performance
- Experience in managing data platforms, such as Hadoop, Kafka, Flink, Trino/ClickHouse, etc.
- Experience in cloud service (AWS, GCP, Azure)
- Experience in contributing to open source projects (please provide your github link)
- Experience in open table formats (Apache Iceberg, Delta Lake, Hudi)
#LI-AK1
Similar Jobs
Looks like we're out of matches
Similar Skill Jobs
Looks like we're out of matches
Jobs in Taipei City, Taiwan
Looks like we're out of matches
Data Analysis Jobs
Looks like we're out of matches
