Senior Data Backend Engineer (Ad Cloud)

4 Months ago • 3 Years +

Data Analysis

Job Description

As a Senior Data Backend Engineer, you will design, develop, and maintain RESTful APIs using Python. You'll build and manage robust data warehouses using ClickHouse, Trino/Presto, and Pinot. You will also design and develop data pipelines using Apache Airflow and Apache Spark. This role involves close collaboration with cross-functional teams, implementing monitoring systems, and working on cloud platforms like AWS and GCP. You'll be responsible for addressing queries and optimizing data operations. Requires 3+ years of experience in building large-scale distributed systems and knowledge of Kubernetes and Linux/Unix.

Good To Have:

Experience working with ClickHouse.
Contributing to open source projects (GitHub link).
Experience working with Python and Scala/Java.
Experience with Hadoop, Hive, Flink, Presto/Trino.
Experience with Public Cloud like AWS or GCP.

Must Have:

3+ years experience in large-scale systems.
Experience in Kubernetes development.
Experience in managing data lake/warehouse.
Expertise in data structures and algorithms.
Ability to work independently in a dynamic environment.

Add these skills to join the top 1% applicants for this job

saas-business-models

team-management

cross-functional

data-analytics

github

data-structures

linux

aws

unix

hadoop

spark

deep-learning

kubernetes

python

algorithms

scala

java

machine-learning

About Appier

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

Responsibilities

Design, develop, and maintain RESTful APIs using Python.
Build and manage robust data warehouses utilizing ClickHouse, Trino/Presto and Pinot.
Design and develop data pipelines using Apache Airflow and Apache Spark.
Work closely with cross-functional teams to develop automation tools that streamline daily operations.
Implement state-of-the-art monitoring and alerting systems to ensure optimal system performance and stability.
Address queries from applications in a timely and effective manner, ensuring high client satisfaction.
Work on cloud platforms such as AWS and GCP, leveraging their capabilities to optimize data operations.
Utilize Kubernetes (k8s) for container orchestration to facilitate efficient deployment and scaling of applications.

About you

[Minimum qualifications]

BS/MS degree in Computer Science
3+ years of experience in building and operating large-scale distributed systems or applications
Experience in Kubernetes development, Linux/Unix
Experience in managing data lake or data warehouse
Expertise in developing data structures, algorithms on top of Big Data platforms
Ability to operate effectively and independently in a dynamic, fluid environment
Ability to work in a fast-moving team environment and juggle many tasks and projects
Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

Experience working with ClickHouse is a big plus
Contributing to open source projects is a huge plus (please include your github link)
Experience working with Python, Scala/Java is a plus
Experience with Hadoop, Hive, Flink, Presto/Trino and related big data systems is a plus
Experience with Public Cloud like AWS or GCP is a plus

#LI-AK1

Set alerts for more jobs like Senior Data Backend Engineer (Ad Cloud)

Set alerts for new jobs by appier

Set alerts for new Data Analysis jobs in Taiwan

Set alerts for new jobs in Taiwan

Set alerts for Data Analysis (Remote) jobs