Senior Data Backend Engineer (Ad Cloud)

58 Minutes ago • 3 Years +

Job Summary

Job Description

As a Senior Data Backend Engineer, you will design, develop, and maintain RESTful APIs using Python. You'll build and manage robust data warehouses using ClickHouse, Trino/Presto, and Pinot. You will also design and develop data pipelines using Apache Airflow and Apache Spark. This role involves close collaboration with cross-functional teams, implementing monitoring systems, and working on cloud platforms like AWS and GCP. You'll be responsible for addressing queries and optimizing data operations. Requires 3+ years of experience in building large-scale distributed systems and knowledge of Kubernetes and Linux/Unix.
Must have:
  • 3+ years experience in large-scale systems.
  • Experience in Kubernetes development.
  • Experience in managing data lake/warehouse.
  • Expertise in data structures and algorithms.
  • Ability to work independently in a dynamic environment.
Good to have:
  • Experience working with ClickHouse.
  • Contributing to open source projects (GitHub link).
  • Experience working with Python and Scala/Java.
  • Experience with Hadoop, Hive, Flink, Presto/Trino.
  • Experience with Public Cloud like AWS or GCP.

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain RESTful APIs using Python.
  • Build and manage robust data warehouses utilizing ClickHouse, Trino/Presto and Pinot.
  • Design and develop data pipelines using Apache Airflow and Apache Spark.
  • Work closely with cross-functional teams to develop automation tools that streamline daily operations.
  • Implement state-of-the-art monitoring and alerting systems to ensure optimal system performance and stability.
  • Address queries from applications in a timely and effective manner, ensuring high client satisfaction.
  • Work on cloud platforms such as AWS and GCP, leveraging their capabilities to optimize data operations.
  • Utilize Kubernetes (k8s) for container orchestration to facilitate efficient deployment and scaling of applications.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 3+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in Kubernetes development, Linux/Unix
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Ability to work in a fast-moving team environment and juggle many tasks and projects
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience working with ClickHouse is a big plus
  • Contributing to open source projects is a huge plus (please include your github link)
  • Experience working with Python, Scala/Java is a plus
  • Experience with Hadoop, Hive, Flink, Presto/Trino and related big data systems is a plus  
  • Experience with Public Cloud like AWS or GCP is a plus 

 

#LI-AK1

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Taipei City, Taiwan

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Taipei City, Taiwan (On-Site)

Paris, Île-de-France, France (On-Site)

View All Jobs

Get notified when new jobs are added by Appier

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug