Senior Data Backend Engineer (Ad Cloud)

1 Month ago • 3 Years + • Data Analysis

Job Summary

Job Description

As a Senior Data Backend Engineer, you will design, develop, and maintain RESTful APIs using Python. You'll build and manage robust data warehouses using ClickHouse, Trino/Presto, and Pinot. You will also design and develop data pipelines using Apache Airflow and Apache Spark. This role involves close collaboration with cross-functional teams, implementing monitoring systems, and working on cloud platforms like AWS and GCP. You'll be responsible for addressing queries and optimizing data operations. Requires 3+ years of experience in building large-scale distributed systems and knowledge of Kubernetes and Linux/Unix.
Must have:
  • 3+ years experience in large-scale systems.
  • Experience in Kubernetes development.
  • Experience in managing data lake/warehouse.
  • Expertise in data structures and algorithms.
  • Ability to work independently in a dynamic environment.
Good to have:
  • Experience working with ClickHouse.
  • Contributing to open source projects (GitHub link).
  • Experience working with Python and Scala/Java.
  • Experience with Hadoop, Hive, Flink, Presto/Trino.
  • Experience with Public Cloud like AWS or GCP.

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain RESTful APIs using Python.
  • Build and manage robust data warehouses utilizing ClickHouse, Trino/Presto and Pinot.
  • Design and develop data pipelines using Apache Airflow and Apache Spark.
  • Work closely with cross-functional teams to develop automation tools that streamline daily operations.
  • Implement state-of-the-art monitoring and alerting systems to ensure optimal system performance and stability.
  • Address queries from applications in a timely and effective manner, ensuring high client satisfaction.
  • Work on cloud platforms such as AWS and GCP, leveraging their capabilities to optimize data operations.
  • Utilize Kubernetes (k8s) for container orchestration to facilitate efficient deployment and scaling of applications.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 3+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in Kubernetes development, Linux/Unix
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Ability to work in a fast-moving team environment and juggle many tasks and projects
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Experience working with ClickHouse is a big plus
  • Contributing to open source projects is a huge plus (please include your github link)
  • Experience working with Python, Scala/Java is a plus
  • Experience with Hadoop, Hive, Flink, Presto/Trino and related big data systems is a plus  
  • Experience with Public Cloud like AWS or GCP is a plus 

 

#LI-AK1

Similar Jobs

Diligent Corporation - Accounts Receivable Specialist

Diligent Corporation

Galway, County Galway, Ireland (Hybrid)
2 Weeks ago
Glean - Product Manager, LLM Infrastructure

Glean

Palo Alto, California, United States (Hybrid)
1 Month ago
e2 open - Enterprise Service Engineer - Java

e2 open

Hyderabad, Telangana, India (On-Site)
4 Weeks ago
Kaseya - Senior Engineer - Cloud Ops

Kaseya

Bengaluru, Karnataka, India (On-Site)
8 Months ago
EveryMatrix - Senior Frontend Developer (JavaScript)

EveryMatrix

Kyiv, Kyiv City, Ukraine (Hybrid)
1 Week ago
bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
3 Months ago
Lionbridge Games - Business Analyst

Lionbridge Games

Mexico City, Mexico (On-Site)
3 Weeks ago
Enphase Energy - Senior Data Scientist

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
10 Months ago
TransUnion - Sr Analyst, Data Science and Analytics

TransUnion

Mumbai, Maharashtra, India (Hybrid)
1 Month ago
London stock Exchange - Market Data Engineer

London stock Exchange

St. Louis, Missouri, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Rippling - Account Manager - Strategic, Growth & Retention (HR Services Channel)

Rippling

San Francisco, California, United States (Hybrid)
2 Months ago
USE Insider - Solutions Architect - Korea

USE Insider

Seoul, South Korea (Hybrid)
8 Months ago
Rippling - Customer Support Supervisor

Rippling

Bengaluru, Karnataka, India (Hybrid)
2 Days ago
Simcorp - Value Stream Head, SimCorp One

Simcorp

Copenhagen, Denmark (Hybrid)
1 Month ago
Otherside Entertainment - Lead Game Designer - Thick As Thieves

Otherside Entertainment

United States (Remote)
1 Month ago
Egnyte - Software Engineer - Java

Egnyte

Poznań, Greater Poland Voivodeship, Poland (On-Site)
2 Months ago
zeta - Manager - Strategic Partnerships

zeta

Mumbai, Maharashtra, India (On-Site)
8 Months ago
JDA - Sr Support Engineer 1

JDA

Monterrey, Nuevo Leon, Mexico (On-Site)
2 Weeks ago
Ness - Senior Product Manager

Ness

New York, New York, United States (On-Site)
2 Weeks ago
Varonis  - Python Team Leader

Varonis

Herzliya, Tel Aviv District, Israel (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

rivos - Silicon Product eFA Engineer

rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
1 Week ago
Alphawave Semi - IP Application Engineer (Post Silicon)

Alphawave Semi

Hsinchu City, Taiwan (Remote)
4 Weeks ago
Trend Micro - Engineer - Threat Research (MITRE)

Trend Micro

Taipei City, Taiwan (On-Site)
3 Weeks ago
winking Entertainment - Game Character Modeling Art Designer

winking Entertainment

Taipei City, Taiwan (On-Site)
1 Month ago
PwC - Senior ESG Consultant (Corporate Sustainability Management)

PwC

Taipei City, Taiwan (On-Site)
2 Weeks ago
NVIDIA - Senior Verification Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
binance - Operations Specialist - Web3 Wallet

binance

Taipei City, Taiwan (Remote)
3 Months ago
Ansys - Senior Application Engineer - Optics

Ansys

Taipei City, Taiwan (On-Site)
4 Weeks ago
appier - Campaign Analyst (US)

appier

Taipei City, Taiwan (On-Site)
1 Month ago
GoMotive - Manufacturing Test Engineer

GoMotive

Taipei City, Taiwan (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Ciklum - Senior Data Scientist

Ciklum

Chennai, Tamil Nadu, India (Hybrid)
8 Months ago
WebFX - Data Architect (Cape Town)

WebFX

Cape Town, Western Cape, South Africa (On-Site)
6 Months ago
whoop - Senior Data Scientist (Insights)

whoop

Boston, Massachusetts, United States (On-Site)
1 Month ago
CommerceIQ - Senior Manager- Data Science

CommerceIQ

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Nintendo - Principal Business Systems Analyst

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
chess.com - Senior Data Scientist - Product

chess.com

United States (Remote)
1 Year ago
dun bradstreet - Principal, Data Scientist

dun bradstreet

Oslo, Oslo, Norway (Hybrid)
1 Week ago
Nintendo - Business Systems Analyst (Salesforce Project Manager)

Nintendo

Redmond, Washington, United States (Hybrid)
4 Months ago
bytedance - Data Engineer - Global Payment - Singapore

bytedance

Singapore (On-Site)
7 Months ago
Razer - Senior Data Scientist

Razer

Singapore (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded