Senior Software Engineer, Data Backend(CrossX)

5 Months ago • 3 Years + • Full Stack Development

Job Summary

Job Description

As a Senior Software Engineer, Data Backend at Appier, you'll design, develop, and maintain RESTful APIs using Python, build and manage data warehouses (Trino/Presto, Pinot), and design data pipelines (Airflow, Spark). You'll collaborate with cross-functional teams to create automation tools, implement monitoring systems, and ensure optimal system performance. Responsibilities include addressing application queries, working with AWS/GCP, and utilizing Kubernetes for deployment and scaling. The role requires expertise in large-scale distributed systems and big data technologies.
Must have:
  • Python, RESTful APIs
  • Data Warehouses (Trino/Presto, Pinot)
  • Data Pipelines (Airflow, Spark)
  • Kubernetes
  • AWS/GCP
  • Big Data Platforms
Good to have:
  • Open Source Contributions
  • Scala/Java
  • Hadoop, Hive, Flink

Job Details

About Appier 

Appier is a software-as-a-service (SaaS) company that uses artificial intelligence (AI) to power business decision-making. Founded in 2012 with a vision of democratizing AI, Appier’s mission is turning AI into ROI by making software intelligent. Appier now has 17 offices across APAC, Europe and U.S., and is listed on the Tokyo Stock Exchange (Ticker number: 4180). Visit www.appier.com for more information.

 

About the role

Appier’s solutions are powered by proprietary deep learning and machine learning technologies to empower every business to use AI to turn data into business insights and decisions. As a Software Engineer, Data Backend, you will be involved in helping to build critical components of this platform.

 

Responsibilities

  • Design, develop, and maintain RESTful APIs using Python.
  • Build and manage robust data warehouses utilizing Trino/Presto and Pinot.
  • Design and develop data pipelines using Apache Airflow and Apache Spark.
  • Work closely with cross-functional teams to develop automation tools that streamline daily operations.
  • Implement state-of-the-art monitoring and alerting systems to ensure optimal system performance and stability.
  • Address queries from applications in a timely and effective manner, ensuring high client satisfaction.
  • Work on cloud platforms such as AWS and GCP, leveraging their capabilities to optimize data operations.
  • Utilize Kubernetes (k8s) for container orchestration to facilitate efficient deployment and scaling of applications.

 

About you

[Minimum qualifications]

  • BS/MS degree in Computer Science
  • 3+ years of experience in building and operating large-scale distributed systems or applications
  • Experience in Kubernetes development, Linux/Unix
  • Experience in managing data lake or data warehouse
  • Expertise in developing data structures, algorithms on top of Big Data platforms
  • Ability to operate effectively and independently in a dynamic, fluid environment
  • Ability to work in a fast-moving team environment and juggle many tasks and projects
  • Eagerness to change the world in a huge way by being a self-motivated learner and builder

[Preferred qualifications]

  • Contributing to open source projects is a huge plus (please include your github link)
  • Experience working with Python, Scala/Java is a plus
  • Experience with Hadoop, Hive, Flink, Presto/Trino and related big data systems is a plus  
  • Experience with Public Cloud like AWS or GCP is a plus 

Similar Jobs

ByteDance - Linux System Engineer

ByteDance

London, England, United Kingdom (On-Site)
2 Weeks ago
Veeam Software - Senior Systems Engineer

Veeam Software

New Delhi, Delhi, India (On-Site)
1 Day ago
Veeam Software - Veeam Backup for Microsoft Office 365 Engineer

Veeam Software

Tokyo, Japan (On-Site)
1 Day ago
Veeam Software - Associate Talent Acquisition Partner

Veeam Software

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Day ago
AGS - American Gaming Systems - Lead DevSecOps Engineer

AGS - American Gaming Systems

Georgia (On-Site)
3 Weeks ago
Google - Software Engineer III, Google Cloud Platforms

Google

(On-Site)
4 Months ago
Next Level Business Services - Software Design Engineer

Next Level Business Services

Redmond, Washington, United States (On-Site)
6 Months ago
Google - Senior Software Engineer, Embedded Systems/Firmware, Platforms Infrastructure Engineering

Google

Sunnyvale, California, United States (On-Site)
5 Months ago
Microsoft - Software Engineer II - CTJ - Top Secret

Microsoft

Redmond, Washington, United States (On-Site)
2 Days ago
Luxoft - Senior Angular Developer

Luxoft

Toronto, Ontario, Canada (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Veeam Software - Enterprise Account Manager

Veeam Software

(Remote)
1 Day ago
Veeam Software - Inside Sales Representative, UK & Ireland

Veeam Software

Bucharest, Bucharest, Romania (On-Site)
1 Day ago
Canva - Senior Machine Learning Engineer - Photo AI

Canva

Prague, Czechia (Remote)
3 Months ago
Auros Global - Senior Site Reliability Engineer

Auros Global

United Kingdom (Remote)
1 Month ago
Canva - Senior Software Engineer - Cloud Security & Compliance, remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
4 Months ago
Alphasense - Software Engineer II, Full Stack

Alphasense

Delhi, India (On-Site)
1 Day ago
Netflix - SRE Manager

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Argus Labs - Software Engineer (Infrastructure/Backend)

Argus Labs

(Remote)
1 Month ago
Spectro Cloud - Senior Software Test Engineer

Spectro Cloud

Bengaluru, Karnataka, India (Hybrid)
11 Months ago
Veeam Software - DevOps Engineer with CI/CD focus

Veeam Software

Bucharest, Bucharest, Romania (Hybrid)
1 Day ago

Get notifed when new similar jobs are uploaded

Jobs in Taipei City, Taiwan

Ansys - Team Lead Field Marketing

Ansys

Taipei City, Taiwan (On-Site)
1 Day ago
NVIDIA - Senior Generalist Software Engineer -- Omniverse

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
2 Months ago
Trend Micro - Automotive Research Engineer - Threat Intelligence & Content Creation (VicOne)

Trend Micro

Taipei City, Taiwan (On-Site)
7 Months ago
Google - Cloud Technical Solutions Engineer, Infrastructure

Google

Taipei City, Taiwan (On-Site)
2 Days ago
Crypto - Senior Designer (2D/3D Motion)

Crypto

Taipei City, Taiwan (Remote)
9 Months ago
Google - Senior GPU System Architect

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
Google - Senior Server Qualification Engineer, Google Cloud

Google

Taipei City, Taiwan (On-Site)
2 Days ago
Google - Senior Software Engineer, Location and Context, Android

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago
NVIDIA - Senior Mechanical Application Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
1 Week ago
Google - Software Engineering Manager II, Camera and Media, Android

Google

New Taipei, New Taipei City, Taiwan (On-Site)
2 Days ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Nagarro - Associate Engineer ,SAP Human Experience Management

Nagarro

Spain (Remote)
6 Months ago
Hitachi - Power Platform Developers-Mar 2024

Hitachi

Pune, Maharashtra, India (On-Site)
6 Months ago
Nolimit City - Senior Software Engineer

Nolimit City

Stockholm, Stockholm County, Sweden (Hybrid)
5 Months ago
Gaming Innovation Group  - Senior .NET Backend Developer

Gaming Innovation Group

St. Julian's, Malta (Hybrid)
1 Month ago
Google - Software Engineer II, Unified Autoscaling Services

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Vigaet - Internship-Node.Js Developer

Vigaet

(Remote)
5 Months ago
Google - Staff Software Engineer, Google Cloud

Google

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Netflix - Distributed Systems Engineer (L5) - Delivery

Netflix

United States (Remote)
2 Weeks ago
Google - Customer Solutions Engineer

Google

New York, New York, United States (On-Site)
1 Week ago
Armada - Senior Software Engineer

Armada

Thiruvananthapuram, Kerala, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded