Senior Big Data Developer

Paper Stacking games

Job Summary

Responsible for building and optimizing offline and real-time data warehouses, ensuring data accuracy, completeness, and efficient availability. Design reasonable data models, develop efficient ETL processes, and perform data layering and governance. Follow up on the implementation of data products in business scenarios, develop data applications and analysis tools to improve the usability and value of data services. Responsible for performance tuning of big data platforms and tasks, solving various technical problems, and ensuring stable and efficient system operation. Deeply understand game business, interface with business departments, and formulate and implement data solutions for complex business needs.

Must Have

  • Responsible for building and optimizing offline and real-time data warehouses, ensuring data accuracy, completeness, and efficient availability.
  • Design reasonable data models, develop efficient ETL processes, and perform data layering and data governance.
  • Follow up on the implementation of data products in business scenarios, develop data applications and analysis tools.
  • Responsible for performance tuning of big data platforms and tasks, solving various technical problems, and ensuring stable and efficient system operation.
  • Deeply understand game business, interface with business departments, and formulate and implement data solutions for complex business needs.
  • Bachelor's degree or above in Computer Science, Software Engineering, Data Analysis or related majors.
  • 5+ years of big data development experience.
  • Proficient in at least one programming language such as Java or Python, with solid coding skills and algorithm capabilities.
  • Proficient in big data ecosystem components such as Hadoop, Hive, Spark, Flink, Kafka.
  • Familiar with data warehouse theoretical system, layered design, and dimensional modeling.
  • Strong business understanding, able to independently handle complex business requirements, good at communication and teamwork.
  • Strong logical thinking, good technical sensitivity and learning drive, strong stress resistance, sense of responsibility and teamwork spirit.

Good to Have

  • Experience with Alibaba Cloud Maxcompute and ADB development.
  • Experience with PB-level data processing.

Job Description

Job Description

1. Responsible for the construction and optimization of offline and real-time data warehouses, ensuring the accuracy, completeness and efficient availability of data;

2. Design reasonable data models according to business needs, develop efficient ETL processes, and perform data layering and data governance;

3. Follow up on the implementation of data products in business scenarios, develop data applications and analysis tools to improve the usability and value of data services;

4. Responsible for performance tuning of big data platforms and tasks, solving various technical problems, and ensuring the stable and efficient operation of the system;

5. Deeply understand the game business, interface with business departments, and formulate and implement data solutions for complex business needs.

Job Requirements

1. Bachelor's degree or above, computer, software engineering, data analysis or related majors, 5 years or more of big data development experience;

2. Proficient in at least one programming language such as Java, Python, with solid coding skills and algorithm capabilities;

3. Proficient in big data ecosystem components such as Hadoop, Hive, Spark, Flink, Kafka, experience in Alibaba Cloud Maxcompute, ADB development is preferred;

4. Familiar with data warehouse theoretical system, layered design and dimensional modeling, experience in PB-level data processing is preferred;

5. Strong business understanding, able to independently handle complex business requirements, good at communication and teamwork;

6. Strong logical thinking, good technical sensitivity and learning drive, strong stress resistance, sense of responsibility and teamwork spirit.

8 Skills Required For This Role

Team Management Problem Solving Data Analytics Game Texts Hadoop Spark Python Java

Similar Jobs