Real-time Data Development

9 Minutes ago • 4 Years +
Data Analysis

Job Description

Participate in and lead the architecture design, solution selection, verification, and implementation of big data real-time data warehouses. Responsible for the design and development of automated real-time data access systems, realizing automated access of game log data. Participate in building a streaming-batch integrated self-service data analysis platform to support business users in quickly locating and analyzing data. Responsible for Flink stream computing engine scheduling and execution optimization to support stable operation of high-throughput, large-state jobs. Build a real-time data system for complex business scenarios to drive business growth.
Good To Have:
  • Experience in OLAP query optimization.
  • Familiar with Alibaba Cloud big data components such as MaxCompute, Hologres, DataWorks, ADB, and have experience using them.
  • Familiar with the technology stack and principles of agile interactive BI analysis products such as Tableau, Youshu BI, Guanyuan.
  • Familiar with the technology stack and principles of behavioral analysis products such as Shushu Technology, Shence Data.
  • Understand Python language, with development experience in crawlers, pandas.
Must Have:
  • Participate in and lead the architecture design, solution selection, verification, and implementation of big data real-time data warehouses.
  • Responsible for the design and development of automated real-time data access systems, realizing automated access of game log data.
  • Participate in building a streaming-batch integrated self-service data analysis platform.
  • Responsible for Flink stream computing engine scheduling and execution optimization, supporting high-throughput, large-state jobs.
  • Build a real-time data system for complex business scenarios, driving business.
  • Bachelor's degree or above in computer-related majors, 4+ years of experience in real-time data warehousing.
  • Familiar with open-source real-time big data technologies such as Kafka, Flink, Clickhouse, HBase, Doris.
  • Rich experience in stream processing performance, deep understanding of streaming-batch integration, with experience in PB-level online businesses preferred.
  • Possess 3+ years of Java development experience, proficient in frameworks like SpringBoot, SSM, Mybatis.
  • Possess certain DEBUG and performance optimization capabilities.

Add these skills to join the top 1% applicants for this job

team-management
communication
data-analytics
game-texts
agile-development
hbase
tableau
pandas
python
java

Job Description

1. Participate in and lead the architecture design, solution selection, verification, and implementation of big data real-time data warehouses.

2. Responsible for the design and development of automated real-time data access systems, realizing automated access of game log data.

3. Participate in building a streaming-batch integrated self-service data analysis platform, supporting business users to quickly locate and analyze data.

4. Responsible for Flink stream computing engine scheduling and execution optimization, supporting stable operation of high-throughput, large-state jobs.

5. Build a real-time data system for complex business scenarios, driving business.

Job Requirements

1. Bachelor's degree or above in computer-related majors, 4+ years of experience in real-time data warehousing.

2. Familiar with open-source real-time big data technologies such as Kafka, Flink, Clickhouse, HBase, Doris.

3. Rich experience in stream processing performance, deep understanding of streaming-batch integration, with experience in PB-level online businesses preferred.

4. Possess 3+ years of Java development experience, proficient in frameworks like SpringBoot, SSM, Mybatis, and have certain DEBUG and performance optimization capabilities.

5. Possess good learning ability, teamwork and communication skills, strong execution, a sense of responsibility for work, and good planning, communication, and coordination skills.

Bonus Points:

1. Experience in OLAP query optimization is preferred.

2. Familiar with Alibaba Cloud big data components such as MaxCompute, Hologres, DataWorks, ADB, and have experience using them is preferred.

3. Familiar with the technology stack and principles of agile interactive BI analysis products such as Tableau, Youshu BI, Guanyuan is preferred.

4. Familiar with the technology stack and principles of behavioral analysis products such as Shushu Technology, Shence Data is preferred.

5. Understand Python language, with development experience in crawlers, pandas is preferred.

Set alerts for more jobs like Real-time Data Development
Set alerts for new jobs by Paper Stacking games
Set alerts for new Data Analysis jobs in China
Set alerts for new jobs in China
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙