1. Participate in and lead the architecture design, solution selection, verification, and implementation of big data real-time data warehouses.
2. Responsible for the design and development of automated real-time data access systems, realizing automated access of game log data.
3. Participate in building a streaming-batch integrated self-service data analysis platform, supporting business users to quickly locate and analyze data.
4. Responsible for Flink stream computing engine scheduling and execution optimization, supporting stable operation of high-throughput, large-state jobs.
5. Build a real-time data system for complex business scenarios, driving business.
1. Bachelor's degree or above in computer-related majors, 4+ years of experience in real-time data warehousing.
2. Familiar with open-source real-time big data technologies such as Kafka, Flink, Clickhouse, HBase, Doris.
3. Rich experience in stream processing performance, deep understanding of streaming-batch integration, with experience in PB-level online businesses preferred.
4. Possess 3+ years of Java development experience, proficient in frameworks like SpringBoot, SSM, Mybatis, and have certain DEBUG and performance optimization capabilities.
5. Possess good learning ability, teamwork and communication skills, strong execution, a sense of responsibility for work, and good planning, communication, and coordination skills.
1. Experience in OLAP query optimization is preferred.
2. Familiar with Alibaba Cloud big data components such as MaxCompute, Hologres, DataWorks, ADB, and have experience using them is preferred.
3. Familiar with the technology stack and principles of agile interactive BI analysis products such as Tableau, Youshu BI, Guanyuan is preferred.
4. Familiar with the technology stack and principles of behavioral analysis products such as Shushu Technology, Shence Data is preferred.
5. Understand Python language, with development experience in crawlers, pandas is preferred.