Senior Big Data Platform SRE Engineer

2 Months ago • 3 Years +
Data Analysis

Job Description

Technology Engineering Group (TEG) supports the company's technology and operational platforms, R&D management, and data center operations, providing comprehensive customer services. As the operator of Asia's largest networking, devices, and data center, TEG also leads the Tencent Technology Committee in strengthening infrastructure R&D. This role involves overseeing the operation and maintenance of overseas big data platforms, ensuring stability, assisting users with platform issues, optimizing workflows, developing efficiency tools, and optimizing big data cluster costs through new technologies.
Good To Have:
  • Databricks
  • Snowflake
Must Have:
  • Oversee the operation and maintenance of Tencent's overseas big data platforms to ensure platform and cluster stability.
  • Assist users in resolving issues related to big data platform usage, including but not limited to platform operations, component errors, and performance optimisation.
  • Optimise existing service workflows, standards, and pain points, and propose actionable solutions.
  • Develop front-end/back-end operational efficiency tools, including but not limited to: capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring.
  • Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses.

Add these skills to join the top 1% applicants for this job

problem-solving
data-analytics
game-texts
networking
hbase
linux
unix
spark
yarn
front-end
back-end
python
java

Business Unit

Technology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia,TEG also leads the Tencent Technology Committee in strengthening infrastructure R&D through internal and distributed open source collaboration, constructing new platforms and supporting business innovation.

What the Role Entails

1. Oversee the operation and maintenance of overseas big data platforms to ensure platform and cluster stability.

2. Assist users in resolving issues related to big data platform usage, including but not limited to platform operations, component errors, and performance optimisation.

3. Optimise existing service workflows, standards, and pain points, and propose actionable solutions.

4. Develop front-end/back-end operational efficiency tools, including but not limited to: capacity management platforms, DevOps frameworks, coverage analytics, automation systems, and health monitoring.

5. Optimise big data cluster costs by implementing new technologies or architectures to improve processing efficiency and reduce operational expenses.

Who We Look For

1. Proficient in ≥2 of these big data technologies: HDFS, YARN, Flink, Spark, Presto, Hive, HBase, StarRocks.

2 . Skilled in ≥1 programming language (Java/Python/Golang, etc.).

3. Expertise in Linux/Unix OS, system performance tuning, and failure resolution.

4.≥3 years of big data operation/development experience, with strong troubleshooting skills, technical sensitivity, and risk identification capabilities.

5 . Knowledge of mainstream big data platforms (e.g., Databricks, Snowflake) will be considered a strong plus.

Set alerts for more jobs like Senior Big Data Platform SRE Engineer
Set alerts for new jobs by Tencent
Set alerts for new Data Analysis jobs in Singapore
Set alerts for new jobs in Singapore
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙