Software Engineer (HDFS), Technical Infrastructures

1 Month ago • 2 Years + • Full Stack Development

Job Summary

Job Description

This Software Engineer (HDFS) role in Singapore involves platform infrastructure development, improving HDFS storage system stability, scalability, functionality, performance, and cost. Responsibilities include providing technical support for online applications, identifying optimization needs, and continuously optimizing the system. The team manages tens of exabytes of data and offers a structured training program for professional growth. The ideal candidate possesses strong programming skills (C/C++/Java), Linux system familiarity, and distributed systems knowledge. Experience with large-scale data management is essential.
Must have:
  • Platform infrastructure development
  • Improve HDFS storage system
  • Provide technical support
  • Strong programming skills (C/C++/Java)
  • Linux system familiarity
  • Distributed systems knowledge
  • Large-scale data management experience
Good to have:
  • HDFS principles knowledge
  • Low-level OS expertise
  • Experience with Hadoop, HDFS, Flink, Spark, ClickHouse, Apache Doris
  • Open-source contribution
  • Mentoring junior engineers

Job Details

Responsibilities
About the Team The team located in Singapore responsible for HDFS Storage plays a crucial role in supporting key products and core business lines, overseeing the management of extensive amounts of data, totalling tens of exabytes. With a wealth of expertise in source code and architecture optimization within the realm of HDFS, our team has consistently contributed to the technological advancement of large-scale storage systems, ensuring TikTok receives dependable, efficient, and user-friendly big data storage services. By joining this team, you can anticipate a well-structured training program and the opportunity to handle a broader scope of responsibilities, allowing ample room for personal and professional growth. What you will be doing: - Involve in platform-related infrastructure development; - Continuously improve the storage system in terms of stability, scalability, functionality, performance and cost; - Provide timely technical support for our online applications, extract potential needs and points of optimisation, and continuously optimise the system.
Qualifications
Minimum Qualifications: - Bachelor's Degree or above, majoring in Computer Science, or related fields, with 2+ years of relevant development experience in the field with a strong programming ability, and proficiency in one of C/C++/Java; - Familiar with Linux systems, with high proficiency in multi-threading and network programming; - Solid knowledge of data structure, operating system, and principles of the distributed system; - A willingness to tackle challenging problems without clear solutions, a strong enthusiasm for learning new technologies, and prior experience in managing large-scale data. Preferred Qualifications: - Knowledge of HDFS principles is preferred; - Display expertise in low-level aspects of operating systems, with a background in optimizing system performance for TCP/IP, I/O operations, and other critical component; - Expert in working on one or more of these technologies is a plus: Hadoop, HDFS, Flink, Spark, ClickHouse, Apache Doris; - Contributor/Committer or PMC of the open-source community is a plus; - Possess expertise in mentoring junior engineers, developing professional learning objectives and training strategies, and playing a pivotal role in overseeing the advancement of new team members as the project's core focus.
Job Information
About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Gaming Innovation Group  - Infrastructure Engineer

Gaming Innovation Group

Community Of Madrid, Spain (Hybrid)
1 Month ago
Next Level Business Services - Hybris Developer

Next Level Business Services

Sunnyvale, California, United States (On-Site)
6 Months ago
Google - Software Engineering Manager, People with Disabilities

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
5 Months ago
ByteDance - Cloud Site Reliability Engineer

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
ByteDance - Tech Lead - Global E-Commerce Supply Chain

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
PhonePe - Software Engineer (Backend, 3 to 5 yrs)

PhonePe

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Interactive Brokers - Senior Python Developer – Compliance Technology

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
Epic Games - Senior Web Programmer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
Nagarro - Associate Distinguished Engineer, Enterprise Architect

Nagarro

France (Remote)
6 Months ago
Mozilla - Staff Machine Learning Engineer, Gen AI

Mozilla

Spain (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

StoneX Group  Inc  - UAT Tester

StoneX Group Inc

Bengaluru, Karnataka, India (On-Site)
6 Months ago
The Walt Disney Company - Senior Software Engineer - Audience Targeting

The Walt Disney Company

Seattle, Washington, United States (On-Site)
3 Months ago
The Walt Disney Company - Manager, Software Engineering – Media and Playback Data Processing

The Walt Disney Company

Seattle, Washington, United States (On-Site)
1 Month ago
Google - Software Engineer, Early Career (For Women in Tech Candidates)

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
5 Months ago
NinjaVan - Staff Data Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
6 Months ago
Interactive Brokers - Software Engineer - Java

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
Epic Games - Senior Gameplay Systems Programmer, Fortnite

Epic Games

London, England, United Kingdom (On-Site)
2 Months ago
Cognitree - Senior Software Engineer

Cognitree

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Nagarro - Senior Engineer, Hybris

Nagarro

Sri Lanka (Remote)
6 Months ago
Qatar Airways - DevOps Engineer

Qatar Airways

Ahmedabad, Gujarat, India (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Research Engineer (Foundation Model) - Machine Learning Systems

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Android/iOS Engineer, Flow - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Backend Software Engineer - Privacy & Security - Singapore

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Data Analyst - AI Innovation Business

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Threat Intelligence Engineer, Security Assurance

ByteDance

Singapore (On-Site)
5 Months ago
The Walt Disney Company - Associate Manager, Asset Management & Technology

The Walt Disney Company

Singapore, Singapore (On-Site)
2 Months ago
ByteDance - Cloud Technical Support Engineer

ByteDance

Singapore (On-Site)
1 Month ago
The Walt Disney Company - Intern, Digital & Social Media Marketing, Disney+ & Studios

The Walt Disney Company

Singapore, Singapore (On-Site)
2 Months ago
HoYoverse - Quest Designer

HoYoverse

Singapore (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Full Stack Development Jobs

Newzoo - Full Stack Python Developer

Newzoo

North Holland, Netherlands (Hybrid)
4 Months ago
Behaviour Interactive - Senior Fullstack Programmer - Core Technologies

Behaviour Interactive

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Level AI - FullStack Engineer - AI (Noida, India)

Level AI

Noida, Uttar Pradesh, India (Hybrid)
6 Months ago
Alpha Sense - Senior Software Engineer - Vector Search

Alpha Sense

New York, New York, United States (On-Site)
4 Months ago
PAPAYA - DevOps Engineer

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Months ago
N-iX - .NET Backend Engineer

N-iX

Poland (Hybrid)
1 Month ago
CloudHire - Senior Software Engineer - Kotlin

CloudHire

Karnataka, India (Remote)
1 Month ago
Code and Theory - Senior Engineer, Back-end

Code and Theory

Karnataka, India (Remote)
6 Months ago
Lakshya Digital - Dot Net Developer

Lakshya Digital

Gurugram, Haryana, India (On-Site)
1 Month ago
Aristocrat Gaming - iOS Developer

Aristocrat Gaming

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

San Jose, California, United States (On-Site)

State Of São Paulo, Brazil (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug