Cloud Native Engineer, ARK Large Model Platform (Singapore)

5 Months ago • 3 Years + • Research & Development • Artificial Intelligence

Job Summary

Job Description

ByteDance is seeking a Cloud Native Engineer to join their Applied Machine Learning (AML) - Enterprise team in Singapore. The role will focus on developing and maintaining the ARK Large Model Platform on VolcanoEngine, a cloud native resource scheduling system. The ideal candidate will have strong experience in cloud computing, large-scale model systems, and Golang/C++/Cuda development. The position involves tackling challenging tasks related to large language models, distributed training, and cluster management. Responsibilities include building efficient training and inference systems, managing distributed training jobs, constructing scalable ML systems, and investigating cutting-edge technologies in AI and machine learning.
Must have:
  • B. Sc or higher degree in Computer Science or related fields
  • 3+ years of R&D experience in cloud computing or large-scale model systems
  • Experience in Golang/C++/Cuda development
  • Understanding of Linux systems and cloud platforms
  • Knowledge of cloud-native orchestration technologies like Kubernetes
  • Experience in large-scale cluster maintenance and optimization
  • Grasp of computer networking, Linux file system, object storage services, SQL and NoSQL databases
  • Self-motivated, innovative, collaborative, and uphold high coding and documentation standards
Good to have:
  • Experience in developing ML platforms or MLOps platforms
  • Experience in distributed machine learning model training, ML model fine-tuning, and deployment

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The Applied Machine Learning (AML) - Enterprise team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities. Responsibilities Responsible for Ark Large Model Platform development on Volcano Engine, researching systematic solutions on large model solution implementations and applications in various industries, striving to reduce the IT cost of large model applications, meeting the users' ever-growing demand for intelligent interaction and improving the lifestyle and communications of users in the future world. - Maintain a large-scale AI cluster and develop state-of-the-art machine learning platforms to support a diverse group of stakeholders. - Tackle extremely challenging tasks which include, but are not limited to, delivering highly efficient training and inference for large language models, managing extremely effective distributed training jobs across clusters with over 10,000 nodes and GPU chips, and constructing highly reliable ML systems with unparalleled scalability. - The work encompasses various aspects of LLMOps (Large Language Model Operations), such as resource scheduling, task orchestration, model training, model inference, model management, dataset management, and workflow orchestration. - Investigate cutting-edge technologies related to large language models, AI, and machine learning at large, such as state-of-the-art distributed training systems with heterogeneous hardware, GPU utilization optimization, and the latest in hardware architecture. - Employ a variety of technological and mathematical analyses to enhance cluster efficiency and performance.
Qualifications
Minimum Qualifications - B. Sc or higher degree in Computer Science or related fields from accredited and reputable institutions with at least 3 years of R&D experience in the fields of cloud computing or large-scale model systems. - Experience in Golang/C++/Cuda development with a solid understanding of Linux systems and popular cloud platforms such as Volcano Engine Cloud, AWS, and Azure Cloud. - Profound knowledge of cloud-native orchestration technologies like Kubernetes, coupled with experience in large-scale cluster maintenance, job scheduling optimization, and cluster efficiency enhancement. - A strong grasp on various foundational areas of computer science, including computer networking, the Linux file system, object storage services, and SQL as well as NoSQL databases. - Self-motivated, thirst for innovation, collaborative working aptitude, and consistently uphold high standards in coding and documentation quality. Preferred Qualifications: - Experience in developing ML platforms or MLOps platforms. Experience in distributed machine learning model training, ML model fine-tuning, and deployment. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Velotio Technologies - Senior DevOps Engineer (AWS)

Velotio Technologies

Pune, Maharashtra, India (Remote)
4 Weeks ago
Google - Systems Development Engineer, Customer Deployments, Google Cloud

Google

Munich, Bavaria, Germany (On-Site)
1 Week ago
Nagarro - Associate Staff Engineer

Nagarro

Philippines (Remote)
6 Months ago
NVIDIA - Senior Site Reliability Engineer - DGX Cloud

NVIDIA

California, United States (Remote)
1 Day ago
Evolution - C++ Developer (Python/Golang)

Evolution

Riga, Latvia (On-Site)
2 Weeks ago
NVIDIA - SDK Ethernet Software Team Manager

NVIDIA

Ra'anana, Center District, Israel (On-Site)
3 Months ago
Iksha Labs - Senior C++ Engineer

Iksha Labs

Gurugram, Haryana, India (On-Site)
7 Months ago
NVIDIA - Senior Tool and Methodology Development Software Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
NVIDIA - Packaging Technical Lead - Hardware

NVIDIA

California, United States (Hybrid)
2 Days ago
NVIDIA - Chip Architect

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

GoReel - DevOps Lead

GoReel

Romania (Remote)
4 Weeks ago
Tesla - Senior Software Engineer (Backend, .Net)

Tesla

Amsterdam, North Holland, Netherlands (On-Site)
2 Months ago
GoGuardian - Site Reliability Engineer

GoGuardian

India (Remote)
7 Months ago
Warner Bros Games - Senior Staff Engineer - Java-Commerce Team

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
3 Weeks ago
Rackspace Technology - Azure Cloud Engineer

Rackspace Technology

India (Remote)
1 Week ago
The Walt Disney Company - Lead Software Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
1 Month ago
Pocket Worlds - Senior Backend Engineer

Pocket Worlds

United States (Remote)
3 Weeks ago
Amber - Bazel Senior Build Engineer (Project Based)

Amber

Bucharest, Bucharest, Romania (Remote)
1 Month ago
Revolgy - L2 Cloud Operations Engineer

Revolgy

Georgia, United States (Remote)
4 Weeks ago
Thatgamecompany - Senior DevOps Engineer (LiveOps)

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Google - Customer Engineer, Platform Security, Google Cloud

Google

Singapore (On-Site)
1 Week ago
ByteDance - Traffic Access Architectural SRE - Traffic Infrastructure

ByteDance

Singapore (On-Site)
4 Weeks ago
ByteDance - PMO Team Lead

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - Strategy Product Manager - AI Innovation Products

ByteDance

Singapore (On-Site)
5 Months ago
Google - Industry Manager, Gaming and Apps, LCS

Google

Singapore (On-Site)
6 Days ago
ByteDance - Marketing Operations and Campaign Specialist

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - Technical Expert, Large Language Model

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Strategy Manager - Corporate Real Estate

ByteDance

Singapore (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Senior Physical Design Methodology Engineer

NVIDIA

Canada (On-Site)
1 Month ago
ByteDance - Research Scientist in Foundation Model (Speech & Audio Generation) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
ByteDance - Machine Learning Engineer - MLDev

ByteDance

Seattle, Washington, United States (On-Site)
1 Month ago
Google - Physical Design CAD Engineer, Static Timing Analysis

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Week ago
NVIDIA - Senior Firmware Engineer - Memory Subsystem

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
Microsoft - Technical Support Engineer

Microsoft

Bengaluru, Karnataka, India (Hybrid)
2 Days ago
NVIDIA - Principal SoC Architect - Hardware

NVIDIA

Westford, Massachusetts, United States (On-Site)
1 Week ago
Google - Software Engineer, Speed

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Days ago
Regent Craft - Embedded Software Engineering Intern

Regent Craft

North Kingstown, Rhode Island, United States (On-Site)
6 Months ago
Krafton  - HRD Specialist (2+ years / Contract)

Krafton

Seoul, South Korea (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

San Jose, California, United States (On-Site)

State Of São Paulo, Brazil (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug