Cloud Native Engineer, ARK Large Model Platform (Singapore)

6 Months ago • 3 Years + • Research & Development • Artificial Intelligence

Job Summary

Job Description

ByteDance is seeking a Cloud Native Engineer to join their Applied Machine Learning (AML) - Enterprise team in Singapore. The role will focus on developing and maintaining the ARK Large Model Platform on VolcanoEngine, a cloud native resource scheduling system. The ideal candidate will have strong experience in cloud computing, large-scale model systems, and Golang/C++/Cuda development. The position involves tackling challenging tasks related to large language models, distributed training, and cluster management. Responsibilities include building efficient training and inference systems, managing distributed training jobs, constructing scalable ML systems, and investigating cutting-edge technologies in AI and machine learning.
Must have:
  • B. Sc or higher degree in Computer Science or related fields
  • 3+ years of R&D experience in cloud computing or large-scale model systems
  • Experience in Golang/C++/Cuda development
  • Understanding of Linux systems and cloud platforms
  • Knowledge of cloud-native orchestration technologies like Kubernetes
  • Experience in large-scale cluster maintenance and optimization
  • Grasp of computer networking, Linux file system, object storage services, SQL and NoSQL databases
  • Self-motivated, innovative, collaborative, and uphold high coding and documentation standards
Good to have:
  • Experience in developing ML platforms or MLOps platforms
  • Experience in distributed machine learning model training, ML model fine-tuning, and deployment

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The Applied Machine Learning (AML) - Enterprise team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities. Responsibilities Responsible for Ark Large Model Platform development on Volcano Engine, researching systematic solutions on large model solution implementations and applications in various industries, striving to reduce the IT cost of large model applications, meeting the users' ever-growing demand for intelligent interaction and improving the lifestyle and communications of users in the future world. - Maintain a large-scale AI cluster and develop state-of-the-art machine learning platforms to support a diverse group of stakeholders. - Tackle extremely challenging tasks which include, but are not limited to, delivering highly efficient training and inference for large language models, managing extremely effective distributed training jobs across clusters with over 10,000 nodes and GPU chips, and constructing highly reliable ML systems with unparalleled scalability. - The work encompasses various aspects of LLMOps (Large Language Model Operations), such as resource scheduling, task orchestration, model training, model inference, model management, dataset management, and workflow orchestration. - Investigate cutting-edge technologies related to large language models, AI, and machine learning at large, such as state-of-the-art distributed training systems with heterogeneous hardware, GPU utilization optimization, and the latest in hardware architecture. - Employ a variety of technological and mathematical analyses to enhance cluster efficiency and performance.
Qualifications
Minimum Qualifications - B. Sc or higher degree in Computer Science or related fields from accredited and reputable institutions with at least 3 years of R&D experience in the fields of cloud computing or large-scale model systems. - Experience in Golang/C++/Cuda development with a solid understanding of Linux systems and popular cloud platforms such as Volcano Engine Cloud, AWS, and Azure Cloud. - Profound knowledge of cloud-native orchestration technologies like Kubernetes, coupled with experience in large-scale cluster maintenance, job scheduling optimization, and cluster efficiency enhancement. - A strong grasp on various foundational areas of computer science, including computer networking, the Linux file system, object storage services, and SQL as well as NoSQL databases. - Self-motivated, thirst for innovation, collaborative working aptitude, and consistently uphold high standards in coding and documentation quality. Preferred Qualifications: - Experience in developing ML platforms or MLOps platforms. Experience in distributed machine learning model training, ML model fine-tuning, and deployment. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Veeam Software - Customer Success Strategic Representative

Veeam Software

Tokyo, Japan (On-Site)
1 Day ago
ION - Cloud Engineer Kubernetes

ION

Collecchio, Emilia-Romagna, Italy (Hybrid)
6 Months ago
RoofStack - Senior Platform Engineer

RoofStack

İstanbul, İstanbul, Türkiye (On-Site)
2 Months ago
Sporty Group - Data Engineer

Sporty Group

(Remote)
1 Month ago
Netflix - Software Engineer (L4) - Telemetry Collections

Netflix

United States (On-Site)
6 Months ago
ByteDance - Research Scientist in Large Model System

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
Astera Labs - Senior Digital Design Engineer - SOC

Astera Labs

Bengaluru, Karnataka, India (On-Site)
6 Months ago
NVIDIA - Senior Software Engineer - Ethernet Switch

NVIDIA

Ra'anana, Center District, Israel (Hybrid)
3 Months ago
Riot Games - Staff Software Engineer, Gameplay - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

PwC - Senior Manager_Data Engineering_D&A_Advisory _Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Synechron - Node JS & Springboot Developer (Scalable API Solutions)

Synechron

Chennai, Tamil Nadu, India (On-Site)
21 Hours ago
Argus Labs - Site Reliability Engineer (LATAM)

Argus Labs

(Remote)
1 Month ago
Meta - Production Engineering

Meta

Bellevue, Washington, United States (On-Site)
5 Months ago
PwC - IN_Senior Associate_Full Stack Developer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Mythical Games - Senior Live Game Engineer

Mythical Games

United States (Remote)
1 Week ago
Telnyx - Senior Software Engineer, Elixir

Telnyx

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Day ago
Ajmera Infotech - Site Reliability Engineer (SRE) - Kubernetes

Ajmera Infotech

Austin, Texas, United States (On-Site)
3 Months ago
DraftKings - Senior Data Science Engineer

DraftKings

London, England, United Kingdom (On-Site)
1 Week ago
ByteDance - Site Reliability Engineer - CapCut - San Jose/Seattle

ByteDance

San Jose, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

NinjaVan - Staff Driver Class 3/3A (First Mile/Last Mile)

NinjaVan

Singapore, Singapore (On-Site)
6 Months ago
Google - Customer Engineer, Google Cloud

Google

Singapore (On-Site)
2 Days ago
Limit Break - Sr. Mobile Game Designer

Limit Break

Singapore, Singapore (On-Site)
9 Months ago
PwC - Risk Services - Communication and Marketing Specialist

PwC

Singapore (On-Site)
7 Months ago
Netflix - APAC Ads B2B Scaled Programs Marketing Manager

Netflix

Singapore, Singapore (On-Site)
3 Months ago
Glean - Partner Manager

Glean

Singapore (Remote)
2 Months ago
NVIDIA - Director, Regional Developer Relations - ROAP

NVIDIA

Singapore (Remote)
2 Months ago
ByteDance - Tech Lead Manager - Global Payment - Singapore

ByteDance

Singapore (On-Site)
3 Months ago
Alpha Sense - Associate, Customer & Product Support

Alpha Sense

Singapore, Singapore (On-Site)
2 Months ago
ByteDance - Payment Risk Strategy Expert - Global Payment

ByteDance

Singapore (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

ByteDance - High-Performance Computing Research Scientist (Inference Optimization)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Corsair - Senior Hardware Developer

Corsair

Landshut, Bavaria, Germany (On-Site)
1 Month ago
Playtika - R&D Director

Playtika

Poland (Hybrid)
2 Months ago
Google - CPU Performance Modeling Engineer

Google

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
2 Weeks ago
NVIDIA - Staff Systems Software Engineer - Server

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
Google - Senior Software Engineer, Pixel Display System

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago
Riot Games - Staff Software Engineer, Rendering - League of Legends

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
ByteDance - Senior Algorithm Engineer, Trust and Safety

ByteDance

Singapore (On-Site)
6 Months ago
Luma Pictures - Emerging Technology Technical Director

Luma Pictures

Vancouver, British Columbia, Canada (On-Site)
1 Month ago
Google - Student Researcher, PhD, Winter/Summer 2025

Google

Montreal, Quebec, Canada (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

San Diego, California, United States (On-Site)

San Jose, California, United States (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

New York, New York, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug