Cloud Native Engineer, ARK Large Model Platform (Singapore)

8 Months ago • 3 Years + • Research Development

Job Summary

Job Description

ByteDance is seeking a Cloud Native Engineer to join their Applied Machine Learning (AML) - Enterprise team in Singapore. The role will focus on developing and maintaining the ARK Large Model Platform on VolcanoEngine, a cloud native resource scheduling system. The ideal candidate will have strong experience in cloud computing, large-scale model systems, and Golang/C++/Cuda development. The position involves tackling challenging tasks related to large language models, distributed training, and cluster management. Responsibilities include building efficient training and inference systems, managing distributed training jobs, constructing scalable ML systems, and investigating cutting-edge technologies in AI and machine learning.
Must have:
  • B. Sc or higher degree in Computer Science or related fields
  • 3+ years of R&D experience in cloud computing or large-scale model systems
  • Experience in Golang/C++/Cuda development
  • Understanding of Linux systems and cloud platforms
  • Knowledge of cloud-native orchestration technologies like Kubernetes
  • Experience in large-scale cluster maintenance and optimization
  • Grasp of computer networking, Linux file system, object storage services, SQL and NoSQL databases
  • Self-motivated, innovative, collaborative, and uphold high coding and documentation standards
Good to have:
  • Experience in developing ML platforms or MLOps platforms
  • Experience in distributed machine learning model training, ML model fine-tuning, and deployment

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance's sponsorship of a visa. Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The Applied Machine Learning (AML) - Enterprise team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities. Responsibilities Responsible for Ark Large Model Platform development on Volcano Engine, researching systematic solutions on large model solution implementations and applications in various industries, striving to reduce the IT cost of large model applications, meeting the users' ever-growing demand for intelligent interaction and improving the lifestyle and communications of users in the future world. - Maintain a large-scale AI cluster and develop state-of-the-art machine learning platforms to support a diverse group of stakeholders. - Tackle extremely challenging tasks which include, but are not limited to, delivering highly efficient training and inference for large language models, managing extremely effective distributed training jobs across clusters with over 10,000 nodes and GPU chips, and constructing highly reliable ML systems with unparalleled scalability. - The work encompasses various aspects of LLMOps (Large Language Model Operations), such as resource scheduling, task orchestration, model training, model inference, model management, dataset management, and workflow orchestration. - Investigate cutting-edge technologies related to large language models, AI, and machine learning at large, such as state-of-the-art distributed training systems with heterogeneous hardware, GPU utilization optimization, and the latest in hardware architecture. - Employ a variety of technological and mathematical analyses to enhance cluster efficiency and performance.
Qualifications
Minimum Qualifications - B. Sc or higher degree in Computer Science or related fields from accredited and reputable institutions with at least 3 years of R&D experience in the fields of cloud computing or large-scale model systems. - Experience in Golang/C++/Cuda development with a solid understanding of Linux systems and popular cloud platforms such as Volcano Engine Cloud, AWS, and Azure Cloud. - Profound knowledge of cloud-native orchestration technologies like Kubernetes, coupled with experience in large-scale cluster maintenance, job scheduling optimization, and cluster efficiency enhancement. - A strong grasp on various foundational areas of computer science, including computer networking, the Linux file system, object storage services, and SQL as well as NoSQL databases. - Self-motivated, thirst for innovation, collaborative working aptitude, and consistently uphold high standards in coding and documentation quality. Preferred Qualifications: - Experience in developing ML platforms or MLOps platforms. Experience in distributed machine learning model training, ML model fine-tuning, and deployment. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

magic media games - C++ Game Developer

magic media games

(Remote)
1 Month ago
Play everywhere - Software Engineer

Play everywhere

Yokohama, Kanagawa, Japan (On-Site)
3 Months ago
Meta - Software Engineering Manager, Product Infrastructure

Meta

Sunnyvale, California, United States (Remote)
7 Months ago
Thales - Junior Industrial Finance Controller

Thales

Singapore (On-Site)
1 Month ago
InnoPhase IoT - Staff/Sr. Staff PHY Design Engineer

InnoPhase IoT

San Jose, California, United States (On-Site)
2 Months ago
rivos - CPU Physical Design - Full Time

rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
8 Months ago
NVIDIA - Senior Data Scientist and System Architect

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
NVIDIA - Solutions Architect, Energy

NVIDIA

Saudi Arabia (Remote)
2 Months ago
Plaion - Disponent (m/w/d) mit Berufserfahrung

Plaion

Höfen An Der Enz, Baden-Württemberg, Germany (On-Site)
6 Months ago
bytedance - Backend Engineer - Applied Machine Learning Platform

bytedance

Singapore (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Take-Two Interactive - Lead Engineer

Take-Two Interactive

Massachusetts, United States (Remote)
2 Months ago
Ubisoft - Lead R&D Scientist

Ubisoft

Shanghai, Shanghai, China (On-Site)
2 Months ago
bytedance - Senior Software Engineer, Payment Solution

bytedance

San Jose, California, United States (On-Site)
8 Months ago
Qualcomm - Senior ASIC Platform Design Engineer

Qualcomm

Colombes, Île-de-France, France (On-Site)
1 Month ago
Blind Squirrel Games - Technical Director

Blind Squirrel Games

Auckland, Auckland, New Zealand (On-Site)
6 Months ago
Activision - Rigger

Activision

Shanghai, Shanghai, China (On-Site)
2 Months ago
Eqvilent - C++ Developer

Eqvilent

(Remote)
1 Month ago
Ion - Technical Support Analyst, Jersey City - 9781

Ion

Jersey City, New Jersey, United States (On-Site)
8 Months ago
Glean - Software Engineer - Consulting Services

Glean

Bengaluru, Karnataka, India (On-Site)
1 Month ago
NVIDIA - Senior Networking Architect

NVIDIA

Santa Clara, California, United States (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

PwC - Tax NewLaw - Senior Associate

PwC

Singapore (On-Site)
8 Months ago
bytedance - Backend Engineer - AML Framework Development

bytedance

Singapore (On-Site)
1 Month ago
PwC - Tax NewLaw - Senior Associate

PwC

Singapore (On-Site)
8 Months ago
NinjaVan - Delivery Attendant

NinjaVan

Singapore, Singapore (On-Site)
8 Months ago
bytedance - Innovation Tech Solution Sales (Cloud)

bytedance

Singapore (On-Site)
2 Months ago
Bushiroad - Localization Quality Assurance Executive/Senior Executive

Bushiroad

Singapore, Singapore (On-Site)
4 Months ago
Thales - Digital Sales Operation Analyst

Thales

Singapore (Hybrid)
1 Month ago
bytedance - Backend Software Engineer, Data Engineering

bytedance

Singapore (On-Site)
8 Months ago
bytedance - Product Manager - Compliance - Singapore

bytedance

Singapore (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Research Development Jobs

SideFX - Senior Compositing Software Developer/Technical Director

SideFX

Ontario, Canada (Hybrid)
3 Months ago
rivos - CPU Design Verification - Full-time

rivos

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Nahc.io - Software Engineer (Embedded Systems / Firmware)

Nahc.io

Hong Kong (On-Site)
8 Months ago
bytedance - GPU/AI Application Platform Engineer Intern (Server Platform)

bytedance

San Jose, California, United States (On-Site)
2 Months ago
bytedance - Research Scientist/Engineer - Multimodal Interaction & World Model

bytedance

Singapore (On-Site)
7 Months ago
NVIDIA - Senior Signal and Power Integrity Engineer - Hardware

NVIDIA

Santa Clara, California, United States (On-Site)
5 Months ago
NVIDIA - System Software Engineer - Base OS (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
5 Months ago
Riot Games - Technical Product Manager III - VALORANT, Cross-VALORANT Experience (XVX)

Riot Games

Dublin, County Dublin, Ireland (On-Site)
7 Months ago
Krafton - [Publishing] Lead of Game PR (5~10년)

Krafton

Seoul, South Korea (On-Site)
6 Months ago
Riot Games - Senior Product Inclusion Program Manager

Riot Games

Los Angeles, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug