Software Engineer - Machine Learning Training

1 Month ago • 3 Years + • Research & Development

Job Summary

Job Description

ByteDance's Large Model Team seeks a Software Engineer specializing in Machine Learning training in Singapore. This role focuses on building and optimizing the next generation of SFT/RL training frameworks for LLMs and AIGCs. Responsibilities include enhancing training efficiency (memory usage reduction, model parallelism tuning), ensuring framework ease-of-use, and collaborating with product teams. The ideal candidate possesses strong C/C++ skills, deep learning knowledge (PyTorch/TensorFlow), and experience with GPU high-performance computing. The team works on a large scale heterogeneous system and requires experience with distributed systems and parallel computing.
Must have:
  • 3+ years C/C++ experience
  • Deep learning fundamentals
  • PyTorch/TensorFlow knowledge
  • Build SFT/RL training framework
  • Optimize LLM/AIGC training efficiency
Good to have:
  • CUDA GPU optimization
  • Experience with FSDP, Deepspeed, Megatron
  • Strong LLM model knowledge

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance sponsorship of a visa. About the team The ByteDance Large Model Team is committed to developing the most advanced AI large model technology in the industry, becoming a world-class research team, and contributing to technological and social development. The Large Model Team has a long-term vision and determination in the field of AI, with research directions covering NLP, CV, speech, and other areas. Relying on the abundant data and computing resources of the platform, the team has continued to invest in relevant fields and has launched its own general large model, providing multi-modal capabilities. The Machine Learning (ML) System sub-team combines system engineering and the art of machine learning to develop and maintain massively distributed ML training and inference system/services around the world, providing high-performance, highly reliable, scalable systems for LLM/AIGC/AGI. In our team, you'll have the opportunity to build the large scale heterogeneous system integrating with GPU/NPU/RDMA/Storage and keep it running steadily and reliably, enrich your expertise in coding, performance analysis and distributed system, and be involved in the decision-making process. You'll also be part of a global team with members from the United States, China and Singapore working collaboratively towards unified project direction. Responsibilities: - Responsible for building the future generation of SFT/RL training framework - Responsible for optimizing e2e LLM/AIGC training efficiency, including reducing memory usage, tuning model parallelism strategies, etc. - Responsible for making the training framework easy-to-adopt with good out-of-box performance - Collaborate with critical product teams to enable their LLM/AIGC products landing
Qualifications
Minimum Qualifications: - Bachelor's degree or above, major in computer/electronics/automation/software or related; - At least 3 years of working experiences in C/C++, proficient in algorithms and data structures, familiar with Python - Understand the basic principles of deep learning algorithms, be familiar with the basic architecture of neural networks and understand deep learning training frameworks such as PyTorch and TensorFlow - Have a strong sense of responsibility, good learning ability, communication ability and self-drive, good team spirit Preferred Qualifications: - Proficient in GPU high-performance computing optimization technology on CUDA, in-depth understanding of computer architecture, familiar with parallel computing optimization, memory access optimization, low-bit computing, etc. - Familiar with FSDP, Deepspeed, Megatron, etc. - Strong Knowledge of LLM models, experience in accelerating LLM model optimization
Job Information
About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

FlawlessAi - Research Engineer - Audio Driven Facial Animation

FlawlessAi

Santa Monica, California, United States (Hybrid)
1 Month ago
Divensi - LiDAR Analyst

Divensi

Bellevue, Washington, United States (On-Site)
8 Years ago
Qualcomm - Engineer, Staff Systems

Qualcomm

Cork, County Cork, Ireland (On-Site)
3 Weeks ago
playrix  - Feature Owner (LiveOps)

playrix

Ukraine (Remote)
7 Months ago
ness digital  - AI/ML Engineer

ness digital

Iași, Iași County, Romania (Remote)
3 Months ago
NVIDIA - Principal Thermal Mechanical Photonic Designer

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
rivos - Senior Memory Design Engineer

rivos

Portland, Oregon, United States (Hybrid)
7 Months ago
bytedance - Research Scientist Graduate (Computational Biology (AI-for-Science))

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
NVIDIA - Senior Software Engineer, CAD Tool Development

NVIDIA

California, United States (Hybrid)
1 Month ago
NVIDIA - Senior Physical Design Full Chip STA Engineer

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Ansys - Senior R&D Engineer

Ansys

Montigny-le-Bretonneux, Île-de-France, France (On-Site)
3 Weeks ago
Bosch Group India - Applied Computer Vision Engineer

Bosch Group India

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
bytedance - Software Engineer, Inference

bytedance

Seattle, Washington, United States (On-Site)
7 Months ago
G5 games - 2D UI/UX Artist (match-3 project)

G5 games

Astana, Astana, Kazakhstan (Remote)
7 Months ago
Bosch Group India - Applied Computer Vision Engineer- Automated Driving

Bosch Group India

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
FICO - Analytic Science — Lead Scientist

FICO

State Of São Paulo, Brazil (On-Site)
3 Weeks ago
G5 games - 2D UI/UX Artist (Hidden objects project)

G5 games

(Remote)
4 Months ago
Canva - Senior Machine Learning Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
4 Months ago
Intel  - NPU Compiler Developer (C++)

Intel

Gdańsk, Pomeranian Voivodeship, Poland (On-Site)
5 Days ago
Unity - Senior Machine Learning/MLOps Developer

Unity

Canada (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

bytedance - Product Design Intern - Global Payment

bytedance

Singapore (On-Site)
2 Months ago
Saxo Bank - Senior Relationship Manager

Saxo Bank

Singapore, Singapore (On-Site)
1 Month ago
bytedance - Technical Program Manager, Security Engineering

bytedance

Singapore (On-Site)
1 Month ago
PwC - Risk Services - BD Industry Driver

PwC

Singapore (On-Site)
7 Months ago
Adyen - Technical Support Engineer

Adyen

Singapore (On-Site)
2 Weeks ago
CrowdStricke - Sr. Software Engineer - Cloud Platform Reliability

CrowdStricke

Singapore (Remote)
3 Weeks ago
bytedance - System Architect Software Engineer - Data Platform

bytedance

Singapore (On-Site)
6 Months ago
HoYoverse - Customer Experience and Product Operations Specialist

HoYoverse

Singapore, Singapore (On-Site)
1 Month ago
OKX - Anti-Fraud Director

OKX

Singapore (On-Site)
1 Week ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

NVIDIA - Deep Learning Performance Architect

NVIDIA

Shanghai, Shanghai, China (On-Site)
4 Months ago
Meta - Software Engineer, Machine Learning

Meta

United States (Remote)
1 Month ago
Assystems - Ingénieur coordination technique H/F

Assystems

Cherbourg-en-Cotentin, Normandy, France (On-Site)
7 Months ago
Nagarro - SAP FI/CO Senior Consultant

Nagarro

Germany (Remote)
2 Months ago
Thales - Avionics Software Developer

Thales

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Riot Games - Staff Software Engineer (Services) - League of Legends, Motivations

Riot Games

Dublin, County Dublin, Ireland (On-Site)
6 Months ago
rivos - Member of Technical Staff (91839)

rivos

Santa Clara, California, United States (Hybrid)
7 Months ago
NVIDIA - Senior Research Engineer for Reinforcement Learning

NVIDIA

Santa Clara, California, United States (On-Site)
4 Months ago
NVIDIA - GPU Power Architect - New College Grad 2025

NVIDIA

Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

Tokyo, Japan (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

San Jose, California, United States (On-Site)

Ho Chi Minh City, Vietnam (On-Site)

San Diego, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug