Research Engineer (Machine Learning Training System) - 2025 Start

8 Months ago • All levels • System Design

Job Summary

Job Description

ByteDance seeks a Research Engineer to research and develop machine learning systems, manage cross-layer optimization for ML algorithms and hardware, and improve efficiency and stability for distributed training jobs. The ideal candidate will have a PhD in Computer Science or a related field, experience with distributed and parallel computing, and expertise in programming languages like C/C++, CUDA, and Python.
Must have:
  • PhD Computer Science
  • Distributed Computing
  • C/C++ CUDA
  • Machine Learning
Good to have:
  • GPU Computing
  • RDMA Network
  • Deep Learning
  • Cloud Computing
Perks:
  • Growth Opportunities
  • Inspiring Creativity

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team Machine Learning systems team provides E2E machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and AI chips and advances the state-of-the-art of ML systems technology to accelerate models such as stable diffusion and LLM. The team is also responsible for research and development of hardware acceleration technologies for AI and cloud computing, via technologies such as distributed systems, compilers, HPC, and RDMA networking. The team is reinventing the ML infra for large scale language models. We have published papers at top tier conferences such as SIGCOMM, NSDI, EuroSys, OSDI, SOSP, MLSys, NeurIPS, etc. We are looking for talented individuals to join us in 2025. As a graduate, you will get unparalleled opportunities for you to kickstart your career, pursue bold ideas and explore limitless growth opportunities. Co-create a future driven by your inspiration with ByteDance. Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early. Responsibilities - Research and develop our machine learning systems, including heterogeneous computing architecture, management, scheduling, and monitoring; - Manage cross-layer optimisation of system and AI algorithms and hardware for machine learning (GPU, ASIC); - Implement both general purpose training framework features and model specific optimisations (e.g. LLM, diffusions); - Improve efficiency and stability for extremely large scale distributed training jobs;
Qualifications
Minimum Qualifications: 1. Currently pursuing a PhD in Computer Science, engineering quantitative field with a background in distributed, parallel computing principles and know the recent advances in computing, storage, networking, and hardware technologies 2. Familiar with machine learning algorithms and platforms; 3. Have basic understanding of how GPU and/or ASIC works; 4. Expert in at least one or two programming languages in Linux environment: C/C++, CUDA, Python; Preferred Qualifications: 1. GPU based high performance computing, RDMA high performance network (NCCL, ibverbs); Tensorflow, Jax, PyTorch or other deep learning frameworks; 2. Large scale data processing and parallel computing; 3. Experiences in designing and operating large scale systems in cloud computing or machine learning; 4. Experiences in in-depth CUDA programming and performance tuning ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy. If you have any questions, please reach out to us at apac-earlycareers@bytedance.com.

Similar Jobs

Postman - Staff Engineer, Monetization

Postman

San Francisco, California, United States (Hybrid)
2 Months ago
Canonical - Embedded Linux Field Engineer for Devices/IoT

Canonical

(Remote)
1 Month ago
GoMotive - Computer Vision Engineer

GoMotive

Pakistan (Remote)
2 Months ago
bytedance - Software Engineer, Real Time Communication

bytedance

Singapore (On-Site)
8 Months ago
Rockstar Games - Animation R&D Programmer: Retargeting

Rockstar Games

New York, United States (On-Site)
1 Month ago
GT HQ - Senior Engineer / Staff Engineer, Global System Support

GT HQ

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Alphawave Semi - Senior Engineer II - System Engineer

Alphawave Semi

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
Ansys - Aerospace Systems Engineer II

Ansys

Exton, Pennsylvania, United States (On-Site)
2 Weeks ago
Open Systems Technologies - System Engineer Monitoring

Open Systems Technologies

Düsseldorf, North Rhine-Westphalia, Germany (On-Site)
1 Week ago
Qualcomm - AI Model System Software Performance Optimization Lead Engineer, Senior

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hudl - Senior Machine Learning Engineer

Hudl

London, England, United Kingdom (On-Site)
2 Months ago
Assist software  - C++ Developer

Assist software

Suceava, Suceava County, Romania (On-Site)
7 Months ago
Quantic Dream - Engine Programmer

Quantic Dream

Paris, Île-de-France, France (Hybrid)
3 Months ago
Aristocrat - Games Design Manager

Aristocrat

Reno, Nevada, United States (On-Site)
3 Weeks ago
HCL Tech - C++ Senior Technical Lead

HCL Tech

California, United States (On-Site)
3 Weeks ago
bytedance - Software Engineer Graduate (RDMA Network - High Speed Network)

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
Qualcomm - Sr Lead Engineer - Windows/Linux kernel & Driver Development

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago
Unity - Senior Software Development Consultant

Unity

Tokyo, Japan (On-Site)
8 Months ago
Riot Games - Staff Software Engineer, Gameplay - Unpublished R&D Product

Riot Games

Los Angeles, California, United States (On-Site)
4 Months ago
rivos - SOC Design Verification

rivos

Santa Clara, California, United States (Hybrid)
3 Years ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Saviynt - Senior Solutions Engineer

Saviynt

Singapore (Hybrid)
3 Weeks ago
bytedance - Physical Security Trainee-2025 Start

bytedance

Singapore (On-Site)
8 Months ago
London stock Exchange - Customer Success Manager, Analytics

London stock Exchange

Singapore (On-Site)
1 Month ago
Adobe - Employee Relations Consultant

Adobe

Singapore, Singapore (On-Site)
2 Months ago
bytedance - HR System Solution Expert (Third-party Contractor)

bytedance

Singapore (On-Site)
6 Months ago
bytedance - Privacy Counsel, APAC & Emerging Markets

bytedance

Singapore (Hybrid)
2 Months ago
Saviynt - Client Solutions Manager – Application Access Governance

Saviynt

Singapore (Remote)
3 Weeks ago
tatsu works - Senior Fullstack Engineer

tatsu works

Singapore (Remote)
7 Months ago

Get notifed when new similar jobs are uploaded

System Design Jobs

NVIDIA - Senior System Software Engineer, Robotics Simulation

NVIDIA

Toronto, Ontario, Canada (Hybrid)
3 Months ago
extreme network - Senior Systems Engineer – Enterprise, US Central Region

extreme network

United States (Remote)
1 Month ago
AFRY - Power Systems Engineer for Control and Relay Protection

AFRY

Aarhus, Denmark (On-Site)
3 Weeks ago
Ion - System Engineer Control Room, Italy

Ion

Parma, Emilia-Romagna, Italy (Hybrid)
8 Months ago
Palo Alto Networks - Senior Systems Engineer - Orange EMEAL

Palo Alto Networks

Paris, Île-de-France, France (Remote)
7 Months ago
Whatnot - Senior IT Systems & Ops Engineer

Whatnot

San Francisco, California, United States (On-Site)
2 Months ago
Apple - Instrument Systems Design Engineer

Apple

Boulder, Colorado, United States (On-Site)
1 Month ago
bytedance - Software Engineer, LLM Storage System Intern

bytedance

Singapore (On-Site)
1 Month ago
2K - Principal Systems Engineer

2K

Burnaby, British Columbia, Canada (Hybrid)
2 Months ago
Crowd Strick - Senior Engineer, Backend - Channel File Systems

Crowd Strick

Canada (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug