Backend Engineer (Model Inference), Machine Learning Systems

5 Months ago • All levels • Artificial Intelligence • Research & Development

Job Summary

Job Description

ByteDance's Large Model Team seeks a Backend Engineer (Model Inference) to contribute to its advanced AI large model technology. This role involves designing and developing large-scale ML system architecture, delivering end-to-end solutions for deep model inference, optimizing model performance, and managing GPU computing power. The ideal candidate possesses strong C/C++ and Python skills, experience with machine learning frameworks (TensorFlow/PyTorch/MxNet), and knowledge of GPU programming, model quantization, and cluster scheduling.
Must have:
  • Proficient in C/C++ and Python
  • Experience in large-scale ML systems
  • Familiar with TensorFlow/PyTorch/MxNet
  • Knowledge of GPU programming, model quantization
Good to have:
  • Experience with recommendation/advertising/search systems
  • Understanding of GPU hardware architecture and CUDA/cuDNN

Job Details

Responsibilities
ByteDance will be prioritizing applicants who have a current right to work in Singapore, and do not require ByteDance sponsorship of a visa. About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok and Helo as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the team The ByteDance Large Model Team is committed to developing the most advanced AI large model technology in the industry, becoming a world-class research team, and contributing to technological and social development. The Large Model Team has a long-term vision and determination in the field of AI, with research directions covering NLP, CV, speech, and other areas. Relying on the abundant data and computing resources of the platform, the team has continued to invest in relevant fields and has launched its own general large model, providing multi-modal capabilities. The Machine Learning (ML) System sub-team combines system engineering and the art of machine learning to develop and maintain massively distributed ML training and inference system/services around the world, providing high-performance, highly reliable, scalable systems for LLM/AIGC/AGI. As a vital AI infrastructure for the company, our machine learning system integrates our most up-to-date R&D results in AI algorithms and systems. Come and join us, you will get the chance of building large-scale machine learning systems, and working with the best AI system and algorithm researchers and engineers. Responsibilities - Responsible for the design and development of large-scale ML system architecture such as solving technical system problems on high concurrency, reliability, scalability, etc - Develop end-to-end solutions on deep model inference for internal business units such as Search, Recommendation, and relevant Large Language Model (LLM) based systems etc - Provide highly automated and extremely performant model optimization solutions for frameworks such as PyTorch and TensorFlow. Some technical solutions includes subgraph matching, compilation optimization, model quantization, heterogeneous hardware, etc.; - Manage the large-scale GPU computing power cluster for our global businesses by improving utilization rates of the computing power through methods such as elastic scheduling, GPU overselling, and task orchestration; - Engage in cross functional collaboration with the algorithm department to conduct joint optimization of algorithms and systems.
Qualifications
Minimum Qualifications: - Proficient in C/C ++ and Python languages in the Linux environment, with relevant experience in large-scale machine learning systems or search and promote recommendation systems; - Familiar with at least one machine learning framework (Tensorflow/PyTorch/MxNet or other self-developed frameworks). - Background knowledge and experience in at least one of the following: GPU programming, compiler, model quantization, and GPU cluster scheduling. - Have the ability to solve problems independently, a good team spirit, and excellent ability to disassemble complex problems. - Have a strong sense of responsibility, good learning ability, communication skills, and self-drive. - Have good working documentation habits and write updated workflow and technical documents as required in a timely manner. Preferred Qualifications: - Experience with recommendation/advertising/search off-line inference system architecture; - Understand the GPU hardware architecture, understand the GPU software stack (CUDA, cuDNN), and have experience in GPU performance analysis. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

Luxoft - Regular Data Engineer

Luxoft

(Remote)
4 Months ago
Tencent - Senior Staff Researcher

Tencent

California, United States (On-Site)
4 Weeks ago
Meta - Research Scientist Intern, Machine Perception for Input and Interaction (PhD)

Meta

Seattle, Washington, United States (On-Site)
4 Months ago
Lucid Reality Labs - ML/AI Engineer

Lucid Reality Labs

Poland (Remote)
6 Days ago
Meta - Software Engineer, Machine Learning

Meta

New York, New York, United States (On-Site)
4 Months ago
The Walt Disney Company - Principal Software Engineer, AI Architecture - Ad Platforms

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Week ago
GT - AI/ML Engineer

GT

(Remote)
6 Days ago
N-iX - AI Engineer

N-iX

Poland (Remote)
1 Week ago
Interface AI - Sr. Implementation Engineer

Interface AI

United States (Remote)
4 Months ago
Trustana - Senior Data Engineer

Trustana

Gurugram, Haryana, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Senior Computer Vision Engineer - Photo AI

Canva

Vienna, Vienna, Austria (Remote)
2 Months ago
Seedify - AI Product Manager

Seedify

Japan (Remote)
2 Months ago
EXUSIA - AWS and Python Full Stack Leads / Senior Developers

EXUSIA

Hyderabad, Telangana, India (Remote)
6 Days ago
Google - Senior Software Engineer, Machine Learning, YouTube

Google

Mountain View, California, United States (On-Site)
4 Months ago
NVIDIA - Senior System Software Engineer, NCCL - Partner Enablement

NVIDIA

Santa Clara, California, United States (Remote)
1 Month ago
NVIDIA - Senior DevOps Engineer, Deep Learning Frameworks

NVIDIA

Santa Clara, California, United States (On-Site)
2 Months ago
ByteDance - Engineering Manager Machine Learning Infrastructure

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
NVIDIA - Software Engineering Manager, Sparse Linear Algebra Libraries

NVIDIA

United States (Hybrid)
1 Month ago
Razer - Solutions Architect

Razer

Singapore (On-Site)
6 Months ago
Trend Micro - NLP / Prompt Engineer (VicOne_Automotive Security)

Trend Micro

Taipei City, Taiwan (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

ByteDance - Channel Risk Expert - Global Payment

ByteDance

Singapore (On-Site)
2 Months ago
Riot Games - Manager, Concept Art - League of Legends

Riot Games

Singapore (On-Site)
6 Months ago
ByteDance - Procurement Specialist-2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Research Engineer - Multimodal Model

ByteDance

Singapore (On-Site)
5 Months ago
The Walt Disney Company - Intern, Corporate Communications, Southeast Asia

The Walt Disney Company

Singapore, Singapore (On-Site)
1 Month ago
ByteDance - Product Design Intern - Global Payment

ByteDance

Singapore (On-Site)
1 Week ago
ByteDance - APAC Real Estate Space Planning and Operations Manager

ByteDance

Singapore (On-Site)
1 Week ago
ByteDance - Backend Engineer (Model Inference) Intern - 2025 Start

ByteDance

Singapore (On-Site)
5 Months ago
ByteDance - Backend Engineer Lead - ARK Large Model Platform (Singapore)

ByteDance

Singapore (On-Site)
4 Months ago
ByteDance - Product Design Intern - Global Payment

ByteDance

Singapore (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

Artificial Intelligence Jobs

Reality Games - Machine Learning Engineer - Monopoly World

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
AI Fund - Machine Learning Engineer

AI Fund

(Remote)
5 Months ago
Social Discovery Group - Senior NLP Engineer

Social Discovery Group

Serbia (Remote)
5 Months ago
Zoox - Senior/Staff Software Engineer - 3D World Generation Pipelines

Zoox

Foster City, California, United States (Hybrid)
5 Months ago
AI Fund - Founder in Residence/CEO (AI for Construction)

AI Fund

United States (Remote)
5 Days ago
ByteDance - Student Researcher (Doubao (Seed) - Foundation Model - Generative AI) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
ByteDance - Researcher - Large Language Models, Applied Machine Learning

ByteDance

Seattle, Washington, United States (On-Site)
1 Week ago
NVIDIA - Senior System Software Engineer - Dynamo and Triton Inference Server

NVIDIA

California, United States (Remote)
5 Days ago
Zoox - Senior/Staff Software Engineer, ML Performance Optimization

Zoox

Foster City, California, United States (On-Site)
5 Months ago
Google - Senior Software Engineer, Machine Learning, Google Ads

Google

Mountain View, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

New York, New York, United States (On-Site)

Jakarta, Jakarta, Indonesia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Singapore (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug