Software Engineer Intern (Applied Machine Learning-Enterprise) - 2026 Fall (BS/MS)

1 Minute ago • All levels • Research Development • $93,600 PA - $124,800 PA

Job Summary

Job Description

The Applied Machine Learning Enterprise team at ByteDance develops and operates massively distributed machine learning training and inference systems. This 12-week internship, starting in Fall 2026, offers students hands-on experience in building and maintaining large-scale heterogeneous systems integrating GPU/RDMA/Storage. Interns will contribute to a next-generation big model as a service platform, focusing on offline training/finetuning, online inference, model management, and efficient GPU resource orchestration. The role provides exposure to coding, performance analysis, and distributed system management, fostering personal and professional growth.
Must have:
  • Building a next-generation big model as a service platform to serve hundreds of LLMs based applications
  • Develop and maintain the big model as a service platform, including offline training/finetuning, online inference, model management, and resource orchestration
  • Manage a huge number of GPU resources and provide computing power efficiently
Good to have:
  • Experience in NLP and LLM technologies
  • Experience or research in Alignment for Large language models
  • Experience in ModelOps, for example large model management, finetuning workflow management
  • Contribution to top-tier conference papers, including NeurIPS, ICML, ICLR, CVPR, ICCV, ACL, KDD
Perks:
  • Day one access to health insurance
  • Life insurance
  • Wellbeing benefits
  • 10 paid holidays per year
  • Paid sick time
  • Housing allowance (if not 100% remote)

Job Details

Responsibilities

The Applied Machine Learning Enterprise team combines system engineering and machine learning to develop and operate massively distributed machine learning training, inference systems and services to serve both the big model vendors and users around the world. You'll have the opportunity to build and enrich your expertise in coding, performance analysis and large system management, and get heavily involved in the process of hardware/capacity decision-making. In the engineering team, you'll have the opportunity to build the large scale heterogeneous system integrating with GPU/RDMA/Storage and keep it running stable and reliable, enrich your expertise in coding, performance analysis and distributed system, be involved in the process of hardware/capacity decision-making. We are looking for talented individuals to join us for an internship in 2026. Internships at ByteDance aim to offer students industry exposure and hands-on experience. Turn your ambitions into reality as your inspiration brings infinite opportunities at ByteDance. Applications will be reviewed on a rolling basis. We encourage you to apply early. Candidates can apply to a maximum of TWO positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance (select one) and its affiliates' jobs globally. Internships at ByteDance aim to provide students with hands-on experience in developing fundamental skills and exploring potential career paths. A vibrant blend of social events and enriching development workshops will be available for you to explore. Here, you will utilize your knowledge in real-world scenarios while laying a strong foundation for personal and professional growth. It runs for 12 weeks and begins in August/September 2026. Successful candidates must be able to commit to one of the following start dates below: (Select below options for Fall) - 8/10/2026 - 8/24/2026 - 9/8/2026 - 9/21/2026 Please state your availability clearly in your resume (Start date, End date). Applications will be reviewed on a rolling basis. We encourage you to apply early. Candidates can apply to a maximum of TWO positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Candidates who pass resume evaluation will be invited to participate in ByteDance's technical online assessment through CodeSignal.

Responsibilities:

  • Building a next-generation big model as a service platform to serve hundreds of LLMs based applications;
  • To develop and maintain the big model as a service platform, including offline training/finetuning, online inference, model management, and resource orchestration, etc.;
  • To manage a huge number of GPU resources and provide computing power efficiently.

Qualifications

Minimum Qualifications:

  • Must be able to commit to a 12-week full-time work period during Fall 2026
  • Currently pursuing a BS/MS degree in Computer Science or related technical field;
  • Proficient in deep learning frameworks such as PyTorch or TensorFlow;
  • Experience with software development in at least one of the following programming languages: C++, Python, Go;
  • Good sense of teamwork and communication skills, practical experience in relevant business scenarios is preferred;
  • Strong software programming capabilities, exhibits good code design and coding style;
  • Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.

Preferred Qualifications:

  • Experience in NLP and LLM technologies;
  • Experience or research in Alignment for Large language models;
  • Experience in ModelOps, for example large model management, finetuning workflow management, etc.;
  • Contribution to top-tier conference papers, including NeurIPS, ICML, ICLR, CVPR, ICCV, ACL, KDD, etc. is a big plus.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in San Jose, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Research Development Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug