Software Engineer in ML Systems Graduate (AML - Machine Learning Systems) - 2024 Start (BS/MS)

8 Months ago • All levels • System Design • $112,200 PA - $147,000 PA

Job Summary

Job Description

ByteDance's Doubao Team is seeking a talented Software Engineer in ML Systems Graduate to join their team in developing and deploying cutting-edge machine learning systems. This role involves research and development of heterogeneous computing architectures, management and monitoring of ML systems, distributed task scheduling, and optimization of systems and algorithms for machine learning on GPUs and ASICs. The ideal candidate will have a strong background in distributed computing, machine learning algorithms, and experience with platforms like PyTorch and Jax. Additionally, proficiency in programming languages such as C/C++, CUDA, and Python is essential.
Must have:
  • Master's degree or above
  • Expertise in distributed and parallel computing principles
  • Familiarity with machine learning algorithms, platforms, and frameworks like PyTorch and Jax
  • Basic understanding of GPU and/or ASIC operations
  • Proficiency in C/C++, CUDA, and Python programming languages
Good to have:
  • GPU-based high-performance computing
  • RDMA high-performance networking
  • Distributed training framework optimizations
  • AI compiler stacks like torch.fx, XLA, and MLIR
  • Large-scale data processing and parallel computing
  • Experience designing and operating large-scale systems in cloud computing or machine learning
  • In-depth CUDA programming and performance tuning
Perks:
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • Disability Insurance
  • Life Insurance
  • Health Savings Account (HSA)
  • Flexible Spending Account (FSA)
  • Paid Time Off
  • Paid Sick Days
  • Parental Leave
  • Supplemental Disability Leave
  • Employee Assistance Program (EAP)
  • Lyra Mental Health Benefits
  • 401K Company Match
  • Gym Reimbursements
  • Cellphone Service Reimbursements

Job Details

Responsibilities
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us." About the team Founded in 2023, ByteDance Doubao Team is dedicated to crafting the industry's most advanced LLMs. We aim to lead global research and foster both technological and social progress. With a long-term vision and a strong commitment to the AI field, the Team conducts research in a range of areas including natural language processing (NLP), computer vision (CV), and speech recognition and generation. It boasts a robust international presence with labs and research facilities in China, Singapore, and the US. Leveraging substantial data and computing resources and through continued investment in these domains, our team has built a proprietary general-purpose model with multimodal capabilities. This model supports over 50 downstream business services including Doubao, Coze, and Dreamina, which are available to enterprise customers via the Volcano Engine. Currently, the Doubao App is the most used AIGC application in the China market. Successful candidates must be able to commit to one of the following start dates below: 1. January 15, 2024 2. February 5, 2024 3. March 4, 2024 4. May 20, 2024 5. June 10, 2024 6. July 15, 2024 7. August 12, 2024 We will prioritize candidates who are able to commit to these start dates. Please state your availability and graduation date clearly in your resume. Applications will be reviewed on a rolling basis. We encourage you to apply early. Candidates can apply for a maximum of TWO positions and will be considered for jobs in the order you applied for. The application limit is applicable to ByteDance and its affiliates' jobs globally. Responsibilities - Research and develop our machine learning systems, including heterogeneous computing architecture, management, and monitoring - Deploy machine learning systems, distributed task scheduling, machine learning training - Manage cross-layer optimization of system and AI algorithms and hardware for machine learning (GPU, ASIC) - Implement both general purpose training framework features and model specific optimizations (e.g. LLM, diffusions) - Improve efficiency and stability for extremely large scale distributed training jobs
Qualifications
1. Master or above degree in distributed, parallel computing principles and know the recent advances in computing, storage, networking, and hardware technologies; 2. Familiar with machine learning algorithms, platforms and frameworks such as PyTorch and Jax. 3. Have basic understanding of how GPU and/or ASIC works; 4. Expert in at least one or two programming languages in Linux environment: C/C++, CUDA, Python; 5. The following experiences will be a big plus: - GPU based high performance computing, RDMA high performance network (MPI, NCCL, ibverbs); -Distributed training framework optimizations such as DeepSpeed, FSDP, Megatron, GSPMD - AI compiler stacks such as torch.fx, XLA and MLIR; - Large scale data processing and parallel computing; - Experiences in designing and operating large scale systems in cloud computing or machine learning; - Experiences in in-depth CUDA programming and performance tuning (cutlass, triton) ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at earlycareers.accommodations@bytedance.com. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy.
Job Information
【For Pay Transparency】Compensation Description (annually)

The base salary range for this position in the selected city is $112200 - $147000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Our company benefits are designed to convey company culture and values, to create an efficient and inspiring work environment, and to support our employees to give their best in both work and life. We offer the following benefits to eligible employees:

We cover 100% premium coverage for employee medical insurance, approximately 75% premium coverage for dependents and offer a Health Savings Account(HSA) with a company match. As well as Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans. In addition to Flexible Spending Account(FSA) Options like Health Care, Limited Purpose and Dependent Care.

Our time off and leave plans are: 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO) (prorated upon hire and increased by tenure) and 10 paid sick days per year as well as 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.

We also provide generous benefits like mental and emotional health benefits through our EAP and Lyra. A 401K company match, gym and cellphone service reimbursements. The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

Ansys - R&D Engineer II - EDA

Ansys

Noida, Uttar Pradesh, India (On-Site)
1 Month ago
NVIDIA - Senior ASIC Verification Engineer

NVIDIA

Shanghai, Shanghai, China (Hybrid)
2 Months ago
London stock Exchange - Senior DevOps Engineer

London stock Exchange

Colombo, Western Province, Sri Lanka (On-Site)
1 Month ago
Google - Software Engineer, PhD, Cloud Platforms

Google

Taipei City, Taiwan (On-Site)
2 Months ago
Loft Orbital - Senior Site Reliability Engineer

Loft Orbital

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
4 Weeks ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Months ago
Anthology  Inc  - System Engineer

Anthology Inc

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
extreme network - Systems Engineer-Scandinavia

extreme network

Stockholm, Stockholm County, Sweden (Remote)
8 Months ago
Thales - Systems Engineer with EW experience

Thales

Crawley, England, United Kingdom (On-Site)
1 Month ago
Apple - Wireless System Verification Engineer

Apple

San Diego, California, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Marvell - Principal Design Verification Engineer

Marvell

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
IO Interactive - Senior Audio Programmer

IO Interactive

Barcelona, Catalonia, Spain (Hybrid)
9 Months ago
Wind River - Senior Engineer - Network Stack

Wind River

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
NVIDIA - Principal Engineer

NVIDIA

(Remote)
4 Months ago
Ubisoft - Graphics Programmer [Snowdrop]

Ubisoft

Düsseldorf, North Rhine-Westphalia, Germany (Hybrid)
3 Weeks ago
luxsoft - System Software Verification

luxsoft

Hyderabad, Telangana, India (On-Site)
1 Week ago
Riot Games - Staff Software Engineer - VALORANT, Foundations, Build Platforms

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Activision - Principal Online Programmer

Activision

Santa Monica, California, United States (On-Site)
3 Weeks ago
Hologate  - Unreal Engine Developer (C++)

Hologate

Munich, Bavaria, Germany (On-Site)
2 Months ago
zoox - Principal Software Engineer, ML Infrastructure

zoox

Foster City, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Netflix - Senior Software Engineer - Developer Automation Platform (Backend)

Netflix

Los Gatos, California, United States (On-Site)
2 Months ago
Electronic Arts - Senior AI Data Scientist

Electronic Arts

Kirkland, Washington, United States (On-Site)
2 Months ago
Apple - Senior iOS Engineer - Home Ecosystem (Frameworks & Services)

Apple

Seattle, Washington, United States (On-Site)
1 Month ago
Nintendo - Accounts Payable and Project Accountant (Retro Studios)

Nintendo

Austin, Texas, United States (On-Site)
11 Months ago
Zones - Property Manager

Zones

Bellevue, Washington, United States (On-Site)
1 Month ago
Alten Technology - Propulsion Engineer (Thrusters)

Alten Technology

Natick, Massachusetts, United States (On-Site)
1 Month ago
The E.W. Scripps Company - Executive Reporter

The E.W. Scripps Company

Phoenix, Arizona, United States (On-Site)
2 Months ago
Toast - Retail Account Executive

Toast

Albany, New York, United States (On-Site)
2 Weeks ago
Ion - Covenant Analyst

Ion

New York, United States (On-Site)
1 Year ago
WebTech Corporation - Welder

WebTech Corporation

Kansas City, Missouri, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

System Design Jobs

Qualcomm - Systems Engineer, Staff

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Assystems - Senior Systems Engineer

Assystems

Culham, England, United Kingdom (Hybrid)
8 Months ago
IGT - Temporary Information System Engineer

IGT

West Greenwich, Rhode Island, United States (On-Site)
2 Months ago
NVIDIA - System Architect

NVIDIA

Santa Clara, California, United States (On-Site)
3 Months ago
extreme network - Staff SW Systems Engineer - WLAN Development/WIFI Protocols

extreme network

Bengaluru, Karnataka, India (Hybrid)
3 Weeks ago
Apple - Systems Metrology Engineer

Apple

Sunnyvale, California, United States (On-Site)
4 Weeks ago
Cubic corporation - Senior Systems Engineer

Cubic corporation

Hyderabad, Telangana, India (On-Site)
1 Week ago
Ion - System Engineer Control Room, Italy

Ion

Parma, Emilia-Romagna, Italy (Hybrid)
8 Months ago
Qualcomm - Camera ISP Algorithm System Engineer

Qualcomm

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
Google - Photonic Engineer, Machine Learning Systems, Platforms

Google

Sunnyvale, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Tokyo, Japan (On-Site)

View All Jobs

Get notified when new jobs are added by bytedance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug