Senior Software Engineer - XR Spatial Machine Learning
Job Summary
Job Description
Our team at ByteDance focuses on integrating AI and Machine Learning into XR headsets, aiming to empower developers with tools to build groundbreaking applications. We strive to establish an ecosystem where AI/ML within XR headsets redefines human-digital interaction. This role involves designing and implementing APIs for AI/ML frameworks, creating data pipelines, and collaborating with research teams to integrate models for XR SDK features. The position requires optimizing frameworks based on analytics and user feedback.
Must have:
- Work on frameworks to enable developers to leverage AI/ML features in customizing their XR experiences
- Design and implement APIs to provide these frameworks to developers in an accessible way
- Create tools, workflows and pipelines for easy data collection, training and deployment
- Work with research teams to implement AI/ML models for XR SDK features
- Collaborate with other teams that provide frameworks that would need to be integrated for AI/ML features to work
- Profile and optimize our frameworks and tools based on analytics or user feedback
Good to have:
- Master’s degree or PhD in Engineering, Computer Science, or a related technical field
- Experience with development of native Android Services and AIDL
- Experience with LLM inference
- Familiarity with Qualcomm QNN SDK, OpenCV and other ML and CV related frameworks
- Experience with GPU performance profiling and tuning
- Experience with XR development
Perks:
- Medical, dental, and vision insurance
- 401(k) savings plan with company match
- Paid parental leave
- Short-term and long-term disability coverage
- Life insurance
- Wellbeing benefits
- 10 paid holidays per year
- 10 paid sick days per year
- 17 days of Paid Personal Time
12 skills required
Job Details
About the Team
The convergence of Artificial Intelligence (AI) and Extended Reality (XR) technologies has birthed an exciting new era of immersive computing. Our team is well placed within a company that has focused on practical applications of AI, and a division that has a mandate to deliver innovative XR solutions. Our team's goals are centered around integrating AI and Machine Learning (ML) into XR headsets, with a primary focus on equipping developers with tools and resources to build groundbreaking applications. Our vision is to establish an ecosystem where developers can leverage the power of AI/ML within XR headsets to create experiences that redefine human digital interaction. By providing developers with comprehensive frameworks, tools, resources, and SDKs, we aim to enable the creation of applications that are intuitive, personalized, and context-aware, pushing the boundaries of what is achievable in immersive development.
Responsibilities:
- Work on frameworks to enable developers to leverage AI/ML features in customizing their XR experiences
- Design and implement APIs to provide these frameworks to developers in an accessible way
- Create tools, workflows and pipelines for easy data collection, training and deployment
- Work with research teams to implement AI/ML models for XR SDK features
- Collaborate with other teams that provide frameworks that would need to be integrated for AI/ML features to work
- Profile and optimize our frameworks and tools based on analytics or user feedback
Minimum Qualifications:
- Bachelor's degree or equivalent practical industry experience
- Strong computer architecture/system knowledge and familiarity with commonly used data structure and algorithms
- Strong C/C++ programming, problem solving and debugging skills
- Experience with native Android development, including multithreading and shared memory
- Good understanding of Vulkan / OpenGL and modern mobile graphics pipeline
- Experience with low level performance profiling and optimization
- Experience with ML frameworks such as TFLite, PyTorch or Tensorflow running on mobile
Preferred Qualifications:
- Master’s degree or PhD in Engineering, Computer Science, or a related technical field
- Experience with development of native Android Services and AIDL
- Experience with LLM inference
- Familiarity with Qualcomm QNN SDK, OpenCV and other ML and CV related frameworks
- Experience with GPU performance profiling and tuning
- Experience with XR development
Similar Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Similar Skill Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Jobs in San Jose, California, United States
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
Research Development Jobs
Looks like we're out of matches
Set up an alert and we'll send you similar jobs the moment they appear!
About The Company
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Get notified when new jobs are added by bytedance
