Research Scientist, ML H/W-SW Codesign

1 Month ago • 2 Years + • Artificial Intelligence

About the job

Job Description

Meta is seeking a Research Scientist to join our Research & Development teams. The ideal candidate will have experience working on AI models, hardware acceleration and software systems related topics. The position will involve taking these skills and applying them to solve for some of the most crucial & exciting problems that exist in Reality Labs. The primary objective will be to develop novel solutions that enable compute and power efficient training and on-device inference of vision and language models for use cases in AR, VR and edge devices. We are hiring in multiple locations. Responsibilities: * Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture and AR/VR use cases. Many of these would be first time solutions in the industry. * Work across hardware and software, to solve deep co-design problems with other Research scientists working in this area. * Codesign and invent novel ML accelerator and system architecture solutions , and facilitate the integration of algorithms and software to utilize these enhancements. * Develop state-of-the art model compression and scalability techniques using Numerics, pruning, distillation etc. * Optimize models on hardware accelerators to achieve the best performance given various real time latency and power constraints. * Influence partners to deliver impact through deep, thorough data-driven analysis. * Define use cases, and develop methodology & benchmarks to evaluate different approaches. * Apply in-depth knowledge of how the ML acceleration interacts with the other systems around it. * Attend conferences/interpret papers and stay updated with latest research advancements in the field of ML acceleration * Patent and/or publish novel outcomes in peer-reviewed conferences and journals.
Must have:
  • Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience
  • PhD in Electrical Engineering, Computer Science or equivalent experience
  • 2+ years of specialized experience in ML/deep learning domains
  • Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python
Good to have:
  • Experience or knowledge of training/inference of Large scale AI models - CV and/or LLMs
  • Experience or knowledge of architecting ML hardware accelerators and systems
  • Experience or knowledge of on-device algorithm development including hardware-aware ML models and/or optimizing ML compilers for efficient deployment on AI accelerators
  • Experience with PyTorch, TensorFlow or similar machine learning toolsets
  • Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ICLR, NeurIPS, CVPR, ACL, ICML, MLSys, ISCA, MICRO, DAC, ASPLOS etc.
  • Demonstrated research and engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub)
  • Experience working and communicating cross functionally in a team environment
  • Experience solving complex problems and comparing alternative solutions, trade offs, and diverse points of view to determine a path forward
Perks:
  • Bonus
  • Equity
  • Benefits
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.
Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR) and Augmented Reality (AR). The compute performance and power efficiency requirements of Virtual and Augmented Reality require custom silicon. Reality Labs Silicon team is driving the state of the art forward with breakthrough work in computer vision, machine learning, mixed reality, graphics, displays, sensors, and new ways to map the human body. Our chips will enable AR & VR devices where our real and virtual world will mix and match throughout the day. We believe the only way to achieve our goals is to look at the entire stack, from transistors, through architecture, firmware, and algorithms. Meta is seeking a Research Scientist to join our Research & Development teams. The ideal candidate will have experience working on AI models, hardware acceleration and software systems related topics. The position will involve taking these skills and applying them to solve for some of the most crucial & exciting problems that exist in Reality Labs. The primary objective will be to develop novel solutions that enable compute and power efficient training and on-device inference of vision and language models for use cases in AR, VR and edge devices. We are hiring in multiple locations.
Research Scientist, ML H/W-SW Codesign Responsibilities
  • Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture and AR/VR use cases. Many of these would be first time solutions in the industry.
  • Work across hardware and software, to solve deep co-design problems with other Research scientists working in this area.
  • Codesign and invent novel ML accelerator and system architecture solutions , and facilitate the integration of algorithms and software to utilize these enhancements.
  • Develop state-of-the art model compression and scalability techniques using Numerics, pruning, distillation etc.
  • Optimize models on hardware accelerators to achieve the best performance given various real time latency and power constraints.
  • Influence partners to deliver impact through deep, thorough data-driven analysis.
  • Define use cases, and develop methodology & benchmarks to evaluate different approaches.
  • Apply in-depth knowledge of how the ML acceleration interacts with the other systems around it.
  • Attend conferences/interpret papers and stay updated with latest research advancements in the field of ML acceleration
  • Patent and/or publish novel outcomes in peer-reviewed conferences and journals.
Minimum Qualifications
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • PhD in Electrical Engineering, Computer Science or equivalent experience.
  • 2+ years of specialized experience in one or more of the following machine learning/deep learning domains: Model compression, hardware aware model optimizations, hardware accelerators architecture, GPU architecture, machine learning compilers, or ML systems, AI infrastructure, high performance computing, performance optimizations, or Machine learning frameworks (e.g. PyTorch), numerics and SW/HW co-design.
  • Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python.
Preferred Qualifications
  • Experience or knowledge of training/inference of Large scale AI models - CV and/or LLMs.
  • Experience or knowledge of architecting ML hardware accelerators and systems.
  • Experience or knowledge of on-device algorithm development including hardware-aware ML models and/or optimizing ML compilers for efficient deployment on AI accelerators.
  • Experience with PyTorch, TensorFlow or similar machine learning toolsets.
  • Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ICLR, NeurIPS, CVPR, ACL, ICML, MLSys, ISCA, MICRO, DAC, ASPLOS etc.
  • Demonstrated research and engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).
  • Experience working and communicating cross functionally in a team environment.
  • Experience solving complex problems and comparing alternative solutions, trade offs, and diverse points of view to determine a path forward.
For those who live in or expect to work from California if hired for this position, please click for additional information.
Locations
Use Ctrl and scroll to zoom the map
Zoom in
Zoom out
Re-centre
Data Center
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

$177,000/year to $251,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about at Meta.


Equal Employment Opportunity and Affirmative Action
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to .
View Full Job Description
$177.0K - $251.0K/yr (Outscal est.)
$214.0K/yr avg.
Redmond, Washington, United States

About The Company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.


We want to give people the power to build community and bring the world closer together. To do that, we ask that you help create a safe and respectful online space. These community values encourage constructive conversations on this page:


• Start with an open mind. Whether you agree or disagree, engage with empathy.

• Comments violating our Community Standards will be removed or hidden. So please treat everybody with respect.

• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.

• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.

• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).


For a full listing of our jobs, visit https://www.metacareers.com

California, United States (On-Site)

Washington, United States (On-Site)

California, United States (On-Site)

Washington, United States (On-Site)

England, United Kingdom (On-Site)

California, United States (On-Site)

New York, United States (On-Site)

Washington, United States (On-Site)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug