Research Intern, Computer Vision for Egocentric Representation Learning (PhD)
Job Summary
Job Description
This internship focuses on applying computer vision methods to model adaptive processes in the human visual system. You'll work within a team exploring innovative approaches to using data from egocentric cameras and motion detectors (IMU) to model image encoding by the eye and apply those models to predict AR display image quality. Responsibilities include identifying, developing, and evaluating methods for learning robust representations from egocentric video data, using a spatially calibrated camera and image processing pipeline to estimate physical scene parameters, leveraging Meta's infrastructure for scalable experimentation, writing modular research code, and collaborating with researchers in image processing and computer vision.
Must have:
- PhD in machine learning, computer vision, or related field
- Experience with research involving problem definition, solution exploration, analysis, and presentation
- Proficiency in Python and ML libraries (numpy, scikit-learn, scipy, pandas, matplotlib, tensorflow, pytorch)
- Experience with self-supervised learning for computer vision
- Understanding of natural image statistics and/or using network layers to characterize scene/image properties
- Work authorization in the country of employment
Good to have:
- Experience with deep metric learning / neural net embedding methods
- Basic understanding of color image processing pipelines
- Basic understanding of modern adaptive camera and image processing pipelines
- Intent to return to degree program after the internship
- First-authored publications in high-impact journals or conferences (e.g., SIGGRAPH, CVPR, ICCV, ECCV, Journal of Vision)
- Cross-group and cross-culture collaboration skills
14 skills required
Job Details
Reality Labs (RL) brings together a world-class, cross-disciplinary science and engineering teams with the shared goal of developing the next generation of AI for AR technologies.
The primary goal of this internship is on applying methods from computer vision to model adaptive processes in the human visual system. We are specifically looking for computer vision researchers who have or would like to learn how to apply CV models toward a better understanding of how human vision works. In this role, you will be embedded in a multidisciplinary team of scientists and engineers exploring innovative approaches to using data from egocentric cameras and motion detectors (IMU) and knowledge about human visual processes to model image encoding by the eye and applying those models to predict the quality of images presented on AR displays.
Our internships are twelve (12) to sixteen (16), or twenty-four (24) weeks long and we have various start dates throughout the year.
Research Intern, Computer Vision for Egocentric Representation Learning (PhD) Responsibilities
- Identify, develop, implement, and evaluate methods for learning robust representations that model human visual performance from egocentric video data
- Learn, evaluate, and use spatially calibrated camera and image processing pipeline to estimate physical scene parameters (e.g. luminance & chromaticity as a function of visual direction)
- Make use of Meta’s large infrastructure to scale and speed up experimentation
- Write modular research code that can be reused in other contexts.
- Collaborate with researchers with expertise in image processing and computer vision
Minimum Qualifications
- Currently has or is in the process of pursuing a PhD in machine learning, computer vision, applied statistics, computational neuroscience, or a related field
- Experience with research involving defining problems, exploring solutions, and analyzing and presenting results
- Proficiency in python and machine learning libraries (numpy, scikit-learn, scipy, pandas, matplotlib, tensorflow, pytorch)
- Experience in approaches to using self-supervised learning for computer vision
- Experience in understanding of approaches to characterize the statistics of natural images and/or how to use properties of network layers to characterize high level scene/image properties
- Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
Preferred Qualifications
- Experience with deep metric learning / neural net embedding methods
- Basic understanding of color image processing pipelines
- Basic understanding of modern adaptive camera and image processing pipelines
- Intent to return to degree program after the completion of the internship/co-op.
- Proven track record of achieving significant results as demonstrated by first-authored publications in high-impact journals or conferences (e. g., SIGGRAPH, SIGGRAPH Asia, Eurographics, CVPR, ICCV, ECCV, Journal of Vision, etc.).
- Interpersonal skills: cross-group and cross-culture collaboration
For those who live in or expect to work from California if hired for this position, please click for additional information.
Locations
Data Center
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
$7,313/month to $11,293/month + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about at Meta.
Equal Employment Opportunity and Affirmative Action
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice .
Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to .
Similar Jobs
Qualcomm
Austin, Texas, United States (On-Site)
• 1 Month ago
Microsoft
Zürich, Zurich, Switzerland (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Roblox
San Mateo, California, United States (On-Site)
• 1 Week ago
Get notifed when new similar jobs are uploaded
Jobs in Redmond, Washington, United States
Apple
Sunnyvale, California, United States (On-Site)
• 4 Weeks ago
Enphase Energy
United States (On-Site)
• 8 Months ago
Elsewhere
San Francisco, California, United States (On-Site)
• 1 Year ago
FalconX
New York, New York, United States (On-Site)
• 2 Months ago
Get notifed when new similar jobs are uploaded
Research Development Jobs
bytedance
San Jose, California, United States (On-Site)
• 8 Months ago
![PwC - Senior AI Developer - Roma [DIG]](/_next/image?url=https%3A%2F%2Foutscal-lms-data.s3.ap-south-1.amazonaws.com%2Fcompany-image%2Fproduction%2Fpwc%2Fpwc_logo_10_16_2024__09_49_44.jpg&w=256&q=50){kind=logo}
bytedance
San Jose, California, United States (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
About The Company
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.
We want to give people the power to build community and bring the world closer together. To do that, we ask that you help create a safe and respectful online space. These community values encourage constructive conversations on this page:
• Start with an open mind. Whether you agree or disagree, engage with empathy.
• Comments violating our Community Standards will be removed or hidden. So please treat everybody with respect.
• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.
• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.
• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).
For a full listing of our jobs, visit https://www.metacareers.com
Get notified when new jobs are added by Meta
