Real-Time Computer Vision Architect

57 Minutes ago • 8 Years + • $181,100 PA - $318,400 PA
Research Development

Job Description

The Video Computer Vision and Video Engineering teams at Apple are seeking a Real-Time Computer Vision Architect. This role involves developing real-time on-device Computer Vision, Machine Perception, and Image Quality technologies across Apple products. The architect will balance research and product development, innovate through the full stack, and partner with hardware and software teams to influence roadmaps. The position focuses on co-designing computer vision algorithms and systems, understanding trade-offs between algorithm performance, imaging pipeline, system resources, and real-time constraints, and requires strong collaboration skills.
Good To Have:
  • Breadth of knowledge in some areas of computer vision including either classical methods or ML (Image Enhancement, SLAM, calibration, scene understanding, gaze tracking, human representation, and activity recognition).
  • Experience in translating ambiguous, high-level product goals into detailed feature-level architectures and system requirements.
  • Proven ability to derive defensible end-to-end requirements at the system level and decompose them into module/component specific requirements that include firmware, ISP, and OS constraints.
  • Strong leadership skills to drive large multi-functional efforts, resolve conflicts, and present results to the highest levels of Apple leadership.
  • Demonstrated ability to bridge the gap between high-level algorithm design and low-level system optimization.
  • Experience in optimizing and fine-tuning ISP pipelines, including tasks like noise reduction, color correction, demosaicing, and dynamic range enhancement.
  • Exposure to modern innovative techniques including vision transformers, foundation models, and vision-language models, with a focus on integrating these methods into resource-constrained environments.
  • Proficiency in debugging and optimizing performance at the firmware or OS level, with specific expertise in tuning ISP performance.
Must Have:
  • BS in Computer Science, Electrical engineering, or other relevant fields with a minimum of 8 years relevant proven experience.
  • Validated ability to work in a highly multi-functional environment at the intersection of Computer Vision, Embedded Systems, ISP, Mechanical and Electrical engineering, Optical Science, Human Factors or similar.
  • Proven track record in developing and improving CV perception algorithms and ISP pipelines.
  • Demonstrated experience in optimizing computer vision algorithms for performance, power, and memory on embedded platforms.
  • Familiarity with firmware integration, operating system constraints, power and memory constraints, and low-level software development for image signal processing (ISP) in real-time applications.
  • Strong understanding of perception sensing technologies including color and monochrome cameras, depth sensors, and IMUs.
  • Ability to understand and articulate trade-offs between multiple sensing solutions and their impact on both high-level algorithms and low-level system performance.
Perks:
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Range of discounted products and free services
  • Reimbursement for certain educational expenses (tuition) for formal education related to advancing career at Apple
  • Opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs
  • Eligibility for discretionary restricted stock unit awards
  • Option to purchase Apple stock at a discount through Employee Stock Purchase Plan
  • Eligibility for discretionary bonuses or commission payments
  • Relocation assistance

Add these skills to join the top 1% applicants for this job

team-management
problem-solving
game-texts
computer-vision
algorithms

The Video Computer Vision and Video Engineering teams are centralized applied research and engineering organizations responsible for developing real-time on-device Computer Vision, Machine Perception and Image Quality, technologies across Apple products. We balance research and product to deliver Apple quality, groundbreaking experiences, innovating through the full stack, and partnering with HW and SW teams to influence SW architecture, sensors, silicon, PD/ID roadmaps that brings our vision to life.

The Architecture team within our organization is responsible for bringing together computer vision algorithms, firmware, and low-level software teams to drive some of the most exciting programs across many Apple products! We do this by enabling the co-design of computer vision algorithms and systems through a deep understanding of the complexities and trade-offs between algorithm performance, imaging pipeline, system resources, and real-time constraints. To be successful in this role, you not only have to be an excellent engineer, but also a phenomenal collaborator—comfortable communicating with a wide range of experts and leaders across many different domains, from firmware and OS to feature and experience.

Key Qualifications

  • BS in Computer Science, Electrical engineering, or other relevant fields with a minimum of 8 years relevant proven experience.
  • Validated ability to work in a highly multi-functional environment at the intersection of Computer Vision, Embedded Systems, ISP, Mechanical and Electrical engineering, Optical Science, Human Factors or similar.
  • Proven track record in developing and improving CV perception algorithms and ISP pipelines.
  • Demonstrated experience in optimizing computer vision algorithms for performance, power, and memory on embedded platforms. Familiarity with firmware integration, operating system constraints, power and memory constraints, and low-level software development for image signal processing (ISP) in real-time applications.
  • Strong understanding of perception sensing technologies including color and monochrome cameras, depth sensors, and IMUs. Ability to understand and articulate trade-offs between multiple sensing solutions and their impact on both high-level algorithms and low-level system performance.

Description

  • Breadth of knowledge in some areas of computer vision including either classical methods or ML. These areas may include Image Enhancement, SLAM, calibration, scene understanding, gaze tracking, human representation, and activity recognition.
  • Experience in translating ambiguous, high-level product goals into detailed feature-level architectures and system requirements. Proven ability to derive defensible end-to-end requirements at the system level and decompose them into module/component specific requirements that include firmware, ISP, and OS constraints.
  • Strong leadership skills to drive large multi-functional efforts, resolve conflicts, and present results to the highest levels of Apple leadership. Demonstrated ability to bridge the gap between high-level algorithm design and low-level system optimization—including the challenges of optimizing ISP performance under tight power and latency constraints.
  • Experience in optimizing and fine-tuning ISP pipelines, including tasks like noise reduction, color correction, demosaicing, and dynamic range enhancement.
  • Ideal candidates will also have exposure to modern innovative techniques including vision transformers, foundation models, and vision-language models, with a focus on integrating these methods into resource-constrained environments.
  • Proficiency in debugging and optimizing performance at the firmware or OS level, with specific expertise in tuning ISP performance to ensure tight integration between hardware capabilities and algorithmic performance.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.

Set alerts for more jobs like Real-Time Computer Vision Architect
Set alerts for new jobs by Apple
Set alerts for new Research Development jobs in United States
Set alerts for new jobs in United States
Set alerts for Research Development (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙