Generative AI Applied Scientist, SIML - ISE

Apple

Job Summary

Apple's System Intelligence and Machine Learning (SIML) team is seeking a senior Generative AI expert to develop the next generation of human-centric device interaction and multimodal scene understanding. This role involves pioneering multimodal LLMs to perceive and understand complex scenes, human interactions, behaviors, and preferences. You will focus on the end-to-end lifecycle of generative models, from novel architecture design and large-scale training to final deployment, contributing to Apple Intelligence.

Must Have

  • Design, train, and deploy large-scale multimodal LLMs, owning the entire lifecycle
  • Implement and demonstrate novel, human-centric user experiences using large foundation models
  • Create robust, scalable ML models and APIs integrated into Apple's production pipelines
  • Work closely with partner teams to build, iterate, and adapt innovative solutions

Good to Have

  • Proven track record of deploying innovative ML technologies in production
  • Familiarity with developing ML for resource-constrained devices
  • Experience working with large cross-functional and diverse teams

Perks & Benefits

  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Range of discounted products and free services
  • Reimbursement for certain educational expenses, including tuition
  • Eligibility for discretionary bonuses or commission payments
  • Eligibility for relocation

Job Description

Generative AI Applied Scientist, SIML - ISE

Apple's System Intelligence and Machine Learning (SIML) team is seeking a senior Generative AI expert to pioneer the next generation of human-centric device interaction and multimodal scene understanding. You will be at the core of our efforts to develop multimodal LLMs that can perceive and understand complex scenes and nuanced human interactions, behaviors, and preferences. This is a unique opportunity to join a leading applied research group known for its foundational contributions to Apple Intelligence, where you will focus on the end-to-end lifecycle of generative models—from novel architecture design and large-scale training to final deployment.

We are looking for a senior applied scientist with strong ML and Generative modeling skills who can design, train, and deploy multimodal GenAI technology. You will need to learn quickly and implement and demonstrate new user experiences using large foundation models. You will build novel and innovative technology, forge collaborations with cross-functional partners, and adapt and iterate your solutions in a dynamic environment. You will be expected to advance human interaction and scene understanding modeling across various fronts, from a system level to a core ML algorithm level. Some of the myriad challenges include understanding user behavior and preferences from interactions with the device and the environment, retrieving useful and nuanced information based on past interactions, handling deeply interleaved streaming inputs, reasoning over varying temporal contexts, developing memory systems to enable long-term adaptation, and generating semantically rich internal representations to enable open-ended downstream tasks. You will be responsible for delivering ML models and solutions that can readily be adopted in production pipelines, such as APIs for production-ready ML models and algorithms well-integrated into our training infrastructure.

  • Design, train, and deploy large-scale multimodal LLMs, owning the entire lifecycle from initial architecture to final deployment within the constraints
  • Implement and demonstrate novel, human-centric user experiences by applying the capabilities of large foundation models
  • Create robust, scalable ML models and APIs that can be well-integrated into Apple's production pipelines and training infrastructure
  • Work closely with partner teams to build, iterate, and adapt innovative solutions in a dynamic, product-focused environment
  • PhD or Masters Degree in Computer Science, Engineering, or a related field with a focus on machine learning; or equivalent experience
  • Strong research skills with first author publications in top tier ML conferences
  • Expert-level knowledge of SOTA in large auto-regressive transformer models, multi-modal encoders, and representation learning
  • Experience with multimodal large language models (LLMs)
  • Strong programming skills in Python, maintaining ML code bases grounded in software engineering principles
  • Proven track record of deploying innovative ML technologies in production
  • Familiarity with developing ML for resource-constrained devices
  • Experience working with large cross-functional and diverse teams

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

.

Apple accepts applications to this posting on an ongoing basis.

6 Skills Required For This Role

Cross Functional Game Texts Html Python Algorithms Machine Learning

Similar Jobs