Software Architect: ML Systems and Evaluation Engineering
2 Months ago • 7 Years + • $181,100 PA - $318,400 PA
Devops
Job Description
Our Siri team is developing groundbreaking technology at the intersection of large-scale systems, spoken language, machine learning, and LLMs. We aim to build a conversational agent that is helpful, knowledgeable, and can get things done naturally and intelligently. The ML SEE team supports the rapid iteration loop for Siri ML and software engineers by building large-scale evaluation solutions for Apple’s latest language models and Siri's overall customer experience. We are seeking a senior engineering architect to drive the strategy and technical design for ML systems evaluation, focusing on building an end-to-end model evaluation platform and shaping methodologies to improve model accuracy and performance.
Good To Have:
- Experience with Python
- Familiarity with C++, C#, or Java
- MS in Computer Science or equivalent experience
- Extensive experience with native and cross-platform mobile SDKs
- Full-stack development of ML-based software on consumer devices
- Systems engineering experience
- Understanding of ML and SW component interdependencies
Must Have:
- 7+ years in mobile app and OS development
- Proficiency in Swift/Objective-C or Java/Kotlin
- Experience with cross-platform frameworks (Flutter, React Native)
- Strong software engineering skills (design, development, testing, debugging)
- Ability to solve complex, large-scale technical challenges
- Proven record of gaining technical expertise and learning independently
- BS in Computer Science or equivalent experience
Perks:
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for educational expenses
- Potential for discretionary bonuses or commission payments
- Relocation assistance
Our Siri team is developing groundbreaking technology at the intersection of large-scale systems, spoken language, machine learning, and LLMs in pursuit of a unique challenge: building a conversational agent that is not only helpful and knowledgeable but can also get things done naturally, intelligently, and delightfully, at the level of quality that Apple’s customers have come to expect. The ML SEE team powers the rapid iteration loop for Siri ML and software engineers. We build large-scale evaluation solutions for Apple’s latest language models and Siri's overall customer experience. We are looking for a senior engineering architect to drive the strategy and technical design for ML systems evaluation.
Our Siri team is developing groundbreaking technology at the intersection of large-scale systems, spoken language, machine learning, and LLMs in pursuit of a unique challenge: building a conversational agent that is not only helpful and knowledgeable but can also get things done naturally, intelligently, and delightfully, at the level of quality that Apple’s customers have come to expect. The ML SEE team powers the rapid iteration loop for Siri ML and software engineers. We build large-scale evaluation solutions for Apple’s latest language models and Siri's overall customer experience. We are looking for a senior engineering architect to drive the strategy and technical design for ML systems evaluation.
In this Technical Lead role, you will play a key part in designing and building a large-scale, end-to-end model evaluation platform, while also shaping methodologies that drive improvements in model accuracy and performance. Your work will deliver high-quality offline evaluation insights that inform model development and elevate the user experience — all in alignment with Apple’s industry-leading standards for privacy and quality. As part of the team advancing Apple Intelligence, you’ll take on challenges such as developing realistic simulation environments, and contributing to scalable evaluation pipelines that can evolve rapidly alongside shifting system architectures. With Siri becoming increasingly personal, you’ll collaborate closely across teams to implement evaluation solutions grounded in real-world, context-aware scenarios. In this role, you will own requirements, including 'proof of concept' development, and co-own the development roadmap for ML system evaluation platform. You have a consistent record defining success by completing the full product cycle, from design and implementation to gathering feedback and iterating on systems, frameworks, and tools for Siri
- 7+ years of professional experience in mobile app and OS development, with proficiency in Swift/Objective-C or Java/Kotlin, along with cross-platform frameworks such as Dart (Flutter), JavaScript/TypeScript (React Native).
- Experience with Python is a plus, as well as familiarity with at least one additional object-oriented programming language, such as C++, C#, or Java.
- Strong software engineering skills, including system design, development, testing, debugging, release and maintenance.
- Demonstrated ability to solve complex, large-scale technical challenges by operating beyond conventional constraints, particularly in globally distributed products
- Proven record of gaining technical expertise on the job; demonstrated ability to learn new technologies independently
- BS in Computer Science, or equivalent experience in a related field
- MS in Computer Science, or equivalent experience in a related field
- Extensive experience with native and cross-platform mobile SDKs
- Experience with full-stack development of ML-based software on consumer devices
- Experience with systems engineering; some understanding of interdependencies of ML and SW components
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
Learn more about your EEO rights as an applicant.Set alerts for more jobs like Software Architect: ML Systems and Evaluation Engineering
Set alerts for new jobs by Apple
Set alerts for new Devops jobs in United States
Set alerts for new jobs in United States
Set alerts for Devops (Remote) jobs
