Research and develop evaluation methods to improve the quality of Apple user-facing products, such as Siri and Apple Intelligence. Work with evaluation/experimentation engineering teams to translate methodological developments into technologies for product engineering. Analyze large, complex datasets and solve difficult, non-routine analysis problems using advanced analytical methods, including prompt engineering and building LLMs as judges. Conduct data collection, quality control, requirements specification, processing, and presentations. Build and prototype analysis pipelines iteratively to provide insights at scale. Develop comprehensive knowledge of product data structures and metrics, advocating for necessary changes. Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations. Passionate about building outstanding products with a wide variety of skills and innovation.
Good To Have:- Prompt engineering
- Building LLM as judges
- User experience evaluations
Must Have:- Research and develop evaluation methods
- Improve user-facing product quality
- Translate methodological developments
- Work with large, complex datasets
- Solve advanced analysis problems
- Conduct data collection and quality control
- Build and prototype analysis pipelines
- Develop knowledge of product data structures and metrics
- Partner with product engineering teams
- Core machine learning algorithms