Cambridge Research Intern – Evaluating LLM Agent Systems

Are you a PhD student passionate about AI and eager to make a tangible impact on real-world products? Join us at Microsoft Research and M365 Research for a unique opportunity to advance the development of AI through cutting-edge research. Our work directly influences the future of AI products, and we are looking for talented individuals to help us push the boundaries even further. At MSR Cambridge and M365 Research, we are dedicated to pioneering advancements in AI technology. This internship focuses on evaluating and enhancing LLM-based agent systems. For example, consider Microsoft Copilot, an LLM-based agent system that has already revolutionized user experiences. Our research aspires to further improve the experiences of such systems, driving innovation and excellence in AI.

We are seeking ML/NLP PhD students who have a keen interest in evaluation for LLM-based agent systems. Join us in Cambridge for the spring/summer of 2025. You will be part of a welcoming and highly collaborative environment, working on creative and challenging problems throughout your internship.

Required Qualifications

In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

· Currently enrolled in a PhD program in Computer Science, Mathematics, or a related STEM field.

· Must have at least 1 year of experience in conducting research, writing peer-reviewed publications and software development.

· Experience with one or more of the following: LLM training, inference, architectures, chain-of-thought, prompt-tuning, evaluation, reasoning.

· Interns are expected to be physically located in Cambridge UK, and commence their internship between 1 April – 30 June 2025 Preferred Qualifications

· Publications in top conferences/journals, in at least one of the following areas: natural language processing, statistics, machine learning, and optimization.

· Strong programming skills, preferable in Python.

· Excellent written and verbal communication skills.

· Participate in a 12-week internship program designed to provide hands-on experience and professional development.

· Collaborate with mentors, other interns, and researchers to conduct cutting-edge research and develop AI algorithms and models.

· Present your findings in publications and actively contribute to the vibrant life of the research community.

· Engage in various research areas to broaden your expertise.