Senior Machine Learning Engineer, Test Foundations

As a Senior ML Engineer on the Test Foundations team, you will serve as a pivotal technical contributor, leveraging advanced ML models and MLLMs to spearhead the research, design, and implementation of test automation tools and systems. These efforts will support the expeditious, frequent, and high-quality release of products. Responsibilities:

• Customize innovative AI solutions for our Test Automation systems, bridging the gap between general-purpose LLMs and the specialized requirements of Test Automation, encompassing areas from test case generation to intelligent reporting.
• Implement scalable AI/ML solutions for the automated testing of the Roblox App across all supported platforms, including mobile, desktop, console, and VR.
• Identify existing workflow and system inefficiencies that could benefit from AI integration.
• Drive innovation by exploring state-of-the-art ML research, including multimodal AI, LLMs, Reinforcement Learning, and Generative AI, and applying practical, impactful solutions for Test Automation.
• Provide mentorship to other engineers and contribute to the technical strategy across teams.
• Engage in effective collaboration with cross-functional partners, including engineers, product managers, and researchers throughout Roblox.

Qualifications:

• Hands-On Experience: A minimum of three years of practical experience in designing, building, and deploying complex machine learning models into production environments at scale.
• MLLM Expertise: A robust understanding and practical application of MLLMs and AI systems to resolve challenges in testing and test automation.
• Technical Proficiency: Demonstrated mastery of deep learning frameworks (e.g., PyTorch, TensorFlow) and the ML development lifecycle. Strong programming skills, particularly in Python, are essential.
• Execution Orientation: A proven ability to successfully execute complex technical projects, make critical design decisions, influence technical roadmaps, and guide teams.
• Problem-Solving Mindset: A proactive, results-oriented approach to addressing ambiguous and challenging technical problems.

Preferred Qualifications:

• Experience in leveraging ML and AI models for automation and multi-platform testing.
• Experience in constructing and working with robust, cross-platform test automation frameworks.