Scale AI

Head of Evaluation and Oversight Research

Tech Lead Manager, Machine Learning Research Scientist- LLM Evals

Machine Learning Research Scientist / Engineer, Reasoning

AI Strategic Projects Lead, International Public Sector

AGC, Commercial

Machine Learning Research Scientist / Research Engineer, Post-Training

Machine Learning Engineer, Enterprise

Finance Manager, Enterprise BU

Solutions Engineer - Robotics

Scale is the leading data and evaluation partner for frontier AI companies, focusing on advancing the science of evaluating and characterizing large language models (LLMs) and tackling scalable oversight problems. This role leads a team of research scientists and engineers on foundational work in evaluation and oversight, driving research initiatives on frameworks and benchmarks for frontier AI models, and designing advanced scalable oversight methods.

Machine Learning Research Engineer - Robotics

Scale is the leading data and evaluation partner for frontier AI companies, playing an integral role in advancing the science of evaluating and characterizing large language models (LLMs). Our research focuses on tackling the hardest problems in scalable oversight and the evaluation of advanced AI capabilities. We collaborate broadly across industry and academia and regularly publish our findings.Our Research team is shaping the next generation of evaluation science for frontier AI models and works at the leading edge of model assessment and oversight. Some of our current research includes:<ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Developing AI-assisted evaluation pipelines, where models help critique, grade, and explain outputs (e.g. RLAIF, model-judging-model).</li><li class="leading-relaxed">Advancing scalable oversight methods, such as rubric-guided evaluations, recursive oversight, and weak-to-strong generalization.</li><li class="leading-relaxed">Designing benchmarks for frontier capabilities (e.g. reasoning, coding, multi-modal, and agentic tasks), inspired by efforts like MMMU, GPQA, SWE-Bench.</li><li class="leading-relaxed">Building evaluation frameworks for agentic systems, measuring multi-step workflows and real-world task success.</li></ul><h3 class="text-xl md:text-2xl font-bold mt-8 mb-3 text-gray-800">You will:</h3><ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Lead a team of research scientists and engineers on foundational work in evaluation and oversight.</li><li class="leading-relaxed">Drive research initiatives on frameworks and benchmarks for frontier AI models, spanning reasoning, coding, multi-modal, and agentic behaviors.</li><li class="leading-relaxed">Design and advance scalable oversight methods, leveraging model-assisted evaluation, rubric-guided judgments, and recursive oversight.</li><li class="leading-relaxed">Collaborate with leading research labs across industry and academia.</li><li class="leading-relaxed">Publish research at top-tier venues and contribute to open-source benchmarking initiatives.</li><li class="leading-relaxed">Remain deeply engaged with the research community, both understanding trends and setting them.</li></ul><h3 class="text-xl md:text-2xl font-bold mt-8 mb-3 text-gray-800">Ideally you'd have:</h3><ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Track record of impactful research in machine learning, especially in generative AI, evaluation, or oversight.</li><li class="leading-relaxed">Significant experience leading ML research in academia or industry.</li><li class="leading-relaxed">Strong written and verbal communication skills for cross-functional collaboration.</li><li class="leading-relaxed">Experience building and mentoring teams of research scientists and engineers.</li><li class="leading-relaxed">Publications at major ML/AI conferences (e.g. NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR) and/or journals.</li></ul>Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture. We do not ask LeetCode-style questions.Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You’ll also receive benefits including, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is:$260,000 - $350,000 USDPLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.About Us:At Scale, we believe that the transition from traditional software to AI is one of the most important shifts of our time. Our mission is to make that happen faster across every industry, and our team is transforming how organizations build and deploy AI. Our products power the world's most advanced LLMs, generative models, and computer vision models. We are trusted by generative AI companies such as OpenAI, Meta, and Microsoft, government agencies like the U.S. Army and U.S. Air Force, and enterprises including GM and Accenture. We are expanding our team to accelerate the development of AI applications.We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.We comply with the United States Department of Labor's Pay Transparency provision.PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

thumbnail_Rockstar.webp

Rockstar.webp

Rockstar Jobs

thumbnail_EA.webp

EA.webp

EA Jobs

thumbnail_Playstation.webp

Playstation.webp

Playstation Jobs

small_Ubisoft.webp

thumbnail_Ubisoft.webp

Ubisoft.webp

Ubisoft Jobs

thumbnail_Epic Games.webp

Epic Games.webp

Epic Game Jobs

thumbnail_Riot Games.webp

Riot Games.webp

Riot Jobs

08cafc09dac48d655284704f063dc64e.webp

CDPR Jobs

80ad888d-4837-48d9-8b65-0ffdee910f35.webp

Krafton Jobs

thumbnail_a14feb4b393500244d0b8864bda07b2c.webp

a14feb4b393500244d0b8864bda07b2c.webp

Twitch Jobs

thumbnail_865c7fd0-1ffd-4000-80b6-1e69d6665257.webp

865c7fd0-1ffd-4000-80b6-1e69d6665257.webp

Larian Jobs

thumbnail_02_21_2024__11_00_53.webp

02_21_2024__11_00_53.webp

Wargaming Jobs

medium_naughty dog.webp

small_naughty dog.webp

thumbnail_naughty dog.webp

naughty dog.webp

Naughty Dog Jobs

large_netflix.webp

medium_netflix.webp

small_netflix.webp

thumbnail_netflix.webp

netflix.webp

Netflix Jobs

large_supercell.webp

medium_supercell.webp

small_supercell.webp

thumbnail_supercell.webp

supercell.webp

Supercell Jobs

zynga_logo.jpg

Zynga Jobs

Test your Unity Animations knowledge with this quiz! Explore concepts like Animator Controller, Blend Trees, and many more.

Test your Unity UI knowledge with this quiz! Explore essential concepts like Canvas, EventSystem and many more. 

Challenge yourself with this Unity Input System quiz! Test your skills in input mapping, device handling, and action events.

Take your Unity skills to the next level with Part 3 of this quiz, covering scripting, physics, rendering, and performance optimization!

Test your Unity expertise with this quiz, covering initialization to advanced rendering and physics!

Test your Unity knowledge with this comprehensive quiz, covering everything from MonoBehaviour basics to advanced physics, rendering, and optimization techniques across multiple difficulty levels!

Assess your knowledge of Unity's Rigidbody component and its advanced physics interactions with this in-depth quiz!

Test your understanding of Unity’s Physics, Movement, and MonoBehaviour with this insightful beginner-friendly quiz!

Dive into the fundamentals of open-world game development in Unity with this beginner-friendly quiz.

Challenge yourself with this beginner-friendly quiz on building an endless runner in Unity!

Test your beginner-level knowledge of Unity platformer development with this engaging quiz.

Test your basic knowledge of Unity and Unreal Engine with this beginner-friendly quiz on game development fundamentals.

This assessment evaluates your understanding of Unity's component-based architecture, how GameObjects and their components interact, the hierarchy system with nested GameObjects, and how to reference them in scripts.

This assessment evaluates your understanding of Unity's NavMesh system, including navigation baking, NavMeshAgents, pathfinding, obstacles, and scripting interactions with NavMesh to create AI-driven movement.

An assessment to test the correct usage of Unity's events and lifecycle functions in the context of the game "Clash Royale"

- This assessment gives us an idea of your C++ skills - Companies that evaluate this skillset in interviews: Rockstar Games, Ubisoft, Mayhem Studios, etc. - 10 Multiple Choice questions - Average time to complete: 7 to 10 minutes

Let's assess your Data Structures! 📋 &nbsp;- This assessment gives us an idea of your problem solving skills using DSA - Companies that evaluate this skillset in interviews: MPL, LILA Games, GSN Games, etc. - 10 Multiple Choice questions - Average time to complete: 7 to 10 minutes

Let's assess your Programming Patterns! 📋- This assessment gives us an idea of your code architecture skills - Companies that evaluate this skillset in interviews: Dirtcube, PTW, Playshifu, etc. - 10 Multiple Choice questions - Average time to complete: 7 to 10 minutes

Let's assess your OOPs skills! 📋- This assessment gives us an idea of your fundamental OOPS concepts and Solid principles skills - Companies that evaluate this skillset in interviews: Hitwicket, GSN Games, Tomo Club, etc. - 10 Multiple Choice questions - Average time to complete: 7 to 10 minutes

Let's assess your Unity Skills 📋 - This assessment gives us an idea of your Unity fundamentals - Companies you can apply for after taking this assessment: Godspeed games, Salvation Games, nCore Games, etc. - 9 questions: 9 Multiple Choice - Minimum score needed to qualify: 80% - Average time to complete: 5 to 10 minutes

ansira

Partner Support Team Lead

Maersk

Process Expert/Senior Process Expert

Senior Associate Jira, Azure DevOps Application Technology-MS Engg Advisory Kolkata

IN-Associate_CSV_ITRA_Advisory_Mumbai/Bangalore/Gurgaon

Cineplex

Cast Member

Haleon

Experienced Regional Channel Trade Marketing Manager, East

Iron Mountain

Data Entry Analyst

Mercury

Senior Program Manager - Marketing

The Partner Support Team Lead oversees Brandmuscle’s client support, ensuring service levels are met across phone, email, and chat. This role involves leading a team, improving support processes, managing client implementations, and collaborating with internal departments. The leader will also track performance, provide coaching, and offer training to team members, focusing on effective, results-oriented support for individual franchisees and dealers.

Ansira is the leading marketing platform for brands that operate in distributed ecosystems. By orchestrating the entire brand-to-local value chain, Ansira synchronizes global companies’ internal and external teams across channels, markets and regions. Ansira leverages AI-powered technology, vertical expertise, local insights and strategic partnerships to optimize marketing performance and empower partner growth at scale.

Sr Specialist

Sr. Associate

Associate CPM

Partner Support Associate (Customer Support Representative)

Salesforce Support Specialist / Analyst

Partner Support Associate

Sr. Associate, Client Success Delivery

Quality Assurance Engineer II

The Partner Support team is responsible for overseeing Brandmuscle’s support efforts for clients looking for assistance while using our software. The support team offers phone, email, and chat channels for our clients to contact us. The support team is responsible to achieve and exceed acceptable service levels for all channels.Team Leader, Partner Support is responsible for the overall success of a company's Partner Support team. They may be required to work directly with corporate stakeholders and individual franchisees and dealers, with a passion for effective, results-oriented support. This position will also provide on-site coaching and training to team members and work collaboratively with other internal departments within the company to effectively communicate and train program/product/policy updates to the support team members.Responsibilities:<ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Providing day-to-day leadership to Brandmuscle’s Partner Support team, helping to ensure that all support service level metrics are being achieved</li><li class="leading-relaxed">Identifying opportunities to improve the support process and ensure that all team members have the tools and training necessary to meet the needs of Brandmuscle clients</li><li class="leading-relaxed">Working directly with Brandmuscle corporate clients to manage the introduction and implementation of Brandmuscle’s local marketing services</li><li class="leading-relaxed">Working with cross-functional team members to drive business targets and deliver on shared team goals</li><li class="leading-relaxed">Tracking performance metrics and analyzing individual activity, productivity and pacing (call reviews, scoring, coaching, development, performance improvement)</li><li class="leading-relaxed">Presenting a training program and defined career path</li><li class="leading-relaxed">Respond to customer inquiries (incoming calls, chats and emails), resolve problems, and provide a positive customer experience</li><li class="leading-relaxed">Providing feedback to client and taking part in strategic leadership, idea sharing and proactive initiatives</li><li class="leading-relaxed">Team management: Hire, train, and supervise customer support representatives</li><li class="leading-relaxed">Performance measurement: Compile and analyze data to measure performance, monitor progress, and report to upper management</li><li class="leading-relaxed">Quality assurance: Develop/Review quality control processes, review interactions and provide feedback to improve service delivery</li><li class="leading-relaxed">Training: Provide training and upskilling opportunities for team members</li></ul>Requirements<ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Bachelor’s degree required</li><li class="leading-relaxed">Familiarity with a variety of approaches to provide customer service through email, chat, and inbound/outbound calls</li><li class="leading-relaxed">Superior communication skills, both verbal and written</li><li class="leading-relaxed">Detail- and client service-oriented</li><li class="leading-relaxed">Well-versed in use of Microsoft Office products (Excel, PowerPoint, Outlook)</li><li class="leading-relaxed">Excellent organizational skills</li><li class="leading-relaxed">Ability to manage escalation path</li><li class="leading-relaxed">Willingness to work in 24 * 7 work environment</li><li class="leading-relaxed">Willingness to work on weekends with scheduled week offs as per business requirement</li></ul>Desired Experience<ul class="list-disc list-inside my-5 pl-5 space-y-2 text-gray-700"><li class="leading-relaxed">Minimum of (3) years of experience in leading customer support team</li><li class="leading-relaxed">Experience with Zendesk, Salesforce, Workforce Management recommended</li></ul>

Follow Mayank - career advice

Follow Mayank Grover for game development resources

Free | C# | Midnight Pizza Fight

Free | C++ | Lethos

Free | C++ | Pong

Follow Abhishek - tech content

Follow Abhishek Smith for game programming content

This assessment gives us an idea of your C++ skills- Companies that evaluate this skillset in interviews: Rockstar Games, Ubisoft, Mayhem Studios, etc.- 10 Multiple Choice questions- Average time to complete: 7 to 10 minutes

Let's assess your Data Structures! - This assessment gives us an idea of your problem solving skills using DSA- Companies that evaluate this skillset in interviews: MPL, LILA Games, GSN Games, etc.- 10 Multiple Choice questions

Data Structures and Algorithms

Let's assess your Programming Patterns! ????- This assessment gives us an idea of your code architecture skills- Companies that evaluate this skillset in interviews: Dirtcube, PTW, Playshifu, etc.

Programming Patterns

Let's assess your OOPs skills! ????- This assessment gives us an idea of your fundamental OOPS concepts and Solid principles skills- Companies that evaluate this skillset in interviews: Hitwicket, GSN Games, Tomo Club, etc.

Object Oriented Programming

Let's assess your Unity Skills ????- This assessment gives us an idea of your Unity fundamentals- Companies you can apply for after taking this assessment: Godspeed games, Salvation Games, nCore Games, etc.