Senior Psychometrician

Our mission at Duolingo is to develop the best education in the world and make it universally available. It’s a big mission, and that’s where you come in!

At Duolingo, you’ll join a team that cares about educating our users, experimenting with big ideas, making fact-based decisions, and finding innovative solutions to complex problems. You’ll have limitless learning opportunities and daily collaborations with world-class minds — while doing work that’s both meaningful and fun.

Join our life-changing mission to develop education for our half a billion (and growing!) learners around the world.

Read our blog to learn more.

***

About the role...

Our mission at Duolingo is to develop the best education in the world and make it universally available. But we’ve got more left to do — and that’s where you come in!

Duolingo is the world's most popular learning app. Beyond our core learning product, we also offer English proficiency testing with the Duolingo English Test, and are bringing new subjects into the Duolingo app, where people can develop their Math and Music skills.

We are passionate about educating our users, making fact-based decisions, and finding innovative solutions to complex problems. We offer meaningful work, limitless learning opportunities, and collaboration with world-class minds. Come brighten your life and over half a billion more!

Duolingo is looking for an outstanding authority in psychometrics with elite knowledge of psychometric techniques as well as the desire and ability to support foundational research and operational excellence for the Duolingo English Test. You will join Duolingo’s growing research team and contribute to agile, ongoing development of the test, aiding our efforts to advance Duolingo’s mission through science.

You will...

• Collaborate with dedicated assessment scientists, engineers, and designers to apply psychometric operational excellence principles to innovative and novel assessment instruments
• Develop and apply computational psychometric methods for high-quality language assessments, such as adaptive assignment algorithms, explanatory item response theory (IRT) models, and AI-enhanced scoring systems.
• Build software that monitors and ensures the continued quality and fairness of underlying algorithms, including those powered by machine learning.
• Use AI tools to synthesize research, prototype new test items, assist with code development, and enhance feature extraction pipelines.
• Communicate findings through blogs, dashboards, technical reports, conference presentations, and peer-reviewed journals, potentially using AI to accelerate writing and visualization workflows.

You have...

• 3–5 years of post-PhD experience working in an education-related field.
• PhD in a quantitative field (such as educational measurement, psychometrics, statistics, data science, or artificial intelligence).
• A strong research publication record in psychometrics, educational measurement
• Outstanding interpersonal, communication, and organizational skills for effective collaboration across AI and assessment domains.
• Evidence of innovation in psychometric research or analysis, particularly in leveraging AI or computational methods.
• Excellent skills in open-source data science tools, such as R and Python
• Desire to make the world a better place through technology
• Ability to relocate or work in the Pittsburgh, PA office.

⭐ Exceptional candidates will have...

• Experience with the design, development, and analysis of computer-adaptive tests and data-driven assessments.
• A deep understanding of psychometric modeling techniques, along with hands-on experience applying machine learning and natural language processing (NLP) techniques to educational data.
• Familiarity with how AI can support item development, automated scoring, and test integrity monitoring.
• Familiarity with AI frameworks (e.g., PyTorch, TensorFlow, Hugging Face) is a plus.
• An open mind toward the creative integration of AI and traditional psychometric practices, and a passion for improving global access to high-quality assessment.

Take a peek at how we care for our employees' holistic well-being with our benefits here.

We will do everything we can within reason to make sure that your interview takes place in an environment that fairly and accurately assesses your skills. If you need assistance or accommodation, please contact accommodations@duolingo.com.

Duolingo is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

By applying for this position your data will be processed as per the Duolingo Applicant Privacy Notice.

Sign up for job alerts here.