Job Description
- Degrees in engineering, linguistics, or psychology preferred
- Experience in content creation, QA testing, prompt engineering, or editing preferred
- Create Enterprise AI Model Evaluation Test Sets
- Evaluate AI Models on multiple quality parameters
- Generate AI Evaluation Reports for model improvement
- Test UX Flows for seamless GenAI usage
- Automate Testing Flows using scripts and browser tools
- Bachelor’s degree
- Strong verbal and written English communication skills
- 1-3 years of prior professional experience
- Stay at the cutting edge of GenAI research, guided and coached by top researchers
- Learn best practices for solving user problems with GenAI products
- Collaborate across cross-functional teams to effectively achieve customer impact
About Ema:
Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.
Responsibilities:
1. Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.
2. Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.
3. Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.
4. Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema’s users.
5. Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.
Requirements:
1. Educational Background: Bachelor’s degree required. Degrees in engineering, linguistics, or psychology preferred.
2. Communication Skills: Strong verbal and written English communication skills are essential.
3. Professional Experience: 1-3 years of prior professional experience. Experience in content creation, QA testing, prompt engineering, or editing is preferred.
Benefits:
- Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.
- Learn best practices for solving user problems with GenAI products.
- Collaborate across cross-functional teams to effectively achieve customer impact.
