AI Analyst
level ai
Job Summary
Level AI is seeking an AI Analyst to join their team, focusing on revolutionizing customer engagement through an AI-native platform that leverages Large Language Models. The role involves proposing and conducting quantitative research into user behaviors and trends, building statistical models to identify key drivers, and analyzing data to identify common trends. You will also be responsible for proposing enhancements for automation pipelines, reviewing AI model outputs, optimizing AI model performance through prompt engineering, and establishing automated model performance improvement pipelines. Additionally, you'll generate, test, and evaluate high-quality data for AI model development and analyze model performance using user feedback and product usage reports. A key responsibility includes creating weekly business analysis reports and monitoring key metrics.
Must Have
- Propose and conduct quantitative research
- Build statistical models for trend identification
- Analyze data to identify common trends
- Propose enhancements for automation pipelines
- Review AI model output for performance improvement
- Optimize AI model performance via prompt engineering
- Generate and evaluate data for AI models
- Analyze model performance using feedback
- Suggest product usage improvements
- Create weekly business analysis reports
- Monitor and investigate key metrics
- Experience in Python (Pandas, Matplotlib, NumPy)
- Experience in SQL
Good to Have
- Experience with Prompt Engineering
- Familiarity with Classical ML Models
- Experience with Deep Learning
- Experience with Data Engineering
- Employ test findings for statistical analysis
- Knowledge of ML model evaluation metrics
Perks & Benefits
- Work with cutting-edge technologies
- High-impact role in shaping AI-driven enterprise applications
- Work with experienced professionals from top tech companies
- Fun learning environment
- Growth opportunities
- Market-leading compensation
Job Description
What you’ll get to do at Level AI (and more as we grow together)
- Drive product impact by proposing and conducting quantitative research into key user behaviors and trends
- Conduct in-depth analysis and build statistical models to identify trends and key drivers that inform important decisions made by the user.
- Data analysis to identify common trends
- Based on analysis, propose enhancements for automation pipelines.
- Review the output of AI models to improve performance by identifying common usage gaps
- Optimise AI model performance through effective prompt engineering techniques.
- Establish automated model performance improvement pipelines through prompt engineering.
- Responsible for generating, testing, evaluating, and curating high-quality, diverse, and representative data (including synthetic) for AI model development, training, and performance.
- Analyse model performance by diving into user feedback data and product usage reports.
- Suggest ways to improve product usage by specifically targeting each group of users and also feature.
- Create a business analysis report weekly.
- Define and monitor key metrics; investigate changes in metrics.
- Driven to continuously learn and adapt.
We'd love to explore more about you if you have
- Bachelor's degree or above with a good academic background.
- 1-2 years of full-time work experience as an AI Analyst.
- A highly resourceful individual who is looking to grow in the SaaS AI field.
- Experience in Python (Pandas, Matplotlib, NumPy) is a must.
- Experience in SQL is a must.
- Experience with Prompt Engineering is a plus.
- Familiarity with Classical ML Models (scikit-learn) and Deep Learning (Hugging Face, PyTorch) is a plus.
- Experience with Data Engineering is a plus.
- Employing test findings to do Statistical analysis and improve models.
- Knowledge of common metrics for evaluation of ML models is a plus.