Job Description
- Own and optimize experimentation tools (e.g., Optimizely).
- Develop best practices and governance for statistical rigor.
- Establish guardrails to prevent test collisions.
- Ensure test documentation is captured and archived.
- Support cross-functional knowledge system development.
- Develop and maintain a strategic experimentation roadmap.
- Partner with Analytics and UX Research teams.
- Prioritize initiatives based on user needs and business impact.
- Collaborate to define hypotheses, test structure, and metrics.
- Guide test design (traffic, sample sizing, segmentation).
- Manage end-to-end test execution and post-test analysis.
- Design tests for short-term and longitudinal impacts.
- Perform pre-test analysis using GA or similar.
- Execute robust post-test analysis for clear insights.
- Proactively develop experiments during low-request periods.
- 5+ years in product experimentation, CRO, or analytics.
- Hands-on experience with A/B and multivariate tests.
- Expertise with testing platforms (Optimizely, AB Tasty, VWO).
- Proficiency in analytics tools (GA, Amplitude, Adobe Analytics).
- Strong statistical acumen and test validity.
- Experience working cross-functionally with product, engineering.
- Clear communication of test results and recommendations.
- Experience in Data Visualization (Looker Studio, Power BI).
- Experience using Business and Operational Intelligence tools.
- Fast-paced, exciting work environment
- Diverse, international team (over 75 nationalities)
- Opportunities to grow
The Wow
Betsson Group is looking for a Product Experimentation Lead to operationalize, scale, and champion our experimentation program across our global portfolio of digital products. This role is central to ensuring that every customer-facing decision is backed by evidence, rigor, and user insight.
Sitting at the intersection of product, analytics, UX, and engineering, you will drive evidence-based decision-making through robust A/B testing and live validation frameworks. You’ll execute and interpret high-quality experiments to evangelize a test-and-learn culture and scale the infrastructure that supports it. This includes instilling best practices, improving tools, and ensuring we learn the right things—not just run the right tests.
A taster of what you will be involved with:
Experimentation Platform & Governance:
- Own and optimize the use of experimentation tools (e.g., Optimizely), ensuring robust configuration, scalability, and cost efficiency
- Develop best practices, playbooks, and governance models to ensure statistical rigor and test hygiene across all markets and brands
- Establish guardrails to prevent test collisions and misleading results
- Ensure test documentation is consistently captured, tagged, and archived for future reference. Help build and maintain a repository that connects experiments to broader user insights, product decisions, and research learnings
- Support the development of a cross-functional knowledge system to prevent redundant testing, track learnings over time, and accelerate future decision-making
Strategy & Roadmap:
- Develop and maintain a strategic experimentation roadmap aligned with product priorities and market goals
- Partner closely with Analytics and UX Research (UXR) teams to track research insights and ensure continuity from discovery to validation
- Prioritize initiatives based on user needs, business impact, and technical feasibility
- Account for seasonality, test interdependence, and long-term effects on user behavior in planning
Test Design & Execution:
- Collaborate with PMs, researchers, and analysts to define hypotheses, test structure, and success metrics
- Guide test design including traffic allocation, sample sizing, segmentation, and statistical methods
- Manage test execution end-to-end and ensure robust post-test analysis
- Ensure tests are designed to capture both short-term effects and longitudinal impacts (e.g., retention, engagement)
- Pre-test analysis using GA or similar tools, to identify experiment parameters
- Manage or preferably execute robust post-test analysis ensuring all relevant data sources are used to ‘paint the full picture’ and insights/recommendations are clear
- Proactively develops the applicable experiments to run during low-request periods. Identify opportunities for improvements
What we are looking for:
- 5+ years of relevant experience in product experimentation, CRO, product analytics, or related role
- Hands-on experience running and scaling A/B and multivariate tests across high-traffic digital products
- Expertise with testing platforms (e.g., Optimizely, AB Tasty, VWO) and analytics tools (GA, Amplitude, Adobe Analytics, ContentSquare)
- Strong statistical acumen: understanding of test design, power analysis, segmentation, and validity
- Experience working cross-functionally with product, analytics, research, design, and engineering teams
- Clear communicator able to translate test results into actionable insights and strategic recommendations
- Experience in Data Visualization (through Google Looker Studio, Power BI, Tableau or similar)
- Experience using Business Intelligence and Operational Intelligence tools
What we offer
Much like a rollercoaster, life at Betsson Group is fast-paced, full of twists and turns, and always exciting. With more than 2,800 colleagues representing over 75 nationalities across a global network of offices - including 1,500 at our operational headquarters in Malta - every day brings new challenges and opportunities to grow. It may not be for the faint-hearted, but if you thrive on innovation, enjoy pushing boundaries and want to be part of a diverse, international team, then you’ll fit right in at Betsson.
Challenge accepted?
By submitting your application, you understand that your personal data will be processed as set out in our Privacy Policy_
