How to decide what to test

Build an experiment backlog. Score by impact and effort. Align tests with your biggest bottleneck to avoid random testing.

Introduction

Most teams run experiments based on whoever shouts loudest. The result? Random tests that don't address real bottlenecks. A proper backlog captures every idea, scores it objectively, and ensures you're always testing what matters most. This chapter shows you how to build a backlog, prioritise experiments systematically, and align testing with your growth strategy so every experiment moves you closer to your goal.

Capture all experiment ideas in a backlog

Score experiments on impact versus effort

Align tests with your biggest bottleneck

Build a quarterly experiment roadmap

Conclusion

Related tools

VWO

Rating

Rating

Rating

Rating

Rating

From

393

per month

VWO

VWO provides A/B testing, personalisation, and behaviour analytics to optimise website conversion rates through data-driven experimentation.

Hotjar

Rating

Rating

Rating

Rating

Rating

From

39

per month

Hotjar

Hotjar captures user behaviour through heatmaps, session recordings, and feedback polls to understand how visitors use your website.

Microsoft Clarity

Rating

Rating

Rating

Rating

Rating

From

0

per month

Microsoft Clarity

Microsoft Clarity provides free session recordings, heatmaps, and user behaviour analytics without traffic limits or time restrictions.

Notion

Rating

Rating

Rating

Rating

Rating

From

12

per month

Notion

Flexible workspace for docs, wikis, and lightweight databases ideal when you need custom systems without heavy project management overhead.

Related wiki articles

A/B testing

Compare two versions of a page, email, or feature to determine which performs better using statistical methods that isolate the impact of specific changes.

Hypothesis testing

Structure experiments around clear predictions to focus efforts on learning rather than random changes and make results easier to interpret afterward.

Minimum viable test

Design experiments that answer specific questions with minimum time and resources to maximise learning velocity without over-investing in unproven ideas.

Prioritisation

Systematically rank projects and opportunities using objective frameworks, ensuring scarce resources flow to highest-impact work.

Conversion rate

Calculate the percentage of visitors who complete desired actions to identify friction points and measure the effectiveness of marketing and product changes.

Further reading

Experimentation

Experimentation

Build an experiment backlog. Score by impact and effort. Align tests with your biggest bottleneck to avoid random testing.