Experimentation

Run tests across all growth engines using proper hypothesis formation, test design, and statistical significance. Build learning loops that compound improvements over time.

Experimentation

Introduction

Running experiments is one of the most effective ways to drive growth across your entire funnel. It applies to more than just your website. You can test and learn across email, ads, landing pages, pricing, and even sales messaging.

This playbook gives you a clear process to follow. You’ll learn how to build an experiment backlog, write solid hypotheses, run A/B tests properly, and analyse results with confidence. It’s not about guessing what works. It’s about learning through structured testing.

We’ll also cover how to document what you learn and share results with your team, so you keep improving without repeating work or losing momentum.

If you want your team to move faster and make better decisions, building an experimentation habit is a great place to start. This playbook shows you exactly how to do that.

Chapters

1

Find bottlenecks through research and data

Look at your dashboard to identify where conversion drops, then use customer research to understand why. Bottlenecks are where the most impact lives.

2

Write hypotheses and design proper experiments

Don't just "try something". Write a hypothesis predicting what will happen and why. Design the experiment with proper controls so you actually learn whether your hypothesis was right.

3

Run experiments and analyse results properly

Follow your test plan without peeking early or changing mid-test. Monitor for implementation issues. Segment results to understand which audiences responded. Extract qualitative insights, not just numbers.

4

Document learnings and update operations

Don't just declare winners and move on. Extract the pattern, document why it worked, update playbooks and templates, and build an experimentation culture where testing is continuous.

Experimentation

tools

VWO

Rating

Rating

Rating

Rating

Rating

From

393

per month

VWO

VWO provides A/B testing, personalisation, and behaviour analytics to optimise website conversion rates through data-driven experimentation.

Hotjar

Rating

Rating

Rating

Rating

Rating

From

39

per month

Hotjar

Hotjar captures user behaviour through heatmaps, session recordings, and feedback polls to understand how visitors use your website.

Microsoft Clarity

Rating

Rating

Rating

Rating

Rating

From

0

per month

Microsoft Clarity

Microsoft Clarity provides free session recordings, heatmaps, and user behaviour analytics without traffic limits or time restrictions.

Notion

Rating

Rating

Rating

Rating

Rating

From

12

per month

Notion

Flexible workspace for docs, wikis, and lightweight databases ideal when you need custom systems without heavy project management overhead.

Books

Lean Startup

Eric Ries

Rating

Rating

Rating

Rating

Rating

Lean Startup

A disciplined approach to experiments. Define hypotheses, design MVPs and learn before you scale.

Hacking growth

Sean Ellis

Rating

Rating

Rating

Rating

Rating

Hacking growth

A practical framework for experiments and insights. Build loops, run tests and adopt a cadence that ships learning every week.

Wiki

Sample size

Calculate how many users you need in experiments to detect meaningful differences and avoid declaring winners prematurely based on insufficient data.

P-value

Interpret experiment results to understand the probability that observed differences occurred by chance rather than because your changes actually work.

Minimum viable test

Design experiments that answer specific questions with minimum time and resources to maximise learning velocity without over-investing in unproven ideas.

Hypothesis testing

Structure experiments around clear predictions to focus efforts on learning rather than random changes and make results easier to interpret afterward.

Control group

Maintain an unchanged version in experiments to isolate the impact of your changes and prove causation rather than correlation with external factors.

Statistical significance

Determine whether experiment results reflect real differences or random chance to avoid making expensive decisions based on noise instead of signal.

A/B testing

Compare two versions of a page, email, or feature to determine which performs better using statistical methods that isolate the impact of specific changes.

Growth hacking

Deploy fast, low-cost experiments to discover scalable acquisition and retention tactics, learning through iteration rather than big bets.

Related topic

Growth orchestration

Get a grip on what's actually working and what needs course correction. Use data and experiments to make decisions instead of opinions. See how changes in one part of the system affect everything else. Random tactics don't compound, coordinated ones do.

Experimentation

Other playbooks

Hubspot for managers

Hubspot for managers

This playbook is for sales and marketing managers who need to monitor team performance, set goals, track progress, and forecast revenue. Learn how to use HubSpot's reporting and dashboard capabilities to understand what your team is doing, whether they're hitting targets, and where coaching is needed. By the end of this playbook, you'll have executive-level visibility into your team's performance without micromanaging individual activities.

Hubspot configuration

Hubspot configuration

This playbook is for HubSpot administrators and account owners who are setting up a new HubSpot account or migrating from another platform.

LinkedIn advertising

LinkedIn advertising

Calculate lifetime value

Calculate lifetime value

Automation

Automation

Identify repetitive tasks draining time and build workflows that run without you. Use HubSpot and Zapier to automate lead routing, follow-ups, notifications, and data entry.

Weekly scorecard

Weekly scorecard

Set up and run the weekly 12-metric review across all four growth engines. Structure the meeting, assign ownership, use traffic lights, and escalate issues that need attention.

Keep reading