Article

Build your first A/B test

Get your first structured test live—from copy or design to data setup and measurement.

Introduction

Launching your first A/B test feels risky the moment real traffic splits between an old page that pays the bills and a new variant you hope will win. I remember sweating over a headline change on a high-value pricing page; the five-day wait for results felt like a year, yet the uplift paid the month’s salary in one afternoon.

This chapter walks you through that journey. You will brief developers, build variations, wire the test in your chosen tool and run a final launch checklist. Follow each step and your first experiment will ship with confidence rather than crossed fingers.

Part 1

Coding briefing

Begin with a coding briefing that leaves no room for guesswork. Share a link to the hypothesis card, the control page URL and a annotated mock-up that highlights every element to change. Include mobile and desktop views, colour values and font sizes.

Add functional notes: which button fires the conversion event, which field must remain untouched for tracking and which scripts load after interaction. Reference the dataLayer push or GA4 event names so developers can test locally.

Finally, agree a branch name in version control and a staging link. A clear brief prevents mid-sprint slack pings that derail both teams.

With the brief locked, you can move to crafting the actual variant, covered next.

Part 2

Build variations

Build the variation in a staging environment first. Clone the production page, apply copy or design tweaks and keep file paths identical so assets cache correctly. If the test swaps a headline, do not sneak in button colour changes; one variable keeps results clean.

Run basic checks. Load time must stay within ten per cent of control. Alt text and aria labels must remain accurate for accessibility. Verify that form validations still fire and that thank-you pages render.

Capture before-after screenshots and attach them to the backlog card. These visuals speed approvals and later help the analyst pinpoint unexpected behavioural shifts.

With a stable variant ready, the next task is wiring the split in an A/B testing platform.

Part 3

Set up in A/B testing tool

Open your testing tool—Optimizely, VWO or Google Optimize 360—and create a new experiment. Paste the control URL, then target fifty-fifty traffic for your first run. If traffic is low, consider a higher share for the variant, yet never drop control below thirty per cent.

Define the primary metric as the booked-meeting thank-you URL load or the GA4 event book_demo. Add a guardrail metric such as bounce rate to catch catastrophic failures early. Set the experiment to run until it reaches ninety-five per cent confidence or fourteen days, whichever comes later.

Apply exclusion settings: filter internal IP addresses, exclude bots and remove current customers if your audience includes both prospects and users. Tag the experiment with the naming convention from earlier chapters so reports align.

Configuration done, you are ready for the final launch checklist.

Part 4

Launch checklist

Work through a pre-launch checklist. Clear browser cache and load both variants in incognito. Trigger the primary conversion and check that events fire in real-time analytics. Confirm that heatmap and session-recording tools respect the split by querying variant data.

Test across devices: desktop, tablet and a mid-range smartphone on 4G. Validate legal banners like cookie consent and privacy notices. Ensure that customer support chat still loads and that tracking pixels for remarketing fire on both versions.

Notify sales and support teams of potential messaging changes so incoming calls do not catch them off guard. Schedule the launch at a low-traffic hour to minimise disruption if a rollback is required.

Checklist complete, press go and monitor the first one hundred sessions before stepping away. The experiment is now live and learning.

Conclusion

Conclusion

Your first A/B test now runs on solid ground: a precise brief, a single-variable variant, airtight tool setup and a rigorous checklist. This discipline limits risk and maximises learning speed.

Review interim data only after the minimum sample size to avoid premature bias. When the test finishes, record outcomes in the backlog and decide on rollout or further iteration. Each structured experiment compounds gains and confidence for the next sprint.

Next chapter

Work with your own tools or use these

Use what you already have. But if you're starting from scratch or want recommendations, these are the tools I use with clients and personally rely on. Consider this a bonus: helpful if you need it, completely optional if you don't.

Read all my articles
Chapter
4

Learn from your experiments

Use results to fuel your next round of tests, refine your backlog, and share learnings across teams.

Playbook

Experimentation

Test and learn faster. Set up an experimentation system that helps you prioritise, track and repeat what works. Keep a backlog and a clear way to decide what to try next.

See playbook
Experimentation
Tools

Work with your own tools or use these

Use what you already have. But if you're starting from scratch or want recommendations, these are the tools I use with clients and personally rely on. Consider this a bonus: helpful if you need it, completely optional if you don't.

See all tools
Surfe
Tool

Surfe

Turns LinkedIn into your CRM interface, find and enrich contacts, then push leads and messages to HubSpot, Salesforce or Pipedrive without copy pasting.

Playbooks

Step-by-step guides for B2B marketers

Tactical playbooks for every stage of this engine. The playbooks are practical guides for tactical stuff. They complement the (paid) growth framework and help you with the tactics.

See all playbooks
Playbook

Outreach automation

Pick a prospecting method and tidy data. Warm domains, protect deliverability, build short email and LinkedIn sequences, and route positive replies to the right owner with tasks in the CRM.

See playbook
Outreach automation
Playbook

LinkedIn thought leadership

Post consistently on LinkedIn with a routine that grows authority, attracts buyers and turns visibility into pipeline. Turn posts into warm leads without spam or gimmicks.

See playbook
LinkedIn thought leadership
Playbooks

Book summaries for marketers

The books that shaped how I think about growth. Read summaries here, then buy what resonates. Learn from the best thinkers in B2B.

See all book summaries
Founder brand
Book summary & review

Founder brand

Dave Gerhardt

A guide to purposeful visibility. Choose topics, set a cadence and turn posts, talks and interviews into warm conversations.

The Ultimate Blueprint
Book summary & review

The Ultimate Blueprint

Keith J. Cunningham

A practical summary of how businesses really grow. Clear levers, simple maths and actions you can take this quarter.

Growth wiki

Growth concepts explained in simple language

Key concepts and frameworks explained clearly. Quick reference when you need to understand a term, refresh your knowledge, or share with your team.

See entire growth wiki
Wiki

AIDA

AIDA maps buyer journey: attention, interest, desire, action, letting marketers craft messages that guide prospects from first glance to paid conversion.

Wiki

BANT

Qualify leads fast with budget-authority-need-timing.

Course

Why most B2B marketers don't get the results they want

Most B2B marketers are either Random Ricks (trying everything) or Specialist Steves (obsessed with one channel). Generalists run tactics without strategy. Specialists hit channel ceilings. But there's a better way.

See entire course
Random Rick
Always-busy marketer

Tries everything at once. Posts on LinkedIn, runs ads, tweaks the website, chases referrals. Nothing compounds because nothing's consistent. Growth feels chaotic.

Specialist Steve
Single channel specialist

Obsessed with one tactic. 'We just need better ads' or 'SEO will fix everything.' Ignores the rest of the system. One strong engine can't carry a broken machine.

Solid Sarah
Full-funnel marketer

Finds the bottleneck. Fixes that first. Then moves to the next weakest link. Builds a system that's predictable, measurable and doesn't need 80-hour weeks.

Start for free

Sarah grows faster than Rick and Steve. Want to know how Solid Sarah does it?

Learn how she diagnoses bottlenecks, orchestrates the four engines, and drives predictable growth. Choose if you want to read or watch:

See full course
7-day mini-course in your inbox

Learn the system by email

Get practical frameworks delivered daily. Seven short emails explain how Sarah diagnoses bottlenecks, orchestrates the four engines, and builds systems that compound.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Watch module 1 for free

See the course in action

Free 45-minute video module from the full course. Watch how to diagnose your growth bottleneck and see exactly what the course platform looks like.

Article

Build your first A/B test

Get your first structured test live—from copy or design to data setup and measurement.

Experimentation