Learner guide · Experiment 032

Split Decision

The numbers say one thing. The money says another. Three quick rounds of paid search decisions for a crazy golf venue, against three rival teams.

About 5 minutes solo3 roundsOptional timerCheat sheet on screen
In 30 seconds

What it is, and why

You run paid search for a fictional crazy golf venue. Round one is an A/B test where one ad gets the clicks and the other gets the bookings. Round two is a leak: great clicks, hardly any bookings. Round three is a brand campaign reporting 12× ROAS, until you switch it off. Each reveal shows the maths. Solo, you play against three rival teams with fixed habits: Click Chasers love a big CTR, Gut Feelers go with the vibe, and Data Detectives check before acting.

Inclusive by design

Made for learning on your own

Everything here works on your own, at your own pace. These are the parts built so more people can learn from it:

⏳ The timer is optional

Each round has a 60-second timer, but it only runs if you press Start, and you can pause it.

HelpsSlower readers, people working in a second language, and anyone who needs time with numbers.

🧮 Formulas on screen

The cheat sheet shows all four formulas the whole time, so you don’t have to memorise them first.

HelpsLearners with maths anxiety or dyscalculia, and anyone new to marketing metrics.

🤖 Fair, repeatable rivals

The rival teams always make the same choices, so you can replay and see exactly what changed in your own thinking.

HelpsLearners revising for an exam, and anyone who learns by trying again.

💡 Learn from every answer

After each choice you see the maths behind every option, not just a right or wrong mark. The learning is in the reasons.

HelpsLearners who missed the class, revise on their own, or want to check their thinking without asking in front of others.

🌙 Calm on request

If your device is set to reduce motion, the confetti and animations calm right down. Background music is off unless you switch it on.

HelpsPeople who find movement or sound distracting or uncomfortable, including some autistic and ADHD learners, and people with vestibular conditions.

🔒 No account, no audience

No sign-up and no class watching. Your answers are not sent anywhere, and badges stay on your device.

HelpsAnyone who would rather make mistakes in private first, including anxious learners and people new to the topic.

How to play

Four steps

  1. Choose Solo

    You against Click Chasers, Gut Feelers and Data Detectives.

  2. Read the client

    An average booking is worth £30 and most people book on a phone. Keep that in mind.

  3. Make three calls

    Which ad wins, where is the leak, and is the campaign really working? Best answer 10, good 7, partly right 3.

  4. Read the money

    Each reveal shows CTR, conversion rate, CPA and ROAS. Beat all three rivals for the second badge.

Pro moves

Six habits for reading the numbers

👆 Clicks aren’t customers

A high CTR can still lose money if those clicks don’t book.

💷 Judge on cost per booking

CPA tells you what each customer costs. Compare it with what a customer is worth.

📱 Follow the click

If clicks are good but bookings are poor, look at the landing page, especially on mobile.

🧪 Ask “would it happen anyway?”

Brand ads often claim sales people would have made anyway. That is incrementality.

📊 Trust tests over feelings

An A/B test with enough data beats a gut feeling about which ad looks better.

🔢 Do the sum yourself

Work out one metric by hand before the reveal. It sticks far better.

Screenshot me

Your pocket card

CTRClicks ÷ impressions.
Conversion rateBookings ÷ clicks.
CPASpend ÷ bookings.
ROASRevenue ÷ spend.
Leak?Good clicks, few bookings: check the page.
Ask“Would this have happened without the ad?”
Slip-ups and quick fixes

If this happens, try this

What happensWhat to try
You picked the ad with more clicksLook at bookings and CPA. Clicks cost money; bookings make it.
The formulas blur togetherKeep the cheat sheet in view and say each one out loud as you use it.
Round three surprised youRead about incrementality in the reveal. Reported ROAS isn’t always caused by the ad.
You tied with a rivalTies go to round 3. Replay and focus on the incrementality question.
You want more practiceTry the longer search games below, then come back and beat all three rivals.
Try this tonight: the CPA check

Take any ad you clicked recently. Guess its CTR and conversion rate, then work out a rough CPA if the click cost £1. Would it pay for itself? Then replay and try to beat the Data Detectives.

Want more? Keep going with search marketing: bid in Bid & Rank, find leaks in Leaky Funnel, and run a live auction in Ad Auction Live. Running this with a group? The teacher’s guide has model answers and the button order.