Teacher's guide · Experiment 010

Site Inspector

Teams audit a small outdoor shop's mobile website: home page, product page and checkout. Each page has ten numbered pins; some mark real problems, some are fine. Teams flag five per page and pick one to fix first, then see the page through a slow phone, colour-blind eyes and a screen reader. This guide gives the full answer key, the scoring, every design assumption and a step-by-step plan.

About 15 minutes4 teams or solo3 pages + a final reportOne screen + paper
The idea

What students learn

1. Evaluate through four lenses

Usability, accessibility, speed, and trust and law. Most students only use the first; the game rewards the others and makes them visible.

2. Not everything unfamiliar is a problem

Four pins on every page are fine: white space, a menu icon, honest bad reviews, a secure-checkout strip. A false flag costs a point, so teams learn to separate preference from evidence.

3. Prioritise by impact

Each page has one critical problem. Choosing it as the fix-first earns a bonus, which opens a discussion about severity, reach, legal risk and effort.

4. Standards, not opinions

Every verdict names the standard behind it: Nielsen's heuristics, WCAG 2.2, Core Web Vitals, Stanford's credibility guidelines, UK consumer law and ICO cookie guidance. The final screen produces a model audit report students can reuse.

Built for digital marketing, e-commerce and UX classes, and a good partner to Rank Rescue (SEO). The shop, pages and figures are fictional; the problems were planted for teaching.

Read first

Five golden rules

  1. Reloading is safe.The game remembers where you are in this browser tab. Closing the tab clears it.
  2. There is no back button.Once you press Reveal, that page's flags are locked in. Read each team's numbers back first.
  3. Five flags maximum.Number buttons fade out once a team has five. The fix-first pin must be one of the team's flags; the star turns pink.
  4. Timers never start themselves.Press Start. The 2:30 clock is a guide; add 30 seconds if the room is still arguing productively.
  5. Try the 5-second test.Before teams start, press ⏱ 5-second test: the page shows for five seconds, then blurs. Ask "What does this shop sell? What would you tap first?"
How it is built

The scoring model

Each page: 10 pins = 1 critical + 4 major + 1 minor + 4 fine
Flag a critical problem +3 · major +2 · minor +1 · a fine pin −1
Fix-first bonus: +2 if your fix-first pin is the page's critical problem
Up to 5 flags per page · best possible score 13 a page, 39 in total
Ties go to the team that chose more critical problems to fix first

The best five flags are always the critical, the four majors, and no false flags. The minor problem is worth flagging only if a team is unsure about a major one. After each reveal the pins on the phone turn pink (critical), yellow (major), blue (minor) or green (fine), with coloured dots showing which teams flagged them.

Answer key

Every pin, every page

Page 1: Home page (lenses: slow phone, contrast check)

PinWhat it isVerdictLensStandard
1Hamburger menu iconFine (−1)DesignNielsen 4: consistency and standards
2Vague navigation: Explore, Discover, Inspire, StoriesMajor (+2)UsabilityNielsen 2: match the real world
3Auto-rotating carousel, no pauseMajor (+2)AccessibilityWCAG 2.2.2 Pause, Stop, Hide (A)
4Sign-up pop-up after 1 s, tiny ×Critical (+3)UsabilityGoogle: avoid intrusive interstitials; Stanford credibility 9
5Hero image 4.8 MB, LCP 6.1 s (evidence pack)Major (+2)SpeedCore Web Vitals: LCP good ≤ 2.5 s, poor > 4 s
6Pale grey tagline (about 2:1)Major (+2)AccessibilityWCAG 1.4.3 Contrast (Minimum), AA: 4.5:1
7"Shop rain jackets" buttonFine (−1)UsabilityNielsen 2
8White space between sectionsFine (−1)DesignNielsen 8: aesthetic and minimalist design
9Trust strip: returns, stores, reviewsFine (−1)TrustStanford credibility 2 and 5
10Footer: © 2019, "Winter sale 2022"Minor (+1)TrustStanford credibility 8: keep content current

Page 2: Product page (lenses: colour-blind view, screen reader, slow phone)

PinWhat it isVerdictLensStandard
1Seven share buttons above the productMinor (+1)DesignNielsen 8
2One small photo, alt text "IMG_2231"Major (+2)AccessibilityWCAG 1.1.1 Non-text Content (A)
3Clear priceFine (−1)UsabilityClear, upfront pricing
44.6 stars including bad reviewsFine (−1)TrustSpiegel Research Center (2017)
5Colour-only swatches and stockMajor (+2)AccessibilityWCAG 1.4.1 Use of Color (A)
6No size guideMajor (+2)UsabilityNielsen 10: help and documentation
7Late "Pay in 3" banner pushes the page (CLS 0.31)Major (+2)SpeedCore Web Vitals: CLS good ≤ 0.1, poor > 0.25
8Tiny, unlabelled "Add to bag" iconCritical (+3)AccessibilityWCAG 4.1.2 Name, Role, Value (A); target size 2.5.8 / 2.5.5
9Delivery cost and free returns by the buttonFine (−1)TrustTrust at the point of decision
10Description with headings and bulletsFine (−1)UsabilityNielsen 8

Page 3: Checkout (alert from marketing; lenses: price tracker, consent clicks, screen reader)

PinWhat it isVerdictLensStandard
1"Create an account to continue"Major (+2)UsabilityBaymard: 19% abandon over forced accounts
2Order summary with photoFine (−1)TrustNielsen 6: recognition rather than recall
3"Error" with no explanationMajor (+2)AccessibilityWCAG 3.3.1 Error Identification (A); Nielsen 9
4Typing the address twiceMinor (+1)AccessibilityWCAG 3.3.7 Redundant Entry (A)
5Delivery dates, not just "3–5 days"Fine (−1)UsabilityNielsen 1: visibility of system status
6Pre-ticked "Jacket Care Plan £7.99"Major (+2)Trust & lawConsumer Contracts Regulations 2013, reg. 40
7Surprise £2.50 mandatory service feeCritical (+3)Trust & lawDMCC Act 2024 drip pricing; CMA guidance; Baymard 39%
8Secure checkout and payment logosFine (−1)TrustTrust at the point of payment
9"Place order · £104.44" buttonFine (−1)UsabilityNielsen 1
10Cookie banner with no "Reject all"Major (+2)Trust & lawICO: reject must be as easy as accept

Typical scores on page 1

Team styleFlags · fix firstScore
Perfect audit2 3 4 5 6 · ★413
Accessibility lens3 4 6 10 · ★410
Eyes only (no speed or accessibility)2 4 7 9 10 · ★46
Design critic1 2 4 8 10 · ★14
Be transparent

Design assumptions and simplifications

The same list appears in the game under "How this game simplifies reality".

  1. A planted, fictional site.Each page has exactly six problems and four red herrings. Real audits combine user testing, analytics and automated tools, and find problems nobody planted.
  2. Severity is a judgement.Critical, major and minor reflect the designer's view of impact on the task, how many people are affected and legal risk, in the spirit of common usability severity scales. Practitioners often disagree on exact ratings; that disagreement is a good discussion.
  3. Points are a teaching device.Real prioritisation also weighs the cost and effort of each fix.
  4. Speed figures are illustrative.They are presented as real-user (field) data at the 75th percentile, the way Google assesses Core Web Vitals. The thresholds are real; the shop's numbers are invented.
  5. The lenses are approximations.The colour-blind view simulates one common type (deuteranopia). The screen reader transcript is simplified; real screen readers such as VoiceOver and NVDA announce pages in their own ways.
  6. One page per round.Real evaluations follow whole journeys across devices and browsers.
  7. UK rules, simplified.Legal points describe UK rules in 2026 in plain language. They are not legal advice.
In class

Step by step

About 15 minutes with one debrief question; allow 20 with all the lenses and the full debrief.

  1. 0

    Set the scene and form teams

    1.5 min
    The brief: the Tayside Trails home page on a phone, the three rounds, the scoring scale and the four evaluation lenses.
    The brief: a phone mock of the shop, the four lenses and the points scale.
    Say
    "You're four digital agencies pitching for an audit contract. The client says their site 'isn't converting'. Ten pins a page. Some are real problems, some are fine. You get five flags, and you must tell the client what to fix first."
    Students
    Four teams with paper and a pen. Encourage them to use their own phones to imagine the page in their hands.
  2. 1

    Page 1: Home page

    4 min · timer 2:30
    Round 1: the phone mock with ten numbered pins, the evidence pack with speed data, and four team panels with number buttons and a fix-first row.
    Teams write five numbers and circle their fix-first. Tap the numbers, then the fix-first.
    The 5-second test: the phone is blurred and asks what the shop sells and what you would tap first.
    Optional warm-up: the 5-second test.
    Click
    1. Optional: ⏱ 5-second test, ask the questions, then Show the page again.
    2. Start the timer. At 0:00 tap each team's five numbers, then its fix-first.
    3. Press Reveal the audit.
    Watch for
    • Pin 5 sits on the evidence pack, not the phone. Teams who read the data spot the speed problem.
    • White space (8) and the menu icon (1) attract false flags. That's the point.
    Round 1 reveal: coloured pins on the phone, lens buttons, team scores with points per flag, and verdict cards ordered by severity.
    The reveal: pins change colour; press 📶 Slow phone to replay the 6.1-second load and the pop-up.
  3. 2

    Page 2: Product page

    4 min · timer 2:30
    The colour-blind view of the product page: swatches and size availability can no longer be told apart.
    The colour-blind view makes pin 5 obvious.
    The screen reader lens: a transcript ending in 'Button' for the unlabelled Add to bag icon.
    The screen reader lens: "Image, IMG underscore 2231… Button."
    Say
    "Think about people who don't browse the way you do."
    Watch for
    Read the screen reader transcript aloud in a flat voice. It lands better than any slide on accessibility.
  4. 3

    Page 3: Checkout, with an email from marketing

    4 min · timer 2:30
    Round 3 with a pink alert: marketing wants the cookie banner to raise consent to 95% and has added a small service fee.
    The alert sets up the two legal traps on this page.
    Say
    "The developer did exactly what marketing asked. Is that a defence?"
    Watch for
    After the reveal, use 🧾 Price tracker (£89 becomes £104.44) and 🍪 Consent clicks (1 tap to accept, at least 4 to reject).
  5. 4

    The final report and debrief

    2 to 5 min
    Final screen: the podium of audit points, the most-missed problem and the start of the model audit report.
    The winner, the problem most teams missed, and the model audit report.
    The model audit report: all 18 problems ranked by severity with page, lens, fix and standard, plus copy and print buttons.
    Copy the report or print it as a template for coursework audits.
On their own

Solo mode

Solo mode: the player taps pins on the phone to flag them and marks one as fix first; rival agencies audit in secret.
In solo mode students tap the pins on the phone directly, then star one to fix first.

Share lab.yingwu.co.uk/site-inspector/#solo for homework or revision. The player audits against three rival agencies with blind spots: Pixel Pushers judge by looks and flag design choices, Compliance Bots hunt accessibility and legal problems but miss usability, and the Senior UX Lead is balanced but not perfect. Their flags have some randomness. Winning in solo mode earns the "Lead auditor" badge; finishing any game earns "Site inspector".

Model answers

Debrief questions

  1. What did teams miss? Usually accessibility (colour-only information, alt text, unlabelled buttons) and speed (the evidence pack). We evaluate with our own eyes, devices and fast Wi-Fi, so we miss what we don't experience. Structured lenses and tools fix that.
  2. Preference or problem? A problem stops or slows people doing their task, excludes some people, or breaks a rule; a preference is a matter of taste. Evidence settles it: user testing, analytics, standards. White space, a menu icon and long-but-scannable descriptions are trade-offs, not errors.
  3. What goes first? Severity (does it block the task?), reach (how many people?), legal risk, and effort. The surprise fee is critical because it is unlawful and the top reason people abandon checkouts; the tiny "Add to bag" is critical because without it nothing else matters.
  4. Automated or human? Tools such as Lighthouse can flag low contrast, missing alt text, buttons without names, small targets and measure LCP and CLS. They can't judge whether alt text is useful, whether labels make sense, whether a fee is fair, whether a cookie banner is balanced, or whether a size guide is missing. You need both.
  5. Conversion vs compliance? Consent obtained through an unbalanced design is a legal risk, and the ICO has told major websites to make rejecting as easy as accepting. A lower, genuine consent rate is the real number to plan with; the trust you keep is worth more than the data you lose.
Keep on your phone

Cheat card: the button order

  1. Start round 1, Full screen, optional 5-second test, Start (2:30)
  2. Tap each team's five numbers, then its fix-first, Reveal the audit
  3. Try a lens, read the lesson; Next
  4. Page 2: Start, numbers, fix-first, Reveal; colour-blind and screen reader lenses
  5. Page 3: read the email alert; Start, numbers, fix-first, Reveal; price tracker
  6. See the final report; copy or print it; ask one debrief question
Sources

Behind the verdicts

  • Baymard Institute (2026) How to reduce cart abandonment. baymard.com
  • Competition and Markets Authority (2025, updated 2026) Price transparency (CMA209). gov.uk
  • Fogg, B.J. (2002) Stanford guidelines for web credibility. Stanford Persuasive Technology Lab. credibility.stanford.edu
  • Google Search Central (n.d.) Avoid intrusive interstitials and dialogs. developers.google.com
  • MeasuringU (n.d.) Rating the severity of usability problems. measuringu.com
  • Nielsen Norman Group (n.d.) 10 usability heuristics for user interface design. nngroup.com
  • Spiegel Research Center (2017) How online reviews influence sales. Northwestern University. spiegel.medill.northwestern.edu
  • The Consumer Contracts (Information, Cancellation and Additional Charges) Regulations 2013, regulation 40. legislation.gov.uk
  • The Record (2023) UK data regulator tells websites to offer "Reject all" cookies option, 21 November. therecord.media
  • W3C (2023) Web Content Accessibility Guidelines (WCAG) 2.2. w3.org
  • web.dev (n.d.) How the Core Web Vitals metrics thresholds were defined. web.dev

A simplified classroom model: the severities and points are teaching devices. Tayside Trails is fictional, and its problems were planted.