Treating a response as attention, and other retail media measurement mistakes

Retail media measurement mistakes usually begin when a report renames an event or makes a stronger claim than its evidence supports. This non-ranked list names seven that turn up in England retailer reporting, starting with the commonest: a served response read as shopper attention. It reports no observed incident, prevalence study or finding against a supplier.

What to take away

How this list was scoped and maintained

Research took place on 6 September 2026. The reviewed universe was the directly opened IAB/MRC measurement guidelines, HM Treasury evaluation methods and CAP substantiation rules cited below. Entries were included where those records support a distinct interpretation boundary relevant to retailer-controlled advertising and its data operations.

General ecommerce analytics, undocumented platform faults and unsupported frequency claims were excluded. Order follows the path from delivery evidence to outward claims, not severity or likelihood. No paid ranking is offered; publisher affiliations and sponsorships remain unverified and require disclosure before publication.

Recheck the list when a cited source or adopted measurement definition changes, and at publication. Correct any affected entry with its evidence date and an explanation of the revision. The list is a bounded desk selection, not an exhaustive audit of the industry.

Maintain an evidence reference for each reported issue, including the report version and the wording being questioned. Assign correction ownership without claiming a defect has been confirmed. A later source update should trigger review of the affected interpretation, not automatic changes to historical observations.

Treating a served response as shopper attention

The IAB/MRC retail-media guidelines, dated January 2024, provide the international delivery-measurement reference. Keep ad requests, served or returned responses, rendered placements and viewable impressions distinct. Attention requires separate evidence.

The word response comes from the bid response that IAB Tech Lab's OpenRTB specification defines for programmatic trading: a server-side event, logged when a buyer's ad is returned. It says nothing about a shopper's screen, eyes or memory.

Inspect the event behind the field name. Record its unit, denominator, cohort and period. Add the time zone and the source. A count has no denominator, so the attribution window does not apply to delivery counts. Note exclusions, corrections and uncertainty instead of assuming unseen stages occurred.

Attention measurement firms such as Lumen Research and Amplified Intelligence sell panel eye tracking or modelled attention scores. Those are separate from a server-side delivery count, and neither is standard on a retailer's own dashboard.

Counting a viewable impression as attention

Viewability has a published threshold. Under the Media Rating Council standard, a display impression counts as viewable at 50% of pixels for one continuous second. Video requires 50% for two continuous seconds. The IAB/MRC guidelines treat the viewable impression as its own stage, distinct from attention.

The threshold measures pixels and time, not a shopper. Treating it as attention overstates the top of a retail media report, because an ad in a slot the shopper scrolled past can still qualify.

Comparing click-through rates built from different populations

The same IAB/MRC measurement specification is the source boundary for inspecting media definitions. The house check is to compare the numerator and eligible denominator before interpreting a rate.

A click in a retailer's onsite sponsored-product report, a click in Google Ads and a click in Meta Ads Manager are three different events. Each platform counts its own qualifying click against its own eligible impressions.

For a click-through comparison, preserve the qualifying-click and eligible-impression definitions. Keep the cohort, period, time zone, filtering and source version unchanged.

Record the attribution window as not applicable, plus correction treatment and remaining uncertainty. Undefined denominators or incompatible populations prevent a valid rate comparison; no numerical difference is inferred here.

Counting one sale in two networks

Two reports can each claim the same purchase. Meta Ads Manager defaults to 7-day click and 1-day view attribution. Google Ads made data-driven attribution its default in 2021 and retired its rules-based models in September 2023.

England retail media networks, including Tesco Media and Insight Platform, Nectar360, Boots Media Group and Ocado Ads, each report conversions on windows their own platform defines. A shopper who saw an off-site ad and then bought on site can appear in both totals.

Deduplicate before adding the two figures, or label the combined number as containing the same order twice.

Promoting attributed sales into causal results

HM Treasury's Magenta Book annex, updated in May 2026, describes impact-evaluation designs. Annex A covers randomised controlled trials, quasi-experimental designs such as difference-in-differences, and the counterfactual a causal claim needs. It supports examining the causal method rather than accepting credit allocation as proof of effect.

For attributed sales, record the transaction unit, cohort, window and reporting period. Add the time zone, exclusions, corrections, source and uncertainty; standalone counts have no denominator. Modelled estimates need their assumptions disclosed. Causal incrementality additionally requires its outcome, comparison design and analysis unit. None is demonstrated by a delivery total.

Platform lift tools, including Meta Conversion Lift and Google's conversion lift measurement, run randomised holdout groups. A delivery total is not one of them.

Using an unsupported result in marketing

CAP Code rule 3.7 concerns documentary substantiation for objective marketing claims. It is an advertising-code requirement, not a statement that every internal report is itself an advertisement. The Advertising Standards Authority publishes rulings where a claim was not substantiated.

Trace an outward performance claim to the underlying metric record and its full scope. Preserve the denominator, cohort, clock and attribution terms in the supporting evidence. Keep the exclusions, corrections, source and uncertainty attached as well. Do not strip away a material qualification when turning an analysis into promotional wording.

Counting device IDs or cookies as people

Cookies and device IDs do not map one to one with shoppers. Apple's Intelligent Tracking Prevention and Firefox's Enhanced Tracking Protection shorten cookie lifetimes, so one shopper can look like several unique users. The ICO requires consent for non-essential storage under UK rules.

Reach counted from a fragmented identifier set reads higher than the number of shoppers reached. Retail media networks in England, including Tesco Media and Insight Platform, Nectar360 and Boots Media Group, increasingly report audiences from loyalty schemes rather than cookies, which gives a closed-loop count for signed-in shoppers only.

Resolve findings without inventing a score

Apply the relevant checks to an actual report and document what was examined. Record missing evidence as unresolved rather than awarding a pass or estimating an error rate.

Refer privacy questions to the Information Commissioner's Office, advertising claims to the Advertising Standards Authority, and causal designs to an evaluation specialist. Genuine named authorship, conflicts confirmation and independent source checking remain outstanding publication gates for this article.

Before you act

Common questions

What is the difference between a served response and shopper attention?

The IAB/MRC guidelines distinguish ad requests, served responses, rendered placements and viewable impressions. Attention requires separate evidence. A served response is a delivery event, not proof that a shopper paid attention. Inspect the event behind the field name and record its unit, denominator, cohort and period. Add the time zone and source.

What counts as a viewable impression?

The Media Rating Council threshold is 50% of pixels for one continuous second for display, and 50% for two continuous seconds for video. It measures pixels and time, not a shopper. The IAB/MRC retail media guidelines keep the viewable impression and attention separate.

Why can two click-through rates not be compared directly?

Rates built from different populations may use incompatible qualifying-click and eligible-impression definitions. Preserve cohort, period, time zone, filtering and source version. Undefined denominators or incompatible populations prevent a valid rate comparison. The house check is to compare the numerator and eligible denominator before interpreting a rate.

Does a delivery total prove causal incrementality?

No. Attributed sales are credit allocation, not proof of effect. Causal incrementality requires its outcome, comparison design and analysis unit. Modelled estimates need their assumptions disclosed. The Magenta Book annex supports examining the causal method rather than accepting credit allocation as proof of effect.