Treating a response as attention, and other retail media measurement mistakes

Retail media measurement mistakes can arise when a report changes the meaning of an event or makes a stronger claim than its evidence supports. This non-ranked list helps England retailers inspect those interpretation problems. It reports no observed incident, prevalence study or finding against a supplier.

Selection, scope and maintenance

Research took place on 6 September 2026. The reviewed universe was the directly opened IAB/MRC measurement guidelines, HM Treasury evaluation methods and CAP substantiation rules cited below. Entries were included where those records support a distinct interpretation boundary relevant to retailer-controlled advertising and its data operations.

General ecommerce analytics, undocumented platform faults and unsupported frequency claims were excluded. Order follows the path from delivery evidence to outward claims, not severity or likelihood. No paid ranking is offered; publisher affiliations and sponsorships remain unverified and require disclosure before publication.

Recheck the list when a cited source or adopted measurement definition changes, and at publication. Correct any affected entry with its evidence date and an explanation of the revision. The list is a bounded desk selection, not an exhaustive audit of the industry.

Maintain an evidence reference for each reported issue, including the report version and the wording being questioned. Assign correction ownership without claiming a defect has been confirmed. A later source update should trigger review of the affected interpretation, not automatic changes to historical observations.

Treating a response as shopper attention

The IAB/MRC retail-media guidelines, dated January 2024, provide the international delivery-measurement reference. Keep ad requests, served or returned responses, rendered placements and viewable impressions distinct. Attention requires separate evidence.

Inspect the event behind the field name. Record its unit, denominator if any, cohort, period, time zone and source. A count has no denominator; the attribution window is not applicable to these delivery counts. Note exclusions, corrections and uncertainty instead of assuming unseen stages occurred.

Comparing rates built from different populations

The same IAB/MRC measurement specification is the source boundary for inspecting media definitions. The house check is to compare the numerator and eligible denominator before interpreting a rate.

For a click-through comparison, preserve qualifying-click and eligible-impression definitions, cohort, period, time zone, filtering and source version. Record attribution window as not applicable, correction treatment and remaining uncertainty. Undefined denominators or incompatible populations prevent a valid rate comparison; no numerical difference is inferred here.

Promoting attributed sales into causal results

HM Treasury's Magenta Book annex, updated in May 2026, describes impact-evaluation designs. It supports examining the causal method rather than accepting credit allocation as proof of effect.

For attributed sales, record the transaction unit, cohort, window, reporting period, time zone, exclusions, corrections, source and uncertainty; standalone counts have no denominator. Modelled estimates need their assumptions disclosed. Causal incrementality additionally requires its outcome, comparison design and analysis unit. None is demonstrated by a delivery total.

Using an unsupported result in marketing

CAP Code rule 3.7 concerns documentary substantiation for objective marketing claims. It is an advertising-code requirement, not a statement that every internal report is itself an advertisement.

Trace an outward performance claim to the underlying metric record and its full scope. Preserve denominator, cohort, clock, attribution terms, exclusions, corrections, source and uncertainty in the supporting evidence. Do not strip away a material qualification when turning an analysis into promotional wording.

Resolve findings without inventing a score

Apply the relevant checks to an actual report and document what was examined. Record missing evidence as unresolved rather than awarding a pass or estimating an error rate. Refer privacy, advertising and causal-analysis questions to competent reviewers. Genuine named authorship, conflicts confirmation and independent source checking remain outstanding publication gates for this article.