While spending on retail media surged, has measurement kept pace? 

Retail media has grown under a confluence of factors that make it very difficult to measure effectively. The biggest being that both, the advertising and the sale, take place within walled gardens; and, due to the shifting privacy landscape, there are limited outside options for tracking the customer journey to purchase.

The net result of these conflicting trends toward rapid growth and limited data availability have contributed to widespread adoption of “ad-attributed” sales as the de facto measured outcome of retail media. This metric is widely available and often the default metric across Amazon Ads' own platform as well as the numerous retail media buying platforms. Underpinning “ad-attributed sales” is a very simplistic approach to attribution. If a user saw or clicked an ad and subsequently purchased within the look-back window, the retail media ad gets 100% credit for driving the sale.

When viewed more broadly among all factors which influence a purchase, the rather blunt nature of this approach becomes obvious.

While those users are certainly exposed to an ad, does that ad deserve 100% credit for driving that sale or are there other factors and touchpoints which should be receiving credit as well?

This type of single-source or single-touch attribution has widely been considered inaccurate in almost every other form of advertising and has driven brands and agencies to more nuanced approaches to attribution.

Those of us who have lived through the previous boom cycles of digital media and the catchup game attribution plays will be quick to see the inherent dangers in such an approach to measuring the performance of retail media. Given how close retail media sits to the point of purchase, it can easily take credit for sales being influenced by upstream advertising or external factors like seasonality. There is an analogous set of learnings that came from the early days of digital media. At the time, search and retargeting sat closest to the point of purchase, and because credit was attributed based on the last touch, their performance looked stellar. These channels almost always were the last touch before a user converted. As brands shifted to multi-touch attribution, they came to learn that these channels and tactics were being massively over-credited by last touch attribution.

There was a harder lesson still, learned in the early days of digital which is relevant here as well. Ads on many of these channels were being purchased programmatically using bidding algorithms optimizing toward last touch attributed sales. The result was that the algorithms were optimizing toward users that were the most likely to convert organically so they could touch the users before they converted and steal the conversion credit. The result was huge sums of advertising dollars being directed toward users that actually didn’t need advertising to convert.

So now the $40 billion dollar question, are we seeing the same thing play out with retail media? 

Retail media looks to be in a strikingly similar position, with effective measurement lagging behind. The last touch attribution behind “ad-attributed” sales certainly obfuscates what is actually driving sales and just like we saw in the early days of digital advertising, the first wave of platforms providing measurement is usually the same platforms buying or selling the media which introduces questions of misaligned interests and neutrality.

So what does retail media’s performance really look like?

There are a number of alternative approaches to attribution, each with its own tradeoffs. The approach used here draws from multivariate time series models. These types of time series models have a long history in attribution and are the underpinnings of most marketing mix models today. They attribute sales based on a multitude of factors which influence the outcome, including other media channels like search and social, promotions, and even seasonality and holidays. The results below are an aggregate of these models across a broad set of brands and retail media campaigns.

Before we dive into the results, let’s establish a few operational definitions to ensure we are all speaking the same language:

• Last Touch Ad-attributed Sales: sales that were attributed to advertising by the retail media platform (e.g. clicked ad, purchased product within a look-back window) and does not control for any outside advertising exposure or external factors.
• ROAS: Return on Advertising Spend, a ratio calculated as “ad-attributed sales revenue” / “advertising spend.”
• Incremental Sales: Sales that were incrementally driven by retail media after controlling for spend on other channels and external factors like seasonality, promotion, etc. These are sales that would have otherwise not have occurred without the influence of retail media.
• iROI: Incremental return on investment calculated as Incremental Sales from Retail Media / Retail Media Advertising Spend.

While there are some other interesting insights that have come out of this work (more on those in a later post) I’ll focus on only two here:

1. Retail media can be incredibly efficient. 43% of the spend had an iROI of 6x or greater on par with other highly efficient media channels.
2. However, not all of it is efficient. 33% of the spend had an iROI < 1x suggesting the brands likely got less than a dollar back for every dollar they invested in those retail media campaigns.

Now there is a silver lining to the second point – this is a huge optimization opportunity. Across the industry, that 33% would add up to over $10 billion worth of investment that could be optimized. If those poor-performing campaigns can be identified quickly and that budget reallocated to stronger-performing retail media campaigns, brands can generate significant additional sales with the same working retail media budget.

Now, not all campaigns with iROI of < 1x should be seen as a “bad” investment. Some may serve a strategic value like bidding on branded keywords to protect the brand from competitive conquesting but there is certainly some additional juice that can be squeezed out of retail media with some more robust measurement.

This begs the question though, why is there SO much opportunity for optimization within retail media?

This comes down to last-touch attribution obfuscating the true value of retail media. When looked at under the lens of a more nuanced approach to attribution, there were plenty of retail media campaigns which drove fantastic ROI but last touch attribution blurs those campaigns with ones that are not producing strong returns.

To illustrate this, we compared ROAS and iROI at a campaign-level. One might expect a generally positive relationship between the two. The top performing on one side likely being the top performing on the other.

The results are Jackson Pollock-esque to say the least:

The campaigns that last touch attribution suggested were top performers were not the ones to which our attribution model gave the most credit. Last touch attribution simply is not effective at identifying the actual winners and losers at a campaign level. The upside here is that a more nuanced attribution approach, can become a source of competitive advantage for brands that move first. They should be able to optimize their retail media investments far more effectively than their peers still using last touch attribution.

What next?

There is absolutely a maturity curve to climb in measuring retail media and we are still in the early days as an industry. The good news is that there is a wealth of alternative approaches to measuring retail media other than the last touch attribution being used today and there is a lot we can learn from the hard-won yards in other media channels that we can apply here to avoid making the same mistakes twice.