Shopper Experience
09 June 2022
Amazon grows AR shopping tools with Virtual Try-On for Shoes
Augmented reality meets Amazon's scale.

Augmented reality meets Amazon's scale.

Welcome to Near Future. In this weekly feature, The Current spotlights innovations powering the next wave of commerce.
Shopping for shoes on Amazon allows users to scroll through a host of brands, colors and styles. A new tool is adding the capability to use a phone to check out how the shoes look on their feet.
The ecommerce company’s fashion division on Thursday launched Virtual Try-On for Shoes, a new tool that can be accessed in the US and Canada using the Amazon shopping app in iOS (The company said Android will follow soon). After a period in limited release, Amazon is rolling out the feature with thousands of sneaker styles from brands including New Balance, adidas, Reebok, Puma, Superga, Lacoste, Asics and Saucony.
With the introduction of the feature, Amazon is tapping into augmented reality (AR) to mimic an in-store try-on experience. Augmented reality allows users look at a real-world image through a mobile camera, and view an overlay of a digital image within the phone display.
Here’s how Amazon’s Virtual Try-On for Shoes works:
After being popularized by Pokemon Go, brands and retailers have been experimenting with AR in recent years. As we wrote in Augmented reality is transforming the try-on:
It could usher in a new phase of try-before-you-buy. Makeup counters, dressing rooms, shoe try-ons and even mirrors are all key tools used by physical stores that allow shoppers to get a sense of a product before purchase. Augmented reality can help to bring a key part of the in-person shopping experience to the digital realm: "How can I touch it, feel it and get a better sense of this product?" said Will Gee, CEO of Baltimore-based XR development studio Balti Virtual.
Tech enhancements have helped this area to evolve. In 2017, upgrades that came with the iPhone X and Apple’s release of the ARKit marked a major step forward. This opened the way for pioneering apps from Ikea, Wayfair, Warby Parker and Home Depot.
Amazon, too, has introduced AR shopping in the past. It previously rolled out a tool that allowed shoppers to visualize home decor in a room. With L'Oreal, it introduced cosmetics try-on in 2019. In April, Amazon incorporated virtual try-on into a custom clothing service called Made for You that launched in experimental mode.
The new fashion-focused feature comes at a time when AR is increasingly being applied to apparel and beauty, showing how a product will look on a person rather than in a space. Walmart rolled out its own virtual try-on tool for women's fashion after last year's acquisition of Zeekit, though this allows users to choose a model that best represents them rather than see a product on themselves.
Social media platforms are also integrating augmented reality as they look to bring ecommerce capabilities into their apps. After proving out the technology and conversion potential of its AR tools through brand partnerships that included shoe try-on and cosmetics, Snap is in the midst of introducing upgrades that include a central "dressing room" hub within Snapchat for users to view themselves wearing products, and various tools that allow brands and retailers to easily add items and create AR experiences within the app.
AR tools hold promise in helping to drive purchase decisions. According to a study by AR no-code design platform Camera IQ, 59% of consumers said they would be more likely to purchase a product they’ve seen visualized through AR.

Amazon's Virtual Try-on for Shoes. (Gif via Amazon)
Like others before it, Amazon is initially releasing the technology in a targeted way. It is focusing in the single product area of shoes. It's also focused on look, as opposed to combining style and fit like Warby Parker's AR try-on tool for glasses. However, within the experience, the likeness of the shoes appears to fit to a user's feet when rendered within the app.
That said, the ability to view the shoes from multiple angles goes a long way toward providing a more true-to-life experience, and the integration within Amazon's existing in-app shopping experience makes it accessible as part of general browsing.
Plus, the scale of Amazon can still be felt even in what feels like a test. Even as it provides a tool only for sneakers, the platform is providing access to a host of brands, and a wide range of styles and colors.
Try-on is familiar from the in-store experience, but AR combined with Amazon’s product catalog brings the potential for shoppers to try out a wide variety of options, and do so without having to go to a store and pull boxes off the shelves. It’s a representation of how ecommerce can extend the choice available.
“Amazon Fashion’s goal is to create innovative experiences that make shopping for fashion online easier and more delightful for customers,” said Muge Erdirik Dogan, president of Amazon Fashion, in a statement. “We’re excited to introduce Virtual Try-On for Shoes, so customers can try on thousands of styles from brands they know and love at their convenience, wherever they are. We look forward to listening and learning from customer feedback as we continue to enhance the experience and expand to more brands and styles.”
Even as it remains in learning mode, Amazon’s increasing adoption of the technology will likely be felt across ecommerce. An eyewear executive recently told us that AR is becoming "table stakes" for ecommerce shopping experiences, and Amazon including the capability as part of the largest and most widely-used online shopping platform could go a long way toward making that so.
Campbell Soup Company CEO Mark Clouse offered thoughts on messaging amid inflationary shifts in consumer behavior.
After months of elevated inflation and interest rate hikes that have the potential to cool demand, consumers are showing more signs of shifting behavior.
It’s showing up in retail sales data, but there’s also evidence in the observations of the brands responsible for grocery store staples.
The latest example came this week from Campbell Soup Company. CEO Mark Clouse told analysts that the consumer continues to be “resilient” despite continued price increases on food, but found that “consumers are beginning to feel that pressure” as time goes on.
This shows up in the categories they are buying. Overall, Clouse said Campbell sees a shift toward shelf-stable items, and away from more expensive prepared foods.
There is also change in when they make purchases. People are buying more at the beginning of the month. That’s because they are stretching paychecks as long as possible.
These shifts change how the company is communicating with consumers.
Clouse said the changes in behavior are an opportunity to “focus on value within our messaging without necessarily having to chase pricing all the way down.”
“No question that it's important that we protect affordability and that we make that relevant in the categories that we're in," Clouse said. "But I also think there's a lot of ways to frame value in different ways, right?”
A meal cooked with condensed soup may be cheaper than picking up a frozen item or ordering out. Consumers just need a reminder. Even within Campbell’s own portfolio, the company can elevate brands that have more value now, even if they may not always get the limelight.
The open question is whether the shift in behavior will begin to show up in the results of the companies that have raised prices. Campbell’s overall net sales grew 5% for the quarter ended April 30, while gross profit margins held steady around 30%. But the category-level results were more uneven. U.S. soup sales declined 11%, though the company said that was owed to comparisons with the quarter when supply chains reopened a year ago and expressed confidence that the category is seeing a longer-term resurgence as more people cook at home following the pandemic. Snacks, which includes Goldfish and Pepperidge Farm, were up 12% And while net sales increased overall, the amount of products people are buying is declining. Volumes were down 7%.
These are trends happening across the grocery store. Campbell is continuing to compete. It is leading with iconic brands, and a host of different ways to consume them. It is following that up with innovation that makes the products stand out. Then, it is driving home messaging that shows consumers how to fit the products into their lives, and even their tightening spending plans.
Campbell Soup is more than 150 years old, and has seen plenty of difficult economic environments. It is also a different business today, and will continue to evolve. At the end of the day, continued execution is what’s required.
“If it's good food, people are going to buy it, especially if it's a great value,” Clouse said.