Visual search and "shop the look": turning a customer photo into a buyable cart
Shoppers increasingly start with an image, not a keyword. Visual search and shop-the-look turn a photo, often a real customer’s photo, into a path straight to a buyable product. Here is how it works and where it belongs.
Keyword search asks the shopper to do the hard part: translate something they have seen into the words a database expects. "That oversized oatmeal cardigan with the horn buttons" becomes a clumsy query and three wrong results. Visual search removes that translation step. The shopper shows the system an image; the system finds the product.
What visual search is
Visual search matches an input image against a catalogue and returns the same product or close alternatives. The input can be a photo the shopper took, a screenshot, or an image already on your site. Under the hood the system turns the image into a numeric fingerprint and finds the catalogue items whose fingerprints are nearest: matching on shape, colour, texture and pattern rather than on words.
Shop the look, the UGC angle
Shop-the-look extends visual search to a whole scene. Instead of one product, the image contains several, an outfit, a styled room, and each is detected and made individually tappable. The shopper sees the look they liked and can buy any part of it without leaving the image.
This is where it meets UGC. A studio flat-lay is shoppable but inert. A real customer wearing the outfit, in real light, is the image a shopper actually wants to recreate, and making that image shop-the-look turns aspiration into a cart in one tap. The customer photo does the persuading; the tagging does the routing.
“A shopper who says "I want to look like that" has already decided. Shop-the-look just removes the ten minutes of hunting between the feeling and the cart.”
How it works under the hood
- 1A model detects the distinct items in an image, each garment, each object, and draws a region around them.
- 2Each region is matched against your catalogue, or tagged to a product you confirm.
- 3Those regions become interactive hotspots on the image, tap one, get that product.
- 4The shopper adds to cart from the image itself, never breaking the thread between inspiration and purchase.
Where it belongs on your site
- On UGC galleries, make the customer photos shoppable, not just decorative.
- On the PDP, a "styled with" strip turns one product into a basket.
- On the homepage and collection pages, lookbook imagery that is browsable and buyable at once.
Keyword search
The shopper translates an image into words, and hopes.
Wins at
- Works well when the shopper knows the exact term
- Simple to implement
Struggles with
- Fails on style, texture and "things like this"
- Puts the hard translation work on the shopper
Visual search & shop-the-look
The shopper shows what they want; the system routes them to it.
Wins at
- Matches on look, not vocabulary
- Turns any image, especially UGC, into a buyable surface
- Removes the gap between "I want that" and "add to cart"
Struggles with
- Needs accurate detection and product matching to feel magic
Two ways a shopper can go from interest to product.
Sources & notes
- 1Google, visual search and Lens product-discovery research · Adoption of image-first product discovery.
- 2Baymard Institute, product discovery & search UX · Where keyword search breaks down for shoppers.
- 3Nielsen Norman Group, image and visual search behaviour · How shoppers use images to navigate.
+18%
Median PDP CVR lift
Idukki dataset, 2,400+ brands
+144%
Lift among UGC-engagers
Bazaarvoice 2025 SEI
79%
Consumers say UGC highly impacts purchase
Nosto
4.1x
Video review vs text-only
PowerReviews 2023
More from Rohin Aggarwal
- Conversational commerce
Why we built the Conversational PDP
Most product-page exits are a single unanswered question. Here is the case for answering it on the page, from your own evidence, and the story of why we built a Q&A that is curated-first and AI-second.
- Strategy
PDP before and after UGC: what actually changes on the page
Strip a product page back to brand-only content, then layer verified customer photos, video and reviews into the middle scroll, and watch what moves. A scroll-by-scroll look at the before and after, the numbers the public studies actually support, and where "just add UGC" gets oversold.
- Industry playbook
How to vet a creator: audience authenticity, engagement, and the fake-follower problem
On a typical account, roughly a fifth of followers are fake or inactive. Here is how to read the signals that separate a real audience from an inflated one, before you pay, with the four checks that catch most of it.
