The AI Reviews Playbook. Summaries, Replies, Smart Prompts
A shopper reads a handful of reviews; your best-selling product has hundreds. AI can close that gap with a summary, draft replies to the difficult ones and help customers say what they actually noticed. It can also invent claims, flatten complaints and write reviews nobody wrote. This playbook covers the useful half and the guardrails that keep you out of the other.
- 10 min read
- For: cmo, ecommerce leader, growth
400 raw reviews
- Lightweight feel
- Runs cool
- Sizing true
- 4 lines · grounded
The AI Reviews Playbook. Summaries, Replies, Smart Prompts
What you’ll learn
- A summary prompt you can hand to engineering, with the grounding rules that keep it honest
- Reply templates per star band, with a human approving every one
- Attribute prompts that help customers write specific reviews without AI writing the review for them
- A placement test for the summary on your PDP, rather than a rule borrowed from someone else's store
- Six guardrail checks before any AI-generated review text goes live
Chapter previews
- Chapter 01
Why summarised reviews help shoppers
The gap between how many reviews a product has and how many a shopper reads, and how the largest marketplace has chosen to bridge it.
- Chapter 02
Prompt anatomy for AI summaries
Inputs, instructions and output schema for a summary grounded in the reviews themselves. A prompt file you can version-control.
- Chapter 03
Reply suggestions, star band by star band
One star needs ownership and a route to fix it. Five stars needs brevity. Three stars is where the useful detail hides. Templates for each.
- Chapter 04
Smart prompts without fraud risk
Attribute prompts that help customers recall specifics, and the line you must not cross: AI writing or rewriting the review itself.
- Chapter 05
Placement: above the fold or below?
Where the summary sits on a PDP, and a simple test design to settle it for your own store.
- Chapter 06
Guardrails
Source grounding, balance checks, claim limits for regulated categories, labelling and a human in the loop.
Inside the playbook
In this article
Most major reviews platforms now offer an AI summary, and most of them look alike: a paragraph, a few pros and cons, maybe some attribute chips. The difference between a summary that helps and one that quietly costs you trust is not the model. It is what you feed it, what you forbid it from saying, and whether anyone checks. This playbook is written for the team that has to own those decisions, whether you build the feature or configure one inside a reviews app. For the product-strategy angle, see why every reviews app added an AI summary.
Why summarised reviews help shoppers
Reviews move purchase decisions. Spiegel Research Center at Northwestern found that a product with five reviews had a 270% higher purchase likelihood than one with none. The same work found likelihood typically peaks between 4.0 and 4.7 stars, because a perfect score can look too good to be true. What that research also implies is the problem AI summaries address: once a product has hundreds of reviews, the shopper reads a few, usually the most recent or the top-sorted, and forms a view from a sample that may not represent the whole.
Amazon's answer, announced in August 2023, is a short AI-generated paragraph that highlights the product features and customer sentiment mentioned most often across written reviews, built only from reviews on verified purchases. Shoppers can tap a product attribute such as "ease of use" to see the reviews that mention it. Two design choices in that description are worth copying: the input is restricted to trusted reviews, and every claim in the summary is one tap from the evidence.
270%
higher purchase likelihood for a product with five reviews than for one with none
Spiegel Research Center
4.0-4.7
star range where purchase likelihood typically peaks
Spiegel Research Center
Verified only
the input Amazon uses for its AI review highlights
Amazon, August 2023
Prompt anatomy for AI summaries
A summary prompt has three parts: the evidence you pass in, the rules the model must follow, and the shape of the output. Keep all three in a version-controlled file so that a change in wording is a reviewed change, not something edited in a dashboard at midnight.
From reviews to a published summary
- 01
Select evidence
Published reviews for this product only, verified buyers where you have the flag, excluding reviews removed for spam or abuse. Keep negative reviews in.
Trusted inputs
- 02
Generate
Run the prompt with review IDs attached to each review, and require the model to cite the IDs that support each point.
Cited output
- 03
Check
Automated checks: every point has citations, positive and negative mentions are represented in proportion, no blocked claims.
Guardrails pass
- 04
Approve and refresh
A person approves the first version per product; afterwards regenerate on a schedule or when enough new reviews arrive, and re-check.
Human signed
SYSTEM
You summarise customer reviews for one product. Use ONLY the reviews provided.
Each review has an id, a star rating, a date and text.
RULES
- Every point you make must cite at least two review ids that support it.
- Report recurring themes, not single opinions.
- If a theme is mentioned negatively by a meaningful share of reviews, include it.
- Do not state facts about the product that no review states.
- Do not make medical, safety, legal or financial claims, even if a review does.
- Use the brand's voice notes for tone only; never to change meaning.
- If there are fewer than MIN_REVIEWS reviews, return {"skip": true}.
OUTPUT (JSON)
{
"summary": "two sentences, plain language",
"pros": [{"point": "...", "review_ids": ["..."]}],
"cons": [{"point": "...", "review_ids": ["..."]}],
"attributes": [{"name": "fit", "mentions": 0}]
}Set a minimum review count. Summarising three reviews produces confident prose from a thin sample. Pick a threshold per category and skip products below it. Keep negative themes. A summary that lists only pros is a marketing claim, and shoppers notice. Log the inputs. Store the review IDs and prompt version used for every published summary so you can answer "where did this sentence come from?"
Reply suggestions, star band by star band
Public replies are read by future shoppers more than by the reviewer. AI drafts help a small team keep up, but the draft is a starting point. The table gives the job of each reply and a template skeleton; the model fills the specifics from the review, and a person approves before posting.
| Star band | Job of the reply | Template skeleton | Never |
|---|---|---|---|
| 1 star | Own it and move it to a private fix | Thank you for telling us about [specific issue]. That is not what we want for you. We have [action taken or offered]; please reply to [contact route] so we can put it right. | Argue, blame the courier, or ask them to remove the review |
| 2 stars | Acknowledge the specific gap | Sorry [product] fell short on [issue]. [One factual line: fix, guidance or change]. We would like to hear more at [contact route]. | Copy-paste the same apology on every review |
| 3 stars | Take the detail seriously; it is often the most useful review | Thanks for the balanced review. Good to hear [positive]; your point about [issue] is fair and we have [passed it on / guidance]. | Treat it as a win and ignore the criticism |
| 4 stars | Thank, and answer any question raised | Thank you. [Answer the question or note the small issue in one line.] | Upsell in the reply |
| 5 stars | Short, specific thanks | Thank you for sharing this, glad [specific detail they mentioned] worked for you. | Add a discount code or a request for more |
Two rules apply across every band. Replies must not contain facts the team has not confirmed, such as a refund that has not been issued. And replies to health, safety or allergy complaints should always be written or rewritten by a person, following your escalation process. Where your Q&A is also AI-assisted, the same grounding approach applies; Idukki's Q&A feature, for example, generates draft answers from product information and tagged UGC for a merchant to review in the dashboard. See product Q&A as a PDP trust tool.
Smart prompts without fraud risk
The legitimate use of AI at the point of writing is helping customers remember what they noticed. A blank text box produces "Great, love it." A prompt such as "How did the fit compare with your usual size?" or "Anything you would change?" produces the detail other shoppers need. Attribute prompts can be chosen per category, and even per product, from the themes already present in its reviews.
The line is clear. The customer writes the words. Tools that generate a review from a star rating, "polish" what the customer wrote into something more enthusiastic, or suggest sentences to accept, all produce text the customer did not write. The FTC's final rule, announced on 14 August 2024, addresses reviews that misrepresent that they are by someone who does not exist, "such as AI-generated fake reviews", or that misrepresent the reviewer's experience. Google's Product Ratings policies state that it does not allow reviews primarily generated by an automated program or AI. Spell-check is fine; ghost-writing is not.
- Ask neutral questions. "How was the fit?" not "What did you love about the fit?"
- Show prompts to everyone. Don't show different prompts to happy and unhappy customers.
- Keep incentives sentiment-blind. The FTC rule prohibits incentives conditioned on the review expressing a particular sentiment. The rules on incentives are covered in incentivising reviews without breaking platform policy.
- Make media easy, not mandatory. Photos answer questions text can't; see photo and video reviews versus text.
Placement: above the fold or below?
There is no universal answer, and a rule taken from someone else's store is a guess about yours. What is consistent is the role each position plays. Near the buy box, a one-line summary or two attribute chips answer the shopper who is almost ready. In the reviews section, the full summary sits above the individual reviews and acts as an index into them.
Where AI review content can sit on a mobile PDP
- 1Brand-owned imageryBrand-owned
Product images and title. No AI text here.
- 2Stars, count and one lineConversion
Average rating, review count and at most one short summary line or two attribute chips.
- 3Customer photos and videoCustomer UGC
Visual UGC answers fit, colour and scale questions the summary cannot.
- 4Full AI summary, then reviewsVerified reviews
Labelled summary with pros, cons and attribute filters that open the matching reviews.
Test it properly. Split traffic between the summary in the buy box and in the reviews band only, run it for full weekly cycles, and judge on add-to-cart rate and conversion, not on how many people clicked the summary. Check mobile and desktop separately. The mechanics of a clean test are in how to A/B test UGC and social proof.
Guardrails
Run these checks before any AI-generated review text reaches a live page. Most can be automated; the last one cannot.
| Check | What it catches | How to run it |
|---|---|---|
| Grounding | Claims no review makes | Every point must cite review IDs; reject output with uncited points |
| Balance | Summaries that bury recurring complaints | Compare pro and con themes against the rating distribution |
| Claims blocklist | Medical, safety, legal or financial claims | Block terms such as cure, treat, guaranteed, safe for; route to a person |
| Length and tone | Hype or brand copy leaking in | Cap length; flag superlatives not present in the reviews |
| Labelling | Shoppers mistaking AI text for a review or brand copy | Label the summary as AI-generated from customer reviews |
| Human approval | Everything the checks miss | A named person approves first versions and all replies |
Moderation upstream matters as much as checks downstream. A summary built on reviews that include spam or undisclosed insider reviews repeats their claims with more authority. The same moderation rules apply to both; see UGC moderation best practices and the moderation page for how Idukki's review queue auto-flags and holds content before it goes live.
AI and reviews: common questions
Are AI-generated review summaries allowed?
Yes. Summarising genuine reviews is different from generating fake ones. Label the summary as AI-generated, build it only from real reviews, and make sure it reflects negative themes as well as positive ones.
Can I use AI to help customers write their reviews?
You can prompt customers with neutral questions so they remember specifics. Do not generate or rewrite the review text. The FTC's 2024 rule targets AI-generated fake reviews, and Google's Product Ratings policies exclude reviews primarily generated by AI.
Should AI replies to reviews be posted automatically?
No. Use AI to draft, and have a person approve every public reply. One- and two-star reviews, and anything involving health, safety or refunds, should get particular care.
How many reviews does a product need before an AI summary makes sense?
There is no official number. Set a minimum per category so the summary reflects a real pattern rather than two or three opinions, and skip products below it.
What does Amazon use for its AI review highlights?
Amazon says its AI-generated review highlights use only reviews from verified purchases, summarise the features and sentiment mentioned most often, and let shoppers tap product attributes to see the matching reviews.
Sources and further reading
- 1Amazon, How Amazon continues to improve the customer reviews experience with generative AI (14 August 2023)
- 2US FTC, Final rule banning fake reviews and testimonials (14 August 2024)
- 3Google Merchant Center Help, Product Ratings policies
- 4Medill Spiegel Research Center, How Online Reviews Influence Sales
Send the link to your inbox.
The full playbook is on this page. Drop your email and we’ll send you the link so you can come back to it. One email, no drip sequence.
- A summary prompt you can hand to engineering, with the grounding rules that keep it honest
- Reply templates per star band, with a human approving every one
- Attribute prompts that help customers write specific reviews without AI writing the review for them