IdukkiIdukki
All guides
Playbook · September 2026

The AI Reviews Playbook. Summaries, Replies, Smart Prompts

A shopper reads a handful of reviews; your best-selling product has hundreds. AI can close that gap with a summary, draft replies to the difficult ones and help customers say what they actually noticed. It can also invent claims, flatten complaints and write reviews nobody wrote. This playbook covers the useful half and the guardrails that keep you out of the other.

  • 10 min read
  • For: cmo, ecommerce leader, growth
Rohin Aggarwal

Written by

Rohin Aggarwalon LinkedIn

Co-founder · Idukki.io

400 raw reviews

→
  • Lightweight feel
  • Runs cool
  • Sizing true
  • 4 lines · grounded
IdukkiPlaybook · 10 min read

The AI Reviews Playbook. Summaries, Replies, Smart Prompts

What you’ll learn

  • A summary prompt you can hand to engineering, with the grounding rules that keep it honest
  • Reply templates per star band, with a human approving every one
  • Attribute prompts that help customers write specific reviews without AI writing the review for them
  • A placement test for the summary on your PDP, rather than a rule borrowed from someone else's store
  • Six guardrail checks before any AI-generated review text goes live

Chapter previews

  1. Chapter 01

    Why summarised reviews help shoppers

    The gap between how many reviews a product has and how many a shopper reads, and how the largest marketplace has chosen to bridge it.

  2. Chapter 02

    Prompt anatomy for AI summaries

    Inputs, instructions and output schema for a summary grounded in the reviews themselves. A prompt file you can version-control.

  3. Chapter 03

    Reply suggestions, star band by star band

    One star needs ownership and a route to fix it. Five stars needs brevity. Three stars is where the useful detail hides. Templates for each.

  4. Chapter 04

    Smart prompts without fraud risk

    Attribute prompts that help customers recall specifics, and the line you must not cross: AI writing or rewriting the review itself.

  5. Chapter 05

    Placement: above the fold or below?

    Where the summary sits on a PDP, and a simple test design to settle it for your own store.

  6. Chapter 06

    Guardrails

    Source grounding, balance checks, claim limits for regulated categories, labelling and a human in the loop.

Inside the playbook

In this article

Most major reviews platforms now offer an AI summary, and most of them look alike: a paragraph, a few pros and cons, maybe some attribute chips. The difference between a summary that helps and one that quietly costs you trust is not the model. It is what you feed it, what you forbid it from saying, and whether anyone checks. This playbook is written for the team that has to own those decisions, whether you build the feature or configure one inside a reviews app. For the product-strategy angle, see why every reviews app added an AI summary.

Why summarised reviews help shoppers

Reviews move purchase decisions. Spiegel Research Center at Northwestern found that a product with five reviews had a 270% higher purchase likelihood than one with none. The same work found likelihood typically peaks between 4.0 and 4.7 stars, because a perfect score can look too good to be true. What that research also implies is the problem AI summaries address: once a product has hundreds of reviews, the shopper reads a few, usually the most recent or the top-sorted, and forms a view from a sample that may not represent the whole.

Amazon's answer, announced in August 2023, is a short AI-generated paragraph that highlights the product features and customer sentiment mentioned most often across written reviews, built only from reviews on verified purchases. Shoppers can tap a product attribute such as "ease of use" to see the reviews that mention it. Two design choices in that description are worth copying: the input is restricted to trusted reviews, and every claim in the summary is one tap from the evidence.

  • 270%

    higher purchase likelihood for a product with five reviews than for one with none

    Spiegel Research Center

  • 4.0-4.7

    star range where purchase likelihood typically peaks

    Spiegel Research Center

  • Verified only

    the input Amazon uses for its AI review highlights

    Amazon, August 2023

Sources: Medill Spiegel Research Center, "How Online Reviews Influence Sales"; Amazon, "How Amazon continues to improve the customer reviews experience with generative AI" (14 August 2023).

Prompt anatomy for AI summaries

A summary prompt has three parts: the evidence you pass in, the rules the model must follow, and the shape of the output. Keep all three in a version-controlled file so that a change in wording is a reviewed change, not something edited in a dashboard at midnight.

From reviews to a published summary

  1. 01

    Select evidence

    Published reviews for this product only, verified buyers where you have the flag, excluding reviews removed for spam or abuse. Keep negative reviews in.

    Trusted inputs

  2. 02

    Generate

    Run the prompt with review IDs attached to each review, and require the model to cite the IDs that support each point.

    Cited output

  3. 03

    Check

    Automated checks: every point has citations, positive and negative mentions are represented in proportion, no blocked claims.

    Guardrails pass

  4. 04

    Approve and refresh

    A person approves the first version per product; afterwards regenerate on a schedule or when enough new reviews arrive, and re-check.

    Human signed

A sequence for a grounded summary. Each step exists to stop a specific failure: bad inputs, invented claims, or unreviewed publishing.
text
SYSTEM
You summarise customer reviews for one product. Use ONLY the reviews provided.
Each review has an id, a star rating, a date and text.

RULES
- Every point you make must cite at least two review ids that support it.
- Report recurring themes, not single opinions.
- If a theme is mentioned negatively by a meaningful share of reviews, include it.
- Do not state facts about the product that no review states.
- Do not make medical, safety, legal or financial claims, even if a review does.
- Use the brand's voice notes for tone only; never to change meaning.
- If there are fewer than MIN_REVIEWS reviews, return {"skip": true}.

OUTPUT (JSON)
{
  "summary": "two sentences, plain language",
  "pros": [{"point": "...", "review_ids": ["..."]}],
  "cons": [{"point": "...", "review_ids": ["..."]}],
  "attributes": [{"name": "fit", "mentions": 0}]
}

Set a minimum review count. Summarising three reviews produces confident prose from a thin sample. Pick a threshold per category and skip products below it. Keep negative themes. A summary that lists only pros is a marketing claim, and shoppers notice. Log the inputs. Store the review IDs and prompt version used for every published summary so you can answer "where did this sentence come from?"

Reply suggestions, star band by star band

Public replies are read by future shoppers more than by the reviewer. AI drafts help a small team keep up, but the draft is a starting point. The table gives the job of each reply and a template skeleton; the model fills the specifics from the review, and a person approves before posting.

Star bandJob of the replyTemplate skeletonNever
1 starOwn it and move it to a private fixThank you for telling us about [specific issue]. That is not what we want for you. We have [action taken or offered]; please reply to [contact route] so we can put it right.Argue, blame the courier, or ask them to remove the review
2 starsAcknowledge the specific gapSorry [product] fell short on [issue]. [One factual line: fix, guidance or change]. We would like to hear more at [contact route].Copy-paste the same apology on every review
3 starsTake the detail seriously; it is often the most useful reviewThanks for the balanced review. Good to hear [positive]; your point about [issue] is fair and we have [passed it on / guidance].Treat it as a win and ignore the criticism
4 starsThank, and answer any question raisedThank you. [Answer the question or note the small issue in one line.]Upsell in the reply
5 starsShort, specific thanksThank you for sharing this, glad [specific detail they mentioned] worked for you.Add a discount code or a request for more
Template skeletons for AI-drafted replies. Square brackets are filled from the review. A person approves every reply before it is published.

Two rules apply across every band. Replies must not contain facts the team has not confirmed, such as a refund that has not been issued. And replies to health, safety or allergy complaints should always be written or rewritten by a person, following your escalation process. Where your Q&A is also AI-assisted, the same grounding approach applies; Idukki's Q&A feature, for example, generates draft answers from product information and tagged UGC for a merchant to review in the dashboard. See product Q&A as a PDP trust tool.

Smart prompts without fraud risk

The legitimate use of AI at the point of writing is helping customers remember what they noticed. A blank text box produces "Great, love it." A prompt such as "How did the fit compare with your usual size?" or "Anything you would change?" produces the detail other shoppers need. Attribute prompts can be chosen per category, and even per product, from the themes already present in its reviews.

The line is clear. The customer writes the words. Tools that generate a review from a star rating, "polish" what the customer wrote into something more enthusiastic, or suggest sentences to accept, all produce text the customer did not write. The FTC's final rule, announced on 14 August 2024, addresses reviews that misrepresent that they are by someone who does not exist, "such as AI-generated fake reviews", or that misrepresent the reviewer's experience. Google's Product Ratings policies state that it does not allow reviews primarily generated by an automated program or AI. Spell-check is fine; ghost-writing is not.

  • Ask neutral questions. "How was the fit?" not "What did you love about the fit?"
  • Show prompts to everyone. Don't show different prompts to happy and unhappy customers.
  • Keep incentives sentiment-blind. The FTC rule prohibits incentives conditioned on the review expressing a particular sentiment. The rules on incentives are covered in incentivising reviews without breaking platform policy.
  • Make media easy, not mandatory. Photos answer questions text can't; see photo and video reviews versus text.

Placement: above the fold or below?

There is no universal answer, and a rule taken from someone else's store is a guess about yours. What is consistent is the role each position plays. Near the buy box, a one-line summary or two attribute chips answer the shopper who is almost ready. In the reviews section, the full summary sits above the individual reviews and acts as an index into them.

Where AI review content can sit on a mobile PDP

Hero1
Buy box2
Middle scroll3
Reviews band4
  1. 1
    Brand-owned imageryBrand-owned

    Product images and title. No AI text here.

  2. 2
    Stars, count and one lineConversion

    Average rating, review count and at most one short summary line or two attribute chips.

  3. 3
    Customer photos and videoCustomer UGC

    Visual UGC answers fit, colour and scale questions the summary cannot.

  4. 4
    Full AI summary, then reviewsVerified reviews

    Labelled summary with pros, cons and attribute filters that open the matching reviews.

A starting layout to test, not a benchmark. Keep the full summary next to the reviews it summarises.

Test it properly. Split traffic between the summary in the buy box and in the reviews band only, run it for full weekly cycles, and judge on add-to-cart rate and conversion, not on how many people clicked the summary. Check mobile and desktop separately. The mechanics of a clean test are in how to A/B test UGC and social proof.

Guardrails

Run these checks before any AI-generated review text reaches a live page. Most can be automated; the last one cannot.

CheckWhat it catchesHow to run it
GroundingClaims no review makesEvery point must cite review IDs; reject output with uncited points
BalanceSummaries that bury recurring complaintsCompare pro and con themes against the rating distribution
Claims blocklistMedical, safety, legal or financial claimsBlock terms such as cure, treat, guaranteed, safe for; route to a person
Length and toneHype or brand copy leaking inCap length; flag superlatives not present in the reviews
LabellingShoppers mistaking AI text for a review or brand copyLabel the summary as AI-generated from customer reviews
Human approvalEverything the checks missA named person approves first versions and all replies
A pre-publish checklist for AI summaries and replies.

Moderation upstream matters as much as checks downstream. A summary built on reviews that include spam or undisclosed insider reviews repeats their claims with more authority. The same moderation rules apply to both; see UGC moderation best practices and the moderation page for how Idukki's review queue auto-flags and holds content before it goes live.

AI and reviews: common questions

  • Are AI-generated review summaries allowed?

    Yes. Summarising genuine reviews is different from generating fake ones. Label the summary as AI-generated, build it only from real reviews, and make sure it reflects negative themes as well as positive ones.

  • Can I use AI to help customers write their reviews?

    You can prompt customers with neutral questions so they remember specifics. Do not generate or rewrite the review text. The FTC's 2024 rule targets AI-generated fake reviews, and Google's Product Ratings policies exclude reviews primarily generated by AI.

  • Should AI replies to reviews be posted automatically?

    No. Use AI to draft, and have a person approve every public reply. One- and two-star reviews, and anything involving health, safety or refunds, should get particular care.

  • How many reviews does a product need before an AI summary makes sense?

    There is no official number. Set a minimum per category so the summary reflects a real pattern rather than two or three opinions, and skip products below it.

  • What does Amazon use for its AI review highlights?

    Amazon says its AI-generated review highlights use only reviews from verified purchases, summarise the features and sentiment mentioned most often, and let shoppers tap product attributes to see the matching reviews.

Sources and further reading

  1. 1Amazon, How Amazon continues to improve the customer reviews experience with generative AI (14 August 2023)
  2. 2US FTC, Final rule banning fake reviews and testimonials (14 August 2024)
  3. 3Google Merchant Center Help, Product Ratings policies
  4. 4Medill Spiegel Research Center, How Online Reviews Influence Sales
Keep this playbook

Send the link to your inbox.

The full playbook is on this page. Drop your email and we’ll send you the link so you can come back to it. One email, no drip sequence.

  • A summary prompt you can hand to engineering, with the grounding rules that keep it honest
  • Reply templates per star band, with a human approving every one
  • Attribute prompts that help customers write specific reviews without AI writing the review for them

Cloudflare bot-protection

No spam. Unsubscribe anytime. We never sell your data.

More guides

4-min setupDTC + B2B brands37 KB runtimeReal G2 reviews

Loved this?

Get the next post first, plus the playbooks behind it.

Monthly UGC + shoppable-video benchmarks, A/B post-mortems and migration teardowns. No spam, no upsell, unsubscribe in one click.

  • No credit card
  • Cancel anytime
  • GDPR + SOC 2 (in audit)

We use cookies

We use essential cookies to run this site and optional analytics cookies to understand how it’s used. You can change your choice anytime in our privacy policy.