Skip to main content

Chat optimization playbook

Chat quality in ShopGuide has less to do with wordsmithing a welcome message and more to do with three things you actually control: how completely your catalog is indexed, whether your product data matches how customers phrase things, and how quickly you act on what the AI couldn't resolve. This is about ShopGuide's real architecture, not generic chatbot advice.

How ShopGuide decides what to say​

Every incoming message gets classified into an intent — PRODUCT_SEARCH, PRODUCT_QUESTION, PRODUCT_COMPARISON, GUIDED_DISCOVERY, BROWSE_COLLECTIONS, INFORMATION, ORDER_MANAGEMENT, SUPPORT, ADD_TO_CART, CHECKOUT, SPECIAL, CLARIFICATION, plus DISCOUNT_CODE if you've turned that feature on — before the AI writes a word. Each one activates a different tool set and prompt section, not just a different tone.

What that means in practice: if customers describe products using phrasing your catalog doesn't contain, they land in BROWSE_COLLECTIONS or CLARIFICATION instead of PRODUCT_SEARCH, and get a generic category response instead of a direct answer. The fix isn't a better welcome message. It's tightening product titles, collection handles, and descriptions to match how shoppers actually talk about what you sell.

Catalog coverage is the real lever here​

Product search and product questions run on semantic (vector) search over your indexed catalog plus your shop's knowledge content — semantic matching, not keyword matching. A shopper typing "warm winter hat" should land on a product titled "Merino Wool Beanie" because the match is on meaning.

Which also means the AI can only recommend or answer questions about what's actually indexed. If a product line isn't showing up in results, check sync (Sync Products (Delta) or Force Full Sync on the Train page; the first sync runs automatically) and content completeness — full descriptions, current variants, populated metafields — before touching prompt wording. An unindexed or thinly-described product won't surface no matter how you instruct the AI.

When Guided Discovery earns its keep​

GUIDED_DISCOVERY covers vague-need requests — "help me choose," "what do I need for X" — where a keyword search would return too broad a list to be useful. Instead of searching right away, the AI asks up to three short questions, three options each, shown as an in-chat overlay, then searches using the answers.

This flow is only as good as the distinctions your catalog supports. If two products differ in ways your descriptions don't capture — skill level, use case, fit, material — the follow-up questions can't meaningfully change the outcome. If these conversations keep ending in generic browsing rather than a specific pick, that's a catalog-detail problem, not a prompting one.

Closing the loop with Information Gaps​

Every response gets checked afterward by Information Gaps Detection, which flags anything the AI couldn't fully resolve. Gaps are grouped by what you would do about them: Add product info, Clarify a policy, Customer demand and Fix your store. Recurring phrasings of the same question get stacked into one row instead of fragmenting into duplicates, so the count you see is a real frequency signal.

Check the Knowledge gaps tab regularly — see Chat management. Rows are ranked by how many of those chats did not end in an order, so the top of the list is where you lose the most sales. It's the most direct answer to "what is my AI actually failing at," and Answer in Knowledge Base turns a gap into a FAQ in your Shopify Knowledge Base in one step.

Test, don't guess​

Rather than assuming which welcome message or prompt variant performs better, run it as an A/B test. ShopGuide splits shoppers into variants and attributes both engagement and completed orders back to each one, so you're comparing real outcomes instead of a proxy engagement number. Set one up under A/B testing and read results via A/B test results — see Common mistakes for how long to let a test run before acting on it.

Language coverage​

The widget's static chrome — buttons, guided-discovery labels, footer text, disclaimer — ships in English, German, and Dutch only. The AI's own replies aren't limited to those three: it detects and responds in whatever language the shopper is using, regardless of the UI setting. Serve a market outside en/de/nl, and expect fluent AI prose next to English buttons and labels. See Multi-language support for what's configurable and what isn't.

Next steps​