What Shopify merchants complain about in AI chat apps (233 reviews)

What do Shopify merchants complain about most in AI chat apps?

Mostly the vendor, not the AI. In 233 critical merchant reviews of 10 AI chat and help-desk apps for Shopify, slow or absent vendor support came up 81 times, missing or broken integrations 47, surprise charges 39, hard setup 35 and updates that broke things 34. Wrong or invented AI answers came up 23 times.

That order surprised us. We expected accuracy to lead, because an AI that invents a price or a policy costs a store money and trust. It is a serious complaint, and it appears in reviews of nine of the ten apps. But merchants write most often about the things around the AI: whether anyone answers when something breaks, whether the bill matches what they expected, and whether the widget behaves on their storefront.

The chart and the table below show every theme with at least 10 reviews. A single review can sit in more than one theme (a merchant who was charged twice and could not reach support counts in both), so the numbers add up to more than 233.

How did we run this study?

We read 233 public reviews and forum posts written by Shopify merchants about 10 AI chat and help-desk apps: 159 from the Shopify App Store, 57 from Trustpilot and 18 from the Shopify Community forum. We read them in a browser on October 28, 2026, sorted them into complaint themes, and counted reviews per theme.

The apps. Ten widely installed apps that put a chat or an AI agent on a Shopify store: six AI chat or AI sales apps and four help desks with AI features. We do not name them here, because this page is about patterns across the category, not about any one vendor.

The reviews. On the Shopify App Store and Trustpilot we filtered each app to 1 to 4 stars and read newest first. On the forum we kept only posts by merchants about their own store, and dropped vendor replies and self-promotion. Ratings in the set: 137 one-star, 19 two-star, 11 three-star, 49 four-star and 18 unrated forum posts. 150 of the 233 are from 2026; the oldest is from 2021.

The themes. Each review was matched against a list of complaint themes written for AI chat apps (keywords in several languages), then checked by hand. A review counts once per theme, but can count in several themes. We report plain counts per theme; the share is that count divided by 233.

Why is vendor support the most common complaint?

Because when a chat app misbehaves on a live store, every hour costs sales, and the merchant cannot fix it alone. 81 of the 233 reviews, across all ten apps, describe support that answered slowly, not at all, or only through a bot. Some of those reviews say the product itself worked well.

A pattern worth knowing: several of the four-star reviews in the set praise one named, fast support person, even while reporting bugs. Merchants forgive problems that someone owns.

What to check. Before you pay, send the vendor one real question about your store and note who answers and how. Look for a help page, a way to reach a person, and how billing questions are handled. Our support checklist for Shopify apps has the full list.

How Tycoon is built. A request sent from the Help page in your Tycoon dashboard is read by our support team, people. On paid plans an AI assistant inside the dashboard answers setup and plan questions right away and takes you to the right page. Pro and Tycoon add priority support. We do not publish response times.

Which integrations do merchants say are missing or broken?

Mostly the store data a support person or an AI needs to answer: live cart contents, order details, customer type, and sync with the help desk the team already uses. 47 reviews raise it. Most come from help-desk apps, so read the number as a signal about data depth rather than about any one tool.

What to check. Ask whether an integration is live today or on a roadmap, which plan it needs, and whether it only opens another tool or actually creates a ticket with the conversation attached. Our guide to choosing a help-desk integration walks through each type.

How Tycoon is built. Tycoon reads your Shopify catalog, prices and stock live and adds to your store's real cart. Hand-off works today to WhatsApp, phone, email and Shopify Inbox on every plan, and into the Gorgias or Intercom chat from Growth. From Pro it also opens help-desk tickets in Zendesk, Re:amaze, Richpanel and Gorgias, and connects to the store's own Klaviyo, AfterShip and Recharge accounts and to back-in-stock alerts; from Growth it quotes real reviews from Judge.me, Yotpo or Okendo. Flashy and CARGO are in beta, and HFD shipments are recognized from the store's own Shopify tracking. The full list, with the plan for each, is on Why Tycoon.

What billing surprises do merchants report?

Charges they did not expect: double charges, a free trial that turned into a full charge, an automatic upgrade that never went back down, usage fees on top of the plan, and prices shown differently in different places. 39 reviews describe surprise charges or hard cancellation, and 23 more say per-ticket or per-conversation pricing made the app too expensive to keep on.

Shopify's own rules help here. Apps that bill through Shopify appear on your Shopify bill, uninstalling stops future billing cycles, and refunds for app charges are handled by the app developer (Shopify Help Center, app charges).

What to check. Is it billed through Shopify? Is there a usage fee or a per-conversation price on top of the plan? What happens when you reach the limit: does it stop, charge more, or upgrade you? Our billing checklist covers each question.

How Tycoon is built. Each plan is a fixed monthly price you see before you choose, billed through Shopify. There are no usage fees. When you reach your plan's monthly conversations, the AI agent pauses until the next month, an upgrade or extra conversations you approve, and shoppers can still reach your team or leave a message; it never moves you to a bigger plan or charges you without your approval. Free is 25 AI conversations a month, free forever. See pricing.

Why do merchants find AI chat apps hard to set up?

Because the AI often has to be taught the store by hand. 35 reviews, across all ten apps, describe getting stuck: the app could not scan the site, products would not load, or training the AI took longer than the merchant could give it. Some never got past the first setup screen.

What to check. Install on a development store first and time it from install to the first correct answer about one of your own products. Ask whether you need to paste code, upload files or book an onboarding call. Our guide to what a theme app extension means for setup explains the moving parts.

How Tycoon is built. Install it and approve the permissions on Shopify's screen; there is no separate account. Tycoon reads your catalog, policies, shipping and brand voice by itself, you check and approve what it found, then press Save in your theme editor. It is added through a theme app extension, so there is no theme code to edit and no sales call.

What happens when an app update breaks the chat?

Shoppers see it before the merchant does. 34 reviews describe bugs, outages or updates that changed the chat without warning: new sign-in steps for shoppers, buttons that could not be removed, features that appeared and disappeared, or a day of lost support. Merchants are most upset when a change reaches shoppers unannounced.

What to check. Ask how the vendor announces changes that shoppers will see, and whether you can switch the chat off in one step while something is fixed. Keep an eye on your own storefront after app updates, on a phone as well as a desktop.

How Tycoon is built. Every plan has an on/off switch: when it is off, the chat icon disappears from your store. Because Tycoon is a theme app extension, you can also turn its app embed off in your theme editor. This is an area we are still building: release checks and a rule that shopper-visible changes are announced first are on our work list, so we do not claim more here today.

How often do AI chat apps give wrong or made-up answers?

Often enough that it appears in reviews of nine of the ten apps. 23 reviews describe confident answers that missed the question, products shown as unavailable when they were in stock, wrong links, or replies the merchant had to switch off. Seventeen of the 23 are from 2026, so this is a current problem, not an old one.

The cause is usually the same: the model writes a figure or a fact from memory or from an old copy of the site, instead of reading it from the store at the moment it answers. Our guide on AI chatbot hallucinations about prices and stock explains the mechanics and the legal side.

What to check. Ask where each price and stock state comes from on every reply, and whether replies are checked before the shopper sees them. Test it: change a price on a development store and ask the chat about that product a minute later.

How Tycoon is built. For every reply Tycoon reads the price, and whether the item is in stock, live from your store. A discount code can only be one you set up. Each reply is written in full and checked before the shopper sees it (no streaming), and a reply with a figure that doesn't match is stopped and rewritten.

What control do merchants want over the AI?

A real off switch, and rules the AI cannot break. 17 reviews ask for control: an AI agent that could not be turned off, automated replies sent after the bot was disabled, or no way to keep the AI away from topics like dosage, refunds or order changes. Merchants want to decide what the AI may say before a shopper hears it.

What to check. Can you list topics that always go to a person, words it must never use, and the only discount codes it may offer? Does off really mean off? Our guide to the rules your AI chatbot should follow has a starting set.

How Tycoon is built. From your dashboard you set the tone, the topics that always go straight to a person and the words it never says (up to 3 hard rules on Starter, unlimited from Growth), the discount codes it may offer (from Growth), the hours it answers and an on/off switch on every plan. A change you save reaches your store within seconds. Tycoon never edits orders or issues refunds on its own.

Can a chat widget hurt the storefront?

Yes, in three ways merchants describe: the chat button covers a sticky add-to-cart bar or the checkout button on mobile, the script slows the whole site, or the widget is still on the store after the app was removed. 16 reviews raise it. All come from one source, so this theme is thinner than the others.

What to check. Open your product page on a phone with the chat installed and check the add-to-cart bar, the cookie banner and any other chat button. Run a speed test before and after. Ask whether the app uses a theme app extension, which Shopify removes from the theme when the app is uninstalled. See chat widget overlap and leftovers after uninstall and will a chat widget slow down your store.

How Tycoon is built. The script on your storefront is under 10 KB compressed, and the chat window loads separately at low priority. The button moves up so it doesn't sit on a sticky add-to-cart bar, the cookie banner or another chat button, and you choose the side of the screen. Remove the app and the widget goes with it.

Why does a real hand-off to a person matter?

Because some shoppers need a person, and a chat that cannot reach one loses the sale or the customer. 10 reviews describe an AI with no way to hand over, or no way to follow up with a shopper who left. It is a small count, but 8 of the 10 are from 2026, as more stores turn AI agents on around the clock.

What to check. Ask for a person inside the chat and see where you land. Does the shopper have to repeat the question? Is there a way to leave a message when nobody is online? Our guide on AI disclosure and human hand-off covers what good looks like.

How Tycoon is built. Tycoon says plainly that it is an AI and always offers a person from your team, on every plan; you can't turn that off. One tap opens your WhatsApp, phone, email, a leave-a-message form or Shopify Inbox, and from Growth the Gorgias or Intercom chat. On WhatsApp and email the shopper's question is already typed in.

How should you choose an AI chat app for a Shopify store?

Test the vendor as hard as the AI. Install on a development store, time the setup, change a price and ask about it, ask for a person, read the billing terms in Shopify, check the widget on a phone, and send support a real question. Each step maps to one of the complaints merchants raise most.

1. Send support one real question before you pay, and note who answers and how.
2. Read how it bills: through Shopify or not, usage fees, and what happens at the monthly limit.
3. Install on a development store and time it from install to the first correct answer.
4. Change a price or a stock level, then ask the chat about that product.
5. Ask for a person inside the chat; check where the shopper lands and whether the question travels with them.
6. Set one topic that must always go to a person, then try to make the AI answer it.
7. Open a product page on a phone and check the add-to-cart bar, the cookie banner and other buttons.
8. Run a speed test on home, product and collection pages, before and after.
9. Check which integrations are live today and which are on a roadmap, and on which plan.
10. Uninstall on the development store and confirm the widget and its code are gone.

Frequently asked questions

Sources

1. Shopify Help Center: Charges for apps · checked October 28, 2026
2. Shopify Dev: Theme app extensions, UX guidelines · checked October 28, 2026