ParsewellBot

ParsewellBot is the crawler behind Parsewell, which checks how well AI shopping assistants can read a Shopify store. It identifies itself with this user agent:

ParsewellBot/0.1 (MerxonLabs; +https://www.merxonlabs.com/products/parsewell/bot)

When it visits

Only when someone asks Parsewell to check a store, and once a week for stores whose owner has added them to a Parsewell account. A recent report is reused for 24 hours, so the same store isn't scanned again and again.

What it reads

Only public pages that any visitor or AI assistant can see:

• the home page, robots.txt and sitemaps;
• public product information (the store's products feed and a sample of product pages);
• the store's policies and the pages they link to;
• Shopify's public AI shopping connection, to search the store the way a shopper's assistant would and ask about returns and delivery.

It never signs in, never adds anything to a cart or checks out, and never reads customer or order data.

How it behaves

• At most 3 requests to a store at a time, with a short gap between them.
• A 15-second timeout, and limits on how much it downloads.
• If a store answers "too many requests" or has a temporary error, it backs off and respects Retry-After.

How to stop it

Add this to your store's robots.txt (in Shopify: Online Store › Themes › Edit code › robots.txt.liquid):

User-agent: ParsewellBot Disallow: /

Parsewell then won't scan your store at all. You can also block only some paths with Disallow lines for those paths.

Contact

Questions or problems: contact@merxonlabs.com