AI crawlers · OpenAI

Is your site blocking ChatGPT-User?

ChatGPT-User is the crawler ChatGPT uses to open a page when a person asks it to. Check your site now: we read your robots.txt exactly as ChatGPT-User must, ask your server as each AI crawler, and look at your product pages.

Free, about 20 seconds, no sign-up.

Does blocking it hurt?

Opens pages when a person asks Blocking ChatGPT-User stops ChatGPT from opening your pages when a person asks about them, so it answers without your own page.

In our research, 1% of 2,159 online shops block ChatGPT-User in robots.txt. See the research.

Allow or block it in robots.txt

OpenAI says robots.txt rules may not apply to ChatGPT-User, because it acts for a person. A server or firewall block still stops it.

To let it in (add to your robots.txt, at yourshop.com/robots.txt):

User-agent: ChatGPT-User
Allow: /

To keep it out:

User-agent: ChatGPT-User
Disallow: /

A more specific group wins: if your robots.txt also has a group for ChatGPT-User, that group decides, not the “User-agent: *” rules. Our check reads it the same way (RFC 9309).

Other places it gets blocked

Where this comes from

OpenAI’s own documentation: developers.openai.com. OpenAI: triggered by user requests; robots.txt rules may not apply; not used to decide what appears in search.

OpenAI’s other crawlers

We check 18 AI crawlers in one go. See them all · How the check works