Your robots.txt blocks a crawler that only fetches a page when a person explicitly asks for it, usually by pasting your link into an assistant. Unlike a bulk crawler, it makes one request because a human wanted that page. Blocking it means the person gets an error instead of your content, at the exact moment they were trying to read it.
A rule disallows a user-action fetcher such as ChatGPT-User, Claude-User or Perplexity-User:
User-agent: ChatGPT-User
Disallow: /Allow these agents. They generate no crawl load worth managing, because each request corresponds to one person asking for one page:
User-agent: ChatGPT-User
Allow: /
User-agent: Claude-User
Allow: /
User-agent: Perplexity-User
Allow: /These requests are a reader following your link. Serving them is the same decision as serving a person who pasted your URL into a browser.
This issue can affect your site's search engine rankings and user experience. Addressing it promptly helps ensure optimal performance and visibility in search results.
bseoa automatically checks for this warning during site analysis, along with hundreds of other technical SEO issues.
Choose the license that fits your needs and start getting the deep, actionable insights you deserve.