Each retrieval crawler is blocked by its own rule rather than by one blanket line. The individual blocks may each look reasonable, but together they mean that no assistant can reach your content to quote it. This is worth stating on its own because the individual findings do not make the combined effect obvious.
Retrieval crawlers are blocked one at a time, so no single rule looks like the cause:
User-agent: OAI-SearchBot
Disallow: /
User-agent: Claude-SearchBot
Disallow: /
User-agent: PerplexityBot
Disallow: /Allow the retrieval agents. If crawl load is the concern, use Crawl-delay or block specific expensive paths rather than the whole site:
User-agent: OAI-SearchBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
Disallow: /searchBeing citable is how a site earns traffic from assistant answers. Restoring access to the retrieval crawlers is what puts it back in the running.
This issue can affect your site's search engine rankings and user experience. Addressing it promptly helps ensure optimal performance and visibility in search results.
bseoa automatically checks for this warning during site analysis, along with hundreds of other technical SEO issues.
Choose the license that fits your needs and start getting the deep, actionable insights you deserve.