---
title: "BlackSEOAnalyzer-Hosted: the bseoa Hosted Crawler"
description: "What the BlackSEOAnalyzer-Hosted crawler is, what it respects, and how to block it with robots.txt or by asking us to add your site to our deny list."
image: "https://www.blackseoanalyzer.com/static/images/black-seo-analyzer-og-image.png"
canonical: "https://www.blackseoanalyzer.com/en/crawler"
language: "en"
---

# The bseoa hosted crawler

If you found BlackSEOAnalyzer-Hosted in your server logs, a bseoa customer asked their AI assistant to audit a site through the hosted bseoa connector, and our servers fetched the pages. Here is what it is, what it respects and how to block it.

## How it identifies itself

Every request carries this user agent:

`BlackSEOAnalyzer-Hosted/<version> (+https://www.blackseoanalyzer.com/crawler)`

## What it respects

- It always obeys robots.txt. Customers can't switch that off on the hosted crawler.
- It sends at most two requests a second to any one host.
- It doesn't run JavaScript, submit forms or sign in to anything.
- It stays on the site a customer asked it to audit and doesn't check external links.

## How to block it

Add this group to your robots.txt:

```
User-agent: BlackSEOAnalyzer-Hosted
Disallow: /
```

Or email us and we'll add your host to our deny list. Hosted crawls of a host on that list are refused before any request is made.

## Contact

Abuse reports and questions: [support@blackseoanalyzer.com](mailto:support@blackseoanalyzer.com). Include your host name and the time of the requests.

Crawls that customers run with the bseoa desktop app or CLI come from their own computers, not from us. This page, the user agent above and the deny list cover the hosted crawler. One more agent links here: when a chat tool connects to bseoa, our sign-in server may fetch that chat tool's client metadata document once, with the user agent `bseoa-oauth/1.0`. It never fetches your site's pages.

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://www.blackseoanalyzer.com/#organization","name":"Fiscus Technology, LLC","url":"https://www.blackseoanalyzer.com/","logo":"https://www.blackseoanalyzer.com/static/images/black-seo-analyzer.png","sameAs":["https://github.com/sethblack/black-seo-analyzer","https://www.youtube.com/@SethBlack","https://linkedin.com/in/seth-black-tx"],"founder":{"@type":"Person","@id":"https://www.blackseoanalyzer.com/#seth","name":"Seth Black","url":"https://www.blackseoanalyzer.com/about"}},{"@type":"WebSite","@id":"https://www.blackseoanalyzer.com/#website","name":"bseoa","url":"https://www.blackseoanalyzer.com/","publisher":{"@id":"https://www.blackseoanalyzer.com/#organization"}},{"@type":"WebPage","@id":"https://www.blackseoanalyzer.com/en/crawler","url":"https://www.blackseoanalyzer.com/en/crawler","name":"BlackSEOAnalyzer-Hosted: the bseoa Hosted Crawler","description":"What the BlackSEOAnalyzer-Hosted crawler is, what it respects, and how to block it with robots.txt or by asking us to add your site to our deny list.","inLanguage":"en-US","isPartOf":{"@id":"https://www.blackseoanalyzer.com/#website"}},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.blackseoanalyzer.com/"},{"@type":"ListItem","position":2,"name":"BlackSEOAnalyzer-Hosted: the bseoa Hosted Crawler","item":"https://www.blackseoanalyzer.com/en/crawler"}]}]}
```