RankZeroBot
Who runs RankZeroBot, what it fetches, how often, and how to keep it off your site.
RankZeroBot is RankZero's web crawler. RankZero runs it. It reads public websites so we can study how ready they are for AI search.
It identifies itself with this user agent:
Mozilla/5.0 (compatible; RankZeroBot/1.0; +https://rankzero.io/crawler)What it fetches
For each site in a batch, RankZeroBot asks for robots.txt first. If the rules allow it, it then fetches:
- the homepage
- the sitemap
- llms.txt
- the pricing page, if there is one
- one product page, if the site looks like a shop
It only reads. It does not log in, send forms, run JavaScript or load images.
How often
RankZeroBot runs in separate batches, not all the time. A batch visits each site once, and it makes only a few requests to a site at the same time.
robots.txt
RankZeroBot honours robots.txt. It follows the rules for RankZeroBot, or the rules for * when none name it. If your robots.txt cannot be read, for example because of a server error or a rate limit, it fetches nothing from your site.
How to opt out
Add this to your robots.txt:
User-agent: RankZeroBot
Disallow: /Or email legal@rankzero.io with your domain and we will leave it out of every batch.
Other requests with this name
RankZero's tools also use this name when someone asks us to check one particular site. Those are single requests made for that person, not part of a batch, so the rules on this page do not cover them.