PrivettBot
About our website checker
PrivettBot is the crawler behind Privett, which helps UK estate and letting agents see how AI assistants describe them. If you've seen it in your logs, this page explains what it does.
How to recognise it
Requests carry this user agent:
Mozilla/5.0 (compatible; PrivettBot/1.0; +https://www.useprivett.com/bot)
What it fetches, and why
When an agency runs a scan, PrivettBot reads its website, and for paying customers the websites of the agencies AI assistants name most often in the same town. It looks for things that help AI assistants understand an agency: structured data, an llms.txt file, which AI crawlers robots.txt allows, and whether the homepage mentions the town, how quickly it responds, and whether there are pages for valuations, fees, the team, FAQs and the neighbourhoods the agency covers.
- Small and infrequent. The homepage, robots.txt, llms.txt and up to 15 linked pages on the same site, at most four at a time. Usually once a week per site.
- Public pages only. It never logs in, submits forms or follows links to other websites, and it doesn't run JavaScript.
- No copies kept. We store what we found (for example, “has a fees page” and its address) and a copy of robots.txt, not the pages themselves.
- Not for AI training. Nothing PrivettBot collects is used to train AI models.
How to block it
PrivettBot obeys robots.txt. It checks yours before fetching anything else, and skips any page it's asked not to fetch. To block it from your whole site, add:
User-agent: PrivettBot Disallow: /
If you block it, we don't check your website at all, and Privett makes no website suggestions about it rather than guessing.
Contact
Questions, or a problem with PrivettBot on your site? Email ed@useprivett.com and we'll look into it.