Our crawler
CookieExemptionsBot
If this name is in your server logs, someone asked for your site to be looked at here, or your site carries our badge.
1How it identifies itself
Every request carries this at the end of its user agent:
CookieExemptionsBot/1.0 (+https://cookieexemptions.com/robot)
The page loads come from a real Chromium browser, so the rest of the user agent is Chromium’s own. It never pretends to be a person or another crawler.
2What it loads
- A page load in a browser: the homepage, and one product page on shops. Like a visitor’s browser it also fetches what those pages ask for (scripts, images, embeds), within fixed limits. It clicks nothing, fills in nothing and answers no banner.
- A plain fetch of one page, to see whether our badge is on it. Only for sites that have been given badge code.
- robots.txt, to read the rule below.
Each browser load counts as a visit in your statistics.
3Keeping it out, or letting it in
To stop the scheduled re-checks, add this to your robots.txt:
User-agent: CookieExemptionsBot Disallow: /
Only a group that names CookieExemptionsBot is read for this. A check that somebody asks for by hand is a single page load and is not covered by it.
To let it through a firewall or bot filter, allow the user agent token CookieExemptionsBot. We do not publish addresses to allow.
4What you see may differ
Some sites and consent tools serve something different to crawlers. Findings here describe what was served to this one.