Amzn-SearchBot
Crawler operated by Amazon. This crawler feeds the answers the engine shows its users, with their sources. Blocking it removes your site from citations: it is the most expensive decision on this page, and often the one taken by default.
- Operator
- Amazon
- Purpose
- Search
- Honours robots.txt
- yes
- User agent string
- Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/120.0.0.0 Safari/537.36
Allow it
Goes in the robots.txt served at the root of your domain. robots.txt groups do not stack: a crawler applies only the most specific group naming it, so a broader, more permissive rule will not be added to this one.
Allowing it keeps you eligible for this engine’s citations. This is where refusal costs the most, and where it is most often made by accident; by blocking “AI crawlers” as a block.
User-agent: Amzn-SearchBot Allow: /
Refuse it
The refusal takes effect immediately for crawlers that honour robots.txt, and is not retroactive: whatever has already been collected stays collected.
Refusing it removes your pages from this engine’s answers. Your competitors stay in them: the traffic does not disappear, it changes hands.
User-agent: Amzn-SearchBot Disallow: /
How to check its visits on your side
Look for the user agent above in your server logs: it is the only proof a crawler actually came. A robots.txt directive states what you ask for, not what happens.
The other crawlers run by Amazon
Other crawlers with the same purpose
A decision taken here is rarely taken alone: these crawlers fall under the same call.