Amazonbot user agent and robots.txt rules
Amazonbot crawls the web to improve Amazon’s products and services, and Amazon says its data may be used to train Amazon AI models.
User agent
As documented by Amazon. Version numbers change; match on the token.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
robots.txt rules for Amazonbot
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.
Block Amazonbot
Disallows every path for Amazonbot. That keeps your future pages out of what Amazon may use for training. It does not change search results.
User-agent: Amazonbot Disallow: /
Allow Amazonbot
Lets Amazonbot fetch every path, whatever “User-agent: *” says.
User-agent: Amazonbot Allow: /
Good to know
It reads a cached robots.txt up to 30 days old and does not support Crawl-delay.
Amazonbot FAQ
What is Amazonbot?
Amazonbot crawls the web to improve Amazon’s products and services, and Amazon says its data may be used to train Amazon AI models.
How do I block Amazonbot?
Add “User-agent: Amazonbot” and “Disallow: /” to your robots.txt. That keeps your future pages out of what Amazon may use for training. It does not change search results.
Does Amazonbot respect robots.txt?
Yes. Amazon says Amazonbot follows robots.txt rules written for it.
What is the Amazonbot user agent?
Amazon documents it as “Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36”. Version numbers change, so match on “Amazonbot”.
How can I verify Amazonbot requests?
Match the request IP against Amazon’s published list (https://developer.amazon.com/amazonbot/ip-addresses/). The user agent alone can be faked.
Source: developer.amazon.com, checked Nov 17, 2026. AI Crawler Directory
Files are the start. Answers are the result.
Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.