PerplexityBot user agent and robots.txt rules
PerplexityBot surfaces and links websites in Perplexity’s search results. Perplexity says it is not used to crawl content for AI foundation models.
User agent
As documented by Perplexity. Version numbers change; match on the token.
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
robots.txt rules for PerplexityBot
Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.
Block PerplexityBot
Disallows every path for PerplexityBot. That keeps your pages out of Perplexity’s AI search index, so its answers can’t cite them.
User-agent: PerplexityBot Disallow: /
Allow PerplexityBot
Lets PerplexityBot fetch every path, whatever “User-agent: *” says.
User-agent: PerplexityBot Allow: /
Good to know
Perplexity recommends allowing it to appear in its answers. Changes can take up to 24 hours.
PerplexityBot FAQ
What is PerplexityBot?
PerplexityBot surfaces and links websites in Perplexity’s search results. Perplexity says it is not used to crawl content for AI foundation models.
How do I block PerplexityBot?
Add “User-agent: PerplexityBot” and “Disallow: /” to your robots.txt. That keeps your pages out of Perplexity’s AI search index, so its answers can’t cite them.
Does PerplexityBot respect robots.txt?
Yes. Perplexity says PerplexityBot follows robots.txt rules written for it.
What is the PerplexityBot user agent?
Perplexity documents it as “Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)”. Version numbers change, so match on “PerplexityBot”.
How can I verify PerplexityBot requests?
Match the request IP against Perplexity’s published list (https://www.perplexity.ai/perplexitybot.json). The user agent alone can be faked.
Source: docs.perplexity.ai, checked Nov 17, 2026. AI Crawler Directory
Files are the start. Answers are the result.
Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.