PerplexityBot user agent and robots.txt rules

PerplexityBot surfaces and links websites in Perplexity’s search results. Perplexity says it is not used to crawl content for AI foundation models.

AI search Follows robots.txt Perplexity

User agent

As documented by Perplexity. Version numbers change; match on the token.

User agent
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)

robots.txt rules for PerplexityBot

Paste one block into the robots.txt at the root of your domain. Changes can take up to a day to be read.

Block PerplexityBot

Disallows every path for PerplexityBot. That keeps your pages out of Perplexity’s AI search index, so its answers can’t cite them.

robots.txt
User-agent: PerplexityBot
Disallow: /

Allow PerplexityBot

Lets PerplexityBot fetch every path, whatever “User-agent: *” says.

robots.txt
User-agent: PerplexityBot
Allow: /

Good to know

Perplexity recommends allowing it to appear in its answers. Changes can take up to 24 hours.

PerplexityBot FAQ

What is PerplexityBot?

PerplexityBot surfaces and links websites in Perplexity’s search results. Perplexity says it is not used to crawl content for AI foundation models.

How do I block PerplexityBot?

Add “User-agent: PerplexityBot” and “Disallow: /” to your robots.txt. That keeps your pages out of Perplexity’s AI search index, so its answers can’t cite them.

Does PerplexityBot respect robots.txt?

Yes. Perplexity says PerplexityBot follows robots.txt rules written for it.

What is the PerplexityBot user agent?

Perplexity documents it as “Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)”. Version numbers change, so match on “PerplexityBot”.

How can I verify PerplexityBot requests?

Match the request IP against Perplexity’s published list (https://www.perplexity.ai/perplexitybot.json). The user agent alone can be faked.

Source: docs.perplexity.ai, checked Nov 17, 2026. AI Crawler Directory

Files are the start. Answers are the result.

Your buyers’ questions on eight AI engines, on your schedule, with history. Free for 7 days.