← All checks

PerplexityBot robots.txt: can Perplexity index your site?

We evaluate your robots.txt for the PerplexityBot user agent and check that the path / is not disallowed.

Why it matters

Perplexity builds its search index with PerplexityBot and shows the sources it used. If the bot is disallowed, your pages cannot be indexed there, and a user asking a question you answer well is sent to a competitor that is listed. The block often comes from a copied "block all AI bots" snippet.

How to fix it

1. Remove Disallow: / from any User-agent: PerplexityBot group.
2. If you want to be explicit, add User-agent: PerplexityBot and Allow: /.
3. Check that the User-agent: * group is not a blanket Disallow: /.
4. Review anti-bot rules in your CDN, which can block the crawler even when robots.txt allows it.

How to verify

Re-scan this page; the evidence reads "PerplexityBot not disallowed for /".

Check your site free

Scan a site

Related checks

• Google-Extended / Applebot-Extended not disallowed
• Bot Reality: fetch under GPTBot UA
• Rate limit
• sitemap.xml
• No cloud/IP blocking

All checks