Recommended default
Allow this crawler when AI answer visibility, citations, or user-triggered access matters.
User-agent: Perplexity-User Allow: /
Decision notes
- Keep crawler-specific groups separate so future policy changes are easy.
- Do not use robots.txt for private data; use authentication or server-side access control.
- Re-check vendor documentation when this crawler becomes important to your site.
Source
https://docs.perplexity.ai/docs/resources/perplexity-crawlers