Website security · Raksha guide

llms.txt Checker: What Is llms.txt, and What Belongs in It?

llms.txt is a proposed Markdown content map, commonly published at /llms.txt, that describes a site and links to useful pages. It is not an access-control mechanism, a universally adopted crawler standard or a promise that ChatGPT, Claude or Perplexity will cite your content.

By Raksha · Reviewed 16 November 2026

What is llms.txt?

The proposal describes a compact, readable overview for systems working with website content. Unlike a sitemap’s URL inventory, it can explain which resources matter and why. Adoption varies; do not infer that a named provider consumes your file unless you have current documentation or evidence.

Raksha publishes its own public llms.txt. This is a content map, not permission to scan or access private systems.

What belongs in the file

Use a clear site name, a short summary, useful context and a small set of descriptive links to authoritative public pages. Keep it maintainable; there is no universal 500-word limit imposed by the proposal.

# Example Company

> Public documentation for Example Company's scheduling service.

This file links to public resources only. Account data is not included.

## Documentation
- [Overview](https://example.com/docs): What the service does.
- [Security](https://example.com/security): Testing boundaries and reporting.
- [Pricing](https://example.com/pricing): Current plans and allowances.

Do not include private documents, access tokens, internal endpoints or claims you cannot support. Update links when content changes.

How to check whether your site has one

curl -sS -D - https://example.com/llms.txt

Inspect status, content type and body. A 200 containing your HTML homepage is a catch-all, not a valid content map. Check that the intended Markdown is served and the linked pages are public and accurate. A missing file is a content-readiness observation, not a security vulnerability.

What Raksha checks

Raksha’s Web Health and AI visibility review includes llms.txt-related observations alongside structured data and supported bot-access checks. These are separate from the security finding ledger. Review the actual check detail and coverage; a heuristic result does not prove that any AI provider fetched the file.

Understand the AI visibility measures

What llms.txt does not do

  • It does not override authentication, robots directives or a firewall.
  • It does not guarantee inclusion, citations or higher search rankings.
  • It does not make private information safe to publish.
  • It does not replace useful page content, canonical URLs or normal documentation.

Do I also need llms-full.txt?

The proposal discusses expanded content, but it is optional. Publish only content you intend to make public and can keep up to date; do not duplicate a large site without a maintenance plan.

Sources and further reading

Consult current official documentation before changing a production system. Examples are illustrative, not live findings or universal configurations.

Start with a site you are authorised to test

A free passive check needs no card. Sign-in, email confirmation, ownership rules and usage limits apply. It is not an unrestricted penetration test.