feat(documentation): add llms.txt support via docusaurus-plugin-llms

[alicanerdurmaz]

PR Checklist

Please check if your PR fulfills the following requirements:

• The commit message follows our guidelines: https://refine.dev/docs/guides-concepts/contributing/#commit-convention

Bugs / Features

• Related issue(s) linked
• Tests for the changes have been added
• Docs have been added / updated
• Changesets have been added https://refine.dev/docs/guides-concepts/contributing/#creating-a-changeset

What is the current behavior?

AI assistants crawling Refine docs get HTML noise (navigation, JS, footers) instead of clean content.

What is the new behavior?

Two files are auto-generated at build time following the llms.txt spec:

• /llms.txt — structured index of all doc pages (~28K tokens)
• /llms-full.txt — full docs content in a single Markdown file

Via docusaurus-plugin-llms. Old versions (3.xx, 4.xx) excluded automatically.

Notes for reviewers

• Plugin only runs during docusaurus build, not docusaurus start
• Peer dep warning (@docusaurus/core@^3 vs 2.4.0) is harmless — only uses the stable postBuild hook

[changeset-bot]

⚠️ No Changeset found

Latest commit: 538ed2d

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR