Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support indexing by an LLM #4545

Open
4 tasks done
BryanHuntNV opened this issue Feb 5, 2025 · 1 comment
Open
4 tasks done

Support indexing by an LLM #4545

BryanHuntNV opened this issue Feb 5, 2025 · 1 comment

Comments

@BryanHuntNV
Copy link

Is your feature request related to a problem? Please describe.

Our documentation needs to be indexed by an LLM to support natural language searching across multiple tools. The dynamic nature of routing between pages makes this challenging.

Describe the solution you'd like

It would be great if VitePress could somehow make indexing available to external LLMs.

Describe alternatives you've considered

The alternative we are considering is using MkDocs with a plugin for publishing the content to Confluence.

Additional context

No response

Validations

@brc-dd
Copy link
Member

brc-dd commented Feb 5, 2025

Can’t tell without knowing what kind of dynamic content you have. But few options:

  • Just index the markdown source.
  • Enable sitemap and scrape each url in cheerio or some headless browser using playwright/puppeteer. Simple fetch will work if most of the content is static.
  • There are many tools and packages that can generate llm friendly structured data, for example https://github.com/egoist/sitefetch

Is there something specific that you need help with?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants