New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Backfill search index #8765

Open

philipperolet opened this issue Nov 19, 2024 · 1 comment

Contributor

philipperolet commented Nov 19, 2024 •

edited

Loading

Use existing data from folders

Depends on all parent standardization and folder update / backfills
Depends on #8762

Contributor Author

philipperolet commented Dec 12, 2024

Basically, once parents and titles are well-written everywhere, and indexation code on core is live

paginate on data_sources_nodes table with an id cursor
by using batch index
by going up to the last existing id at backfill start
retryable, i.e. outputting current cursor, and with ability to take a start cursor as input

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment