Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

scan: change backend_idx to backend address #154

Open
iwanbk opened this issue Jan 2, 2025 · 0 comments
Open

scan: change backend_idx to backend address #154

iwanbk opened this issue Jan 2, 2025 · 0 comments

Comments

@iwanbk
Copy link
Member

iwanbk commented Jan 2, 2025

Currently SCAN command use backend_idx to complement the cursor argument.
Cursor is needed for the SCAN to work, it is like which page we want to scan.
While backend_idx is the index of the metadata backend in the internal vector of the metastore.

Using backend_idx is not approriate because the index can changed when we refresh the metastore.

Scan is currently only used in two places:

  • by metadata rebuild: it will not impacted by index change
  • by data rebuild: it'll impacted, but will not create any damage.

We should fix it anyway to avoid future problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant