Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mandatory load of 'columnsToIndex' and 'cubeSize' as properties in a Qbeast Table #486

Open
osopardo1 opened this issue Nov 26, 2024 · 0 comments
Assignees

Comments

@osopardo1
Copy link
Member

osopardo1 commented Nov 26, 2024

When loading the properties in a Qbeast Table, both the Metadata from the Delta Log and the Catalog Properties are loaded.

Since v0.7.0, we added the properties columnsToIndex and cubeSize, not present in any of the mentioned components. For new and older tables, would be important to verify and load these two table properties either from the Log or from the Catalog.

We should modify the code for QbeastTableImpl and:

  • Check if those properties are present as 'options.' or with the bare key.
  • If not present, output the latest Revision column names and cube size.
@osopardo1 osopardo1 self-assigned this Nov 26, 2024
@osopardo1 osopardo1 changed the title Load 'columnsToIndex' and 'cubeSize' as properties from Delta Log Load 'columnsToIndex' and 'cubeSize' as properties in a Qbeast Table Nov 26, 2024
@osopardo1 osopardo1 changed the title Load 'columnsToIndex' and 'cubeSize' as properties in a Qbeast Table Mandatory load of 'columnsToIndex' and 'cubeSize' as properties in a Qbeast Table Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant