Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option to disable writing of Parquet offset index #6797

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

etseidl
Copy link
Contributor

@etseidl etseidl commented Nov 25, 2024

Which issue does this PR close?

Closes #6778.

Rationale for this change

Allow disabling offset indexes.

What changes are included in this PR?

Adds a global offset_index_disabled writer property. This was made global rather than per-column because the index is not very useful if not defined for all columns.

Are there any user-facing changes?

Yes, adds a new property.

@github-actions github-actions bot added the parquet Changes to the parquet crate label Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow disabling the writing of Parquet Offset Index
1 participant