Skip to content

Commit

Permalink
Allow custom tree builder for parquet::record::RowIter
Browse files Browse the repository at this point in the history
It will allow to read parquet with custom batch_size.
Currently the only possible batch_size for parquet::record::RowIter is 1024
  • Loading branch information
Yuri Kotov committed Sep 6, 2023
1 parent 65edbb1 commit b32fd9c
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions parquet/src/record/reader.rs
Original file line number Diff line number Diff line change
Expand Up @@ -747,6 +747,12 @@ impl<'a> RowIter<'a> {
}
}

/// Sets tree builder for this row iter.
pub fn with_tree_builder(mut self, tree_builder: TreeBuilder) -> Self {
self.tree_builder = tree_builder;
self
}

/// Returns common tree builder, so the same settings are applied to both iterators
/// from file reader and row group.
#[inline]
Expand Down

0 comments on commit b32fd9c

Please sign in to comment.