Skip to content

Commit

Permalink
Adds support for Dictionary statistics from parquet data pages. (apac…
Browse files Browse the repository at this point in the history
…he#11195)

Co-authored-by: Eric Fredine <[email protected]>
  • Loading branch information
2 people authored and findepi committed Jul 16, 2024
1 parent 1172975 commit 1a4af6b
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -846,6 +846,9 @@ macro_rules! get_data_page_statistics {
})
}).flatten().collect::<Vec<_>>(),
))),
Some(DataType::Dictionary(_, value_type)) => {
[<$stat_type_prefix:lower _ page_statistics>](Some(value_type), $iterator)
},
Some(DataType::Timestamp(unit, timezone)) => {
let iter = [<$stat_type_prefix Int64DataPageStatsIterator>]::new($iterator).flatten();
Ok(match unit {
Expand Down
2 changes: 1 addition & 1 deletion datafusion/core/tests/parquet/arrow_statistics.rs
Original file line number Diff line number Diff line change
Expand Up @@ -1752,7 +1752,7 @@ async fn test_dictionary() {
expected_null_counts: UInt64Array::from(vec![1, 0]),
expected_row_counts: Some(UInt64Array::from(vec![5, 2])),
column_name: "string_dict_i32",
check: Check::RowGroup,
check: Check::Both,
}
.run();

Expand Down

0 comments on commit 1a4af6b

Please sign in to comment.