alamb commented on code in PR #6848:
URL: https://github.com/apache/arrow-rs/pull/6848#discussion_r1874031298
##########
parquet/src/arrow/arrow_reader/statistics.rs:
##########
@@ -1432,6 +1432,24 @@ impl<'a> StatisticsConverter<'a> {
Ok(UInt64Array::from_iter(null_counts))
}
+ /// Extract the uncompressed sizes from row group statistics in
[`RowGroupMetaData`]
Review Comment:
It might also be worth mentioning here that this is the uncompressed size of
the parquet **data page**
Aka this is what is reported here
https://github.com/apache/parquet-format/blob/4a17d6bfc0bcf7fe360e75e165c1764b43b51352/src/main/thrift/parquet.thrift#L724-L725
I think as written it might be confused with the uncompressed size after
decoding to arrow, which will likely be quite different (and substantially
larger)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
