wgtmac commented on code in PR #34112:
URL: https://github.com/apache/arrow/pull/34112#discussion_r1102348619
##########
cpp/src/parquet/column_reader.cc:
##########
@@ -211,10 +211,15 @@ EncodedStatistics ExtractStatsFromHeader(const H& header)
{
return page_statistics;
}
const format::Statistics& stats = header.statistics;
- if (stats.__isset.max) {
+ // Use the new V2 min-max statistics over the former one if it is filled
Review Comment:
Yes, page stats without either min or max is corrupted and cannot be used.
Check parquet-mr for detail:
https://github.com/apache/parquet-mr/blob/5290bd5e0ee5dc30db0576e2bfc6eea335c465cf/parquet-hadoop/src/main/java/org/apache/parquet/format/converter/ParquetMetadataConverter.java#L797
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
