emkornfield commented on code in PR #14603:
URL: https://github.com/apache/arrow/pull/14603#discussion_r1063679459
##########
cpp/src/parquet/column_reader.h:
##########
@@ -55,6 +56,27 @@ static constexpr uint32_t kDefaultMaxPageHeaderSize = 16 *
1024 * 1024;
// 16 KB is the default expected page header size
static constexpr uint32_t kDefaultPageHeaderSize = 16 * 1024;
+// \brief DataPageStats stores encoded statistics and number of values/rows for
+// a page.
+struct PARQUET_EXPORT DataPageStats {
+ DataPageStats(const EncodedStatistics* encoded_statistics, int32_t
num_values,
+ std::optional<int32_t> num_rows)
+ : encoded_statistics(encoded_statistics),
+ num_values(num_values),
+ num_rows(num_rows) {}
+
+ // Encoded statistics extracted from the page header.
+ // Nullptr if there are no statistics in the page header.
+ const EncodedStatistics* encoded_statistics;
+ // Number of values stored in the page. Filled for both V1 and V2 data pages.
+ // For repeated fields, this can be greater than number of rows. For
+ // non-repeated fields, this will be the same as the number of rows.
+ int32_t num_values;
+ // Number of rows stored in the page. std::nullopt for V1 data pages since
Review Comment:
maybe rephrase, is that this might not be available for v1 data pages. It
still seems like it is possible to set if page indexes are written for v1?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
