emkornfield commented on code in PR #197:
URL: https://github.com/apache/parquet-format/pull/197#discussion_r1168922582
##########
src/main/thrift/parquet.thrift:
##########
@@ -753,6 +820,12 @@ struct ColumnMetaData {
/** Byte offset from beginning of file to Bloom filter data. **/
14: optional i64 bloom_filter_offset;
+ /**
+ * Optional statistics to help estimate total memory when converted to in
memory
+ * representations. The histogram contained on these statistics can also be
useful
+ * in some cases for more fine-grained nullability/list length filter
pushdown.
+ */
+ 15: optional SizeEstimationStatistics size_estimate_statistics;
Review Comment:
updated in merge.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
