alkis commented on code in PR #253:
URL: https://github.com/apache/parquet-format/pull/253#discussion_r1622682981
##########
src/main/thrift/parquet.thrift:
##########
@@ -833,6 +843,13 @@ struct ColumnMetaData {
* filter pushdown.
*/
16: optional SizeStatistics size_statistics;
+
+ /**
+ * The index into FileMetadata.schema (list<SchemaElement>) for this column.
+ * This implies that ColumnMetaData can be sparse in a rowgroup, if for
example
+ * a column does not have any data pages in a rowgroup.
+ */
+ 17: optional i32 schema_index;
Review Comment:
FWIW I accidentally discovered
https://issues.apache.org/jira/browse/PARQUET-183 which can be fixed with this
field.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
