brkyvz commented on code in PR #585:
URL: https://github.com/apache/parquet-format/pull/585#discussion_r3545989695
##########
src/main/thrift/parquet.thrift:
##########
@@ -468,6 +468,35 @@ struct GeographyType {
2: optional EdgeInterpolationAlgorithm algorithm;
}
+/**
+ * File logical type annotation
+ *
+ * Annotates a group that represents a reference to a file, or to a range of
+ * bytes that may be stored inline, elsewhere in this file, or in an external
+ * file. All fields are optional and are identified by name:
+ * - path (STRING): an opaque location string (e.g. s3://bucket/file.jpg);
+ * if absent, the value refers to this file (self-reference)
+ * - offset (INT64): start of the byte range; if absent, treated as 0
+ * - size (INT64): byte length of the referenced data; required when
`offset` is set
+ * or `path` is absent. May be omitted only for a whole-file external
reference
Review Comment:
what if you have a mutable external file? Knowing that you want to avoid
putting in the size, so that you always fetch the latest size.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
