This is an automated email from the ASF dual-hosted git repository.
gabor pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-format.git
The following commit(s) were added to refs/heads/master by this push:
new 01971a5 PARQUET-1892: Update Thrift comment to explain CRC
calculation in encrypted columns (#160)
01971a5 is described below
commit 01971a532e20ff8e5eba9d440289bfb753f0cf0b
Author: ggershinsky <[email protected]>
AuthorDate: Thu Jul 30 10:04:31 2020 +0300
PARQUET-1892: Update Thrift comment to explain CRC calculation in encrypted
columns (#160)
---
src/main/thrift/parquet.thrift | 2 ++
1 file changed, 2 insertions(+)
diff --git a/src/main/thrift/parquet.thrift b/src/main/thrift/parquet.thrift
index b60141b..0e091d7 100644
--- a/src/main/thrift/parquet.thrift
+++ b/src/main/thrift/parquet.thrift
@@ -646,6 +646,8 @@ struct PageHeader {
* uncompressed definition levels and the compressed column values.
* If no compression scheme is specified, the CRC shall be calculated on
* the uncompressed concatenation.
+ * - In encrypted columns, CRC is calculated after page encryption; the
+ * encryption itself is performed after page compression (if compressed)
* If enabled, this allows for disabling checksumming in HDFS if only a few
* pages need to be read.
**/
