This is an automated email from the ASF dual-hosted git repository.
apitrou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-testing.git
The following commit(s) were added to refs/heads/master by this push:
new e45cd23 Replace encrypted files with page index enabled (#39)
e45cd23 is described below
commit e45cd23f784aab3d6bf0701f8f4e621469ed3be7
Author: Gang Wu <[email protected]>
AuthorDate: Tue Sep 26 00:06:41 2023 +0800
Replace encrypted files with page index enabled (#39)
---------
Co-authored-by: Antoine Pitrou <[email protected]>
---
data/README.md | 14 ++++++++------
data/encrypt_columns_and_footer.parquet.encrypted | Bin 4930 -> 5515 bytes
data/encrypt_columns_and_footer_aad.parquet.encrypted | Bin 4938 -> 5523 bytes
data/encrypt_columns_and_footer_ctr.parquet.encrypted | Bin 4864 -> 5449 bytes
...s_and_footer_disable_aad_storage.parquet.encrypted | Bin 4930 -> 5515 bytes
...encrypt_columns_plaintext_footer.parquet.encrypted | Bin 5083 -> 5668 bytes
data/uniform_encryption.parquet.encrypted | Bin 5483 -> 6422 bytes
7 files changed, 8 insertions(+), 6 deletions(-)
diff --git a/data/README.md b/data/README.md
index 27c381a..b8534fe 100644
--- a/data/README.md
+++ b/data/README.md
@@ -57,14 +57,15 @@ A detailed description of the Parquet Modular Encryption
specification can be fo
https://github.com/apache/parquet-format/blob/encryption/Encryption.md
```
-Following are the keys and key ids (when using key\_retriever) used to encrypt
the encrypted columns and footer in the all the encrypted files:
+Following are the keys and key ids (when using key\_retriever) used to encrypt
+the encrypted columns and footer in all the encrypted files:
* Encrypted/Signed Footer:
* key: {0,1,2,3,4,5,6,7,8,9,0,1,2,3,4,5}
* key_id: "kf"
-* Encrypted column named double_field:
+* Encrypted column named double_field (including column and offset index):
* key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,0}
* key_id: "kc1"
-* Encrypted column named float_field:
+* Encrypted column named float_field (including column and offset index):
* key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,1}
* key_id: "kc2"
@@ -73,10 +74,11 @@ The following files are encrypted with AAD prefix "tester":
2. encrypt\_columns\_and\_footer\_aad.parquet.encrypted
-A sample that reads and checks these files can be found at the following tests:
+A sample that reads and checks these files can be found at the following tests
+in Parquet C++:
```
-cpp/src/parquet/encryption-read-configurations-test.cc
-cpp/src/parquet/test-encryption-util.h
+cpp/src/parquet/encryption/read-configurations-test.cc
+cpp/src/parquet/encryption/test-encryption-util.h
```
The `external_key_material_java.parquet.encrypted` file was encrypted using
parquet-mr with
diff --git a/data/encrypt_columns_and_footer.parquet.encrypted
b/data/encrypt_columns_and_footer.parquet.encrypted
index 460d05b..3067593 100644
Binary files a/data/encrypt_columns_and_footer.parquet.encrypted and
b/data/encrypt_columns_and_footer.parquet.encrypted differ
diff --git a/data/encrypt_columns_and_footer_aad.parquet.encrypted
b/data/encrypt_columns_and_footer_aad.parquet.encrypted
index 863ccb2..ba988f0 100644
Binary files a/data/encrypt_columns_and_footer_aad.parquet.encrypted and
b/data/encrypt_columns_and_footer_aad.parquet.encrypted differ
diff --git a/data/encrypt_columns_and_footer_ctr.parquet.encrypted
b/data/encrypt_columns_and_footer_ctr.parquet.encrypted
index 0591df4..a319086 100644
Binary files a/data/encrypt_columns_and_footer_ctr.parquet.encrypted and
b/data/encrypt_columns_and_footer_ctr.parquet.encrypted differ
diff --git
a/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted
b/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted
index abd40e7..4867f4d 100644
Binary files
a/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted and
b/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted differ
diff --git a/data/encrypt_columns_plaintext_footer.parquet.encrypted
b/data/encrypt_columns_plaintext_footer.parquet.encrypted
index 0625080..439db7a 100644
Binary files a/data/encrypt_columns_plaintext_footer.parquet.encrypted and
b/data/encrypt_columns_plaintext_footer.parquet.encrypted differ
diff --git a/data/uniform_encryption.parquet.encrypted
b/data/uniform_encryption.parquet.encrypted
index 048f35f..40f46d9 100644
Binary files a/data/uniform_encryption.parquet.encrypted and
b/data/uniform_encryption.parquet.encrypted differ