This is an automated email from the ASF dual-hosted git repository. apitrou pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/parquet-testing.git
The following commit(s) were added to refs/heads/master by this push: new e45cd23 Replace encrypted files with page index enabled (#39) e45cd23 is described below commit e45cd23f784aab3d6bf0701f8f4e621469ed3be7 Author: Gang Wu <ust...@gmail.com> AuthorDate: Tue Sep 26 00:06:41 2023 +0800 Replace encrypted files with page index enabled (#39) --------- Co-authored-by: Antoine Pitrou <anto...@python.org> --- data/README.md | 14 ++++++++------ data/encrypt_columns_and_footer.parquet.encrypted | Bin 4930 -> 5515 bytes data/encrypt_columns_and_footer_aad.parquet.encrypted | Bin 4938 -> 5523 bytes data/encrypt_columns_and_footer_ctr.parquet.encrypted | Bin 4864 -> 5449 bytes ...s_and_footer_disable_aad_storage.parquet.encrypted | Bin 4930 -> 5515 bytes ...encrypt_columns_plaintext_footer.parquet.encrypted | Bin 5083 -> 5668 bytes data/uniform_encryption.parquet.encrypted | Bin 5483 -> 6422 bytes 7 files changed, 8 insertions(+), 6 deletions(-) diff --git a/data/README.md b/data/README.md index 27c381a..b8534fe 100644 --- a/data/README.md +++ b/data/README.md @@ -57,14 +57,15 @@ A detailed description of the Parquet Modular Encryption specification can be fo https://github.com/apache/parquet-format/blob/encryption/Encryption.md ``` -Following are the keys and key ids (when using key\_retriever) used to encrypt the encrypted columns and footer in the all the encrypted files: +Following are the keys and key ids (when using key\_retriever) used to encrypt +the encrypted columns and footer in all the encrypted files: * Encrypted/Signed Footer: * key: {0,1,2,3,4,5,6,7,8,9,0,1,2,3,4,5} * key_id: "kf" -* Encrypted column named double_field: +* Encrypted column named double_field (including column and offset index): * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,0} * key_id: "kc1" -* Encrypted column named float_field: +* Encrypted column named float_field (including column and offset index): * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,1} * key_id: "kc2" @@ -73,10 +74,11 @@ The following files are encrypted with AAD prefix "tester": 2. encrypt\_columns\_and\_footer\_aad.parquet.encrypted -A sample that reads and checks these files can be found at the following tests: +A sample that reads and checks these files can be found at the following tests +in Parquet C++: ``` -cpp/src/parquet/encryption-read-configurations-test.cc -cpp/src/parquet/test-encryption-util.h +cpp/src/parquet/encryption/read-configurations-test.cc +cpp/src/parquet/encryption/test-encryption-util.h ``` The `external_key_material_java.parquet.encrypted` file was encrypted using parquet-mr with diff --git a/data/encrypt_columns_and_footer.parquet.encrypted b/data/encrypt_columns_and_footer.parquet.encrypted index 460d05b..3067593 100644 Binary files a/data/encrypt_columns_and_footer.parquet.encrypted and b/data/encrypt_columns_and_footer.parquet.encrypted differ diff --git a/data/encrypt_columns_and_footer_aad.parquet.encrypted b/data/encrypt_columns_and_footer_aad.parquet.encrypted index 863ccb2..ba988f0 100644 Binary files a/data/encrypt_columns_and_footer_aad.parquet.encrypted and b/data/encrypt_columns_and_footer_aad.parquet.encrypted differ diff --git a/data/encrypt_columns_and_footer_ctr.parquet.encrypted b/data/encrypt_columns_and_footer_ctr.parquet.encrypted index 0591df4..a319086 100644 Binary files a/data/encrypt_columns_and_footer_ctr.parquet.encrypted and b/data/encrypt_columns_and_footer_ctr.parquet.encrypted differ diff --git a/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted b/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted index abd40e7..4867f4d 100644 Binary files a/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted and b/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted differ diff --git a/data/encrypt_columns_plaintext_footer.parquet.encrypted b/data/encrypt_columns_plaintext_footer.parquet.encrypted index 0625080..439db7a 100644 Binary files a/data/encrypt_columns_plaintext_footer.parquet.encrypted and b/data/encrypt_columns_plaintext_footer.parquet.encrypted differ diff --git a/data/uniform_encryption.parquet.encrypted b/data/uniform_encryption.parquet.encrypted index 048f35f..40f46d9 100644 Binary files a/data/uniform_encryption.parquet.encrypted and b/data/uniform_encryption.parquet.encrypted differ