This is an automated email from the ASF dual-hosted git repository.
gershinsky pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-testing.git
The following commit(s) were added to refs/heads/master by this push:
new be74fc0 Add test file encrypted with external key material
new 4aec91f Merge pull request #36 from
adamreeve/java_external_key_material
be74fc0 is described below
commit be74fc0873381110e8a1f69f321cee81bd3f2f60
Author: Adam Reeve <[email protected]>
AuthorDate: Tue Feb 14 16:35:10 2023 +1300
Add test file encrypted with external key material
---
data/README.md | 6 ++++++
...FOR_external_key_material_java.parquet.encrypted.json | 1 +
data/external_key_material_java.parquet.encrypted | Bin 0 -> 2922 bytes
3 files changed, 7 insertions(+)
diff --git a/data/README.md b/data/README.md
index 072a9d5..dd25ade 100644
--- a/data/README.md
+++ b/data/README.md
@@ -75,6 +75,12 @@ cpp/src/parquet/encryption-read-configurations-test.cc
cpp/src/parquet/test-encryption-util.h
```
+The `external_key_material_java.parquet.encrypted` file was encrypted using
parquet-mr with
+external key material enabled, so the key material is found in the
+`_KEY_MATERIAL_FOR_external_key_material_java.parquet.encrypted.json` file.
+This data was written using the
`org.apache.parquet.crypto.keytools.mocks.InMemoryKMS` KMS client,
+which is compatible with the `TestOnlyInServerWrapKms` KMS client used in C++
tests.
+
## Checksum Files
The schema for the `datapage_v1-*-checksum.parquet` test files is:
diff --git
a/data/_KEY_MATERIAL_FOR_external_key_material_java.parquet.encrypted.json
b/data/_KEY_MATERIAL_FOR_external_key_material_java.parquet.encrypted.json
new file mode 100644
index 0000000..a227c13
--- /dev/null
+++ b/data/_KEY_MATERIAL_FOR_external_key_material_java.parquet.encrypted.json
@@ -0,0 +1 @@
+{"footerKey":"{\"kmsInstanceURL\":\"DEFAULT\",\"masterKeyID\":\"kf\",\"wrappedDEK\":\"FLQDczpR9upRCqUjtzac5N1PbdduFekfeklLxi4VwOLul7un1iBcdAsJAXc=\",\"keyEncryptionKeyID\":\"NFkiTmDXYzZMTb+O3b9nSA==\",\"doubleWrapping\":true,\"isFooterKey\":true,\"keyMaterialType\":\"PKMT1\",\"kmsInstanceID\":\"DEFAULT\",\"wrappedKEK\":\"kWHNReXsULhmTplhvImESLFTXV91t5CyoqaEVYLk7k0jD8oeTDDJCUnIiCs=\"}","columnKey1":"{\"masterKeyID\":\"kc2\",\"wrappedDEK\":\"cTH8VFwBMb+3u0r7XJrcjxPu1agMZ7gXWeo8WX6nKFVWpRWs
[...]
\ No newline at end of file
diff --git a/data/external_key_material_java.parquet.encrypted
b/data/external_key_material_java.parquet.encrypted
new file mode 100644
index 0000000..191860d
Binary files /dev/null and b/data/external_key_material_java.parquet.encrypted
differ