[jira] [Created] (ARROW-16505) [Python][Parquet] Enable usage of external key material and rotation for encryption keys in PyArrow

2022-05-09 Thread Maya Anderson (Jira) 
Maya Anderson created ARROW-16505:
-

 Summary: [Python][Parquet] Enable usage of external key material 
and rotation for encryption keys in PyArrow
 Key: ARROW-16505
 URL: https://issues.apache.org/jira/browse/ARROW-16505
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Python
Reporter: Maya Anderson


Python API wrapper for ARROW-9960 .



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

[jira] [Created] (ARROW-14467) [C++][Python][Parquet] Uniform encryption

2021-10-26 Thread Maya Anderson (Jira) 
Maya Anderson created ARROW-14467:
-

 Summary: [C++][Python][Parquet] Uniform encryption
 Key: ARROW-14467
 URL: https://issues.apache.org/jira/browse/ARROW-14467
 Project: Apache Arrow
  Issue Type: Improvement
  Components: C++, Parquet, Python
Reporter: Maya Anderson
Assignee: Maya Anderson


PME supports using the same encryption key for all columns, which is useful in 
a number of scenarios. However, misuse of this feature can break the NIST limit 
on the number of AES GCM operations with one key, as reported in PARQUET-2040. 
We will develop a limit-enforcing code and provide a Python API for uniform 
encryption, similarly to PARQUET-2040 and based on ARROW-9947.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (ARROW-14114) [C++][Parquet] Reading an encrypted parquet with FileReader.ReadTable() multithreaded sometimes fails

2021-09-24 Thread Maya Anderson (Jira) 
Maya Anderson created ARROW-14114:
-

 Summary: [C++][Parquet] Reading an encrypted parquet with 
FileReader.ReadTable() multithreaded sometimes fails
 Key: ARROW-14114
 URL: https://issues.apache.org/jira/browse/ARROW-14114
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++, Parquet
Affects Versions: 4.0.0
Reporter: Maya Anderson
Assignee: Maya Anderson


Reading an encrypted parquet with FileReader.ReadTable() multithreaded (with 
set_use_threads(true) ) sometimes fails decryption finalization and sometimes 
fails with Segmentation fault.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (ARROW-13593) [C++][Dataset][Parquet] Support parquet modular encryption in the new Dataset API

2021-08-10 Thread Maya Anderson (Jira) 
Maya Anderson created ARROW-13593:
-

 Summary: [C++][Dataset][Parquet] Support parquet modular 
encryption in the new Dataset API
 Key: ARROW-13593
 URL: https://issues.apache.org/jira/browse/ARROW-13593
 Project: Apache Arrow
  Issue Type: New Feature
  Components: C++, Parquet
Reporter: Maya Anderson
Assignee: Maya Anderson


In order for the new Dataset API to fully support PME, the same writer 
properties that include file_encryption_properties shouldn’t be used for the 
whole dataset. file_encryption_properties should be per file, for example in 
order to support key rotation https://issues.apache.org/jira/browse/ARROW-9960 .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)