[
https://issues.apache.org/jira/browse/ARROW-15986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511127#comment-17511127
]
Maya Anderson commented on ARROW-15986:
---------------------------------------
[~jorisvandenbossche] , [~apitrou] , There is a problem with this suggestion of
exposing the {{FileDecryptionProperties}} as they are currently exposed in C++,
in that it doesn't enable external key material, which is WIP. See
[https://docs.google.com/document/d/13EysCNC6-Nu9wnJ8YpdzmD-aMLn4i2KXUJTNqIihy7A/edit#]
.
Therefore, before we can expose PME in the new dataset API in Python, there is
work needed in the C++ layer, which is being addressed by ARROW-13593 .
> [Python] Expose decryption properties in ParquetFragmentScanOptions
> -------------------------------------------------------------------
>
> Key: ARROW-15986
> URL: https://issues.apache.org/jira/browse/ARROW-15986
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Parquet, Python
> Reporter: Antoine Pitrou
> Priority: Critical
> Fix For: 8.0.0
>
>
> Parquet modular encryption is now available in the Python Parquet APIs.
> However, it's not available through datasets, as
> {{ParquetFragmentScanOptions}} currently doesn't expose the
> {{FileDecryptionProperties}} (it does in C++).
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
