[
https://issues.apache.org/jira/browse/PARQUET-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035421#comment-17035421
]
Gidon Gershinsky commented on PARQUET-1178:
-------------------------------------------
[~jasbru] Currently, this can't be run on a Databricks cluster - besides the
Thrift structures in parquet-format-2.7.0, it will also require a Java
implementation of parquet encryption and key management libraries (not merged
yet, but we're working on this).
> Parquet modular encryption
> --------------------------
>
> Key: PARQUET-1178
> URL: https://issues.apache.org/jira/browse/PARQUET-1178
> Project: Parquet
> Issue Type: New Feature
> Reporter: Gidon Gershinsky
> Assignee: Gidon Gershinsky
> Priority: Major
>
> A mechanism for modular encryption and decryption of Parquet files. Allows to
> keep data fully encrypted in the storage - while enabling efficient analytics
> on the data, via reader-side extraction / authentication / decryption of data
> subsets required by columnar projection and predicate push-down.
> Enables fine-grained access control to column data by encrypting different
> columns with different keys.
> Supports a number of encryption algorithms, to account for different security
> and performance requirements.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
