[
https://issues.apache.org/jira/browse/PARQUET-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860940#comment-15860940
]
Uwe L. Korn commented on PARQUET-678:
-------------------------------------
Adding them to parquet-cpp and parquet-format is easy, the only thing that
looks a bit harder from my side is to add to Hadoop as a codec so it can be
used in parquet-mr. At least for Zstd, this seems to be done already:
https://issues.apache.org/jira/browse/HADOOP-13578
> Allow for custom compression codecs
> -----------------------------------
>
> Key: PARQUET-678
> URL: https://issues.apache.org/jira/browse/PARQUET-678
> Project: Parquet
> Issue Type: Wish
> Reporter: Steven Anton
> Priority: Minor
>
> I understand that the list of accepted compression codecs is explicity
> limited to uncompressed, snappy, gzip, and lzo. (See
> parquet.hadoop.metadata.CompressionCodecName.java) Is there a reason for
> this? Or is there an easy workaround? On the surface it seems like an
> unnecessary restriction.
> I ask because I have written a custom codec to implement encryption and I'm
> unable to use it with Parquet, which is a real shame because it is the main
> storage format I was hoping to use.
> Other thoughts on how to implement encryption in Parquet with this limitation?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
