[GitHub] [parquet-mr] ggershinsky commented on pull request #615: PARQUET-1373: Encryption key tools

2020-06-25 Thread GitBox
ggershinsky commented on pull request #615: URL: https://github.com/apache/parquet-mr/pull/615#issuecomment-649588181 @gszadovszky the 055bb39 is the squash of all commits that address the latest review round This is an

[jira] [Commented] (PARQUET-1373) Encryption key management tools

2020-06-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144968#comment-17144968 ] ASF GitHub Bot commented on PARQUET-1373: - ggershinsky commented on pull request #615: URL:

RE: Proposal for CompressionCodec Provider-aware Compression Codec Lookup for parquet-mr

2020-06-25 Thread Xu, Cheng A
Hi Micahm, thank you for your suggestions. We have a sync discussing this in Parquet sync up meeting. Besides the meta data items suggested by you (compression level and block size), we will also provide information like vendor name, versions. Will refine the proposal further

Re: [DISCUSS] Ongoing LZ4 problems with Parquet files

2020-06-25 Thread Antoine Pitrou
Le 25/06/2020 à 00:02, Wes McKinney a écrit : > hi folks, > > (cross-posting to dev@arrow and dev@parquet since there are > stakeholders in both places) > > It seems there are still problems at least with the C++ implementation > of LZ4 compression in Parquet files > >

[jira] [Commented] (PARQUET-1879) Apache Arrow can not read a Parquet File written with Parqet-Avro 1.11.0 with a Map field

2020-06-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144855#comment-17144855 ] ASF GitHub Bot commented on PARQUET-1879: - maccamlc commented on pull request #798: URL:

[GitHub] [parquet-mr] maccamlc commented on pull request #798: PARQUET-1879 MapKeyValue is not a valid Logical Type

2020-06-25 Thread GitBox
maccamlc commented on pull request #798: URL: https://github.com/apache/parquet-mr/pull/798#issuecomment-649482253 > Thank you for creating the backward compatibility test for Map. It should have been existed already. > Unfortunately, this way you do not properly test backward