Proposal for CompressionCodec Provider-aware Compression Codec Lookup for parquet-mr

2020-06-03 Thread Dong, Xin
Hi, All, The existing Parquet compress codec framework only supports codec name based compression implementation lookup. And it's one-2-one mapping which means only one implementation is supported given a codec name. However, there are various implementations for the same codec name. And

[jira] [Commented] (PARQUET-1827) UUID type currently not supported by parquet-mr

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125026#comment-17125026 ] ASF GitHub Bot commented on PARQUET-1827: - shangxinli commented on a change in pull request

[GitHub] [parquet-mr] shangxinli commented on a change in pull request #778: PARQUET-1827: UUID type currently not supported by parquet-mr

2020-06-03 Thread GitBox
shangxinli commented on a change in pull request #778: URL: https://github.com/apache/parquet-mr/pull/778#discussion_r434631781 ## File path: parquet-avro/src/test/java/org/apache/parquet/avro/TestAvroSchemaConverter.java ## @@ -766,6 +768,33 @@ public void

[jira] [Commented] (PARQUET-1827) UUID type currently not supported by parquet-mr

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124935#comment-17124935 ] ASF GitHub Bot commented on PARQUET-1827: - gszadovszky commented on a change in pull request

[GitHub] [parquet-mr] gszadovszky commented on a change in pull request #778: PARQUET-1827: UUID type currently not supported by parquet-mr

2020-06-03 Thread GitBox
gszadovszky commented on a change in pull request #778: URL: https://github.com/apache/parquet-mr/pull/778#discussion_r434550078 ## File path: parquet-avro/src/test/java/org/apache/parquet/avro/TestAvroSchemaConverter.java ## @@ -766,6 +768,33 @@ public void

[jira] [Commented] (PARQUET-1842) Update Jackson Databind version to address CVE

2020-06-03 Thread Patrick OFriel (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124919#comment-17124919 ] Patrick OFriel commented on PARQUET-1842: - Really appreciate the update [~gszadovszky] , thanks

[jira] [Commented] (PARQUET-1866) Replace Hadoop ZSTD with JNI-ZSTD

2020-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124682#comment-17124682 ] ASF GitHub Bot commented on PARQUET-1866: - gszadovszky merged pull request #793: URL:

[jira] [Resolved] (PARQUET-1866) Replace Hadoop ZSTD with JNI-ZSTD

2020-06-03 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1866. --- Resolution: Fixed > Replace Hadoop ZSTD with JNI-ZSTD >

[GitHub] [parquet-mr] gszadovszky merged pull request #793: PARQUET-1866: Replace Hadoop ZSTD with JNI-ZSTD

2020-06-03 Thread GitBox
gszadovszky merged pull request #793: URL: https://github.com/apache/parquet-mr/pull/793 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (PARQUET-1842) Update Jackson Databind version to address CVE

2020-06-03 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124675#comment-17124675 ] Gabor Szadovszky commented on PARQUET-1842: --- [~pofriel], we are intensively working on