[jira] [Assigned] (PARQUET-2103) crypto exception in print toPrettyJSON

2023-01-11 Thread Gidon Gershinsky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gidon Gershinsky reassigned PARQUET-2103: - Assignee: Gidon Gershinsky > crypto exception in print toPrettyJSON >

[jira] [Updated] (PARQUET-2103) crypto exception in print toPrettyJSON

2023-01-11 Thread Gidon Gershinsky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gidon Gershinsky updated PARQUET-2103: -- Affects Version/s: 1.12.3 > crypto exception in print toPrettyJSON >

[jira] [Updated] (PARQUET-2103) crypto exception in print toPrettyJSON

2023-01-11 Thread Gidon Gershinsky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gidon Gershinsky updated PARQUET-2103: -- Priority: Minor (was: Major) > crypto exception in print toPrettyJSON >

[jira] [Commented] (PARQUET-2212) Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2023-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675813#comment-17675813 ] ASF GitHub Bot commented on PARQUET-2212: - wgtmac commented on code in PR #1008: URL:

[GitHub] [parquet-mr] wgtmac commented on a diff in pull request #1008: PARQUET-2212: Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2023-01-11 Thread GitBox
wgtmac commented on code in PR #1008: URL: https://github.com/apache/parquet-mr/pull/1008#discussion_r1067699349 ## parquet-format-structures/src/main/java/org/apache/parquet/format/BlockCipher.java: ## @@ -51,17 +52,26 @@ * @param AAD - Additional Authenticated Data for

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2023-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675706#comment-17675706 ] ASF GitHub Bot commented on PARQUET-2160: - Kimahriman commented on PR #982: URL:

[GitHub] [parquet-mr] Kimahriman commented on pull request #982: PARQUET-2160: Close ZstdInputStream to free off-heap memory in time.

2023-01-11 Thread GitBox
Kimahriman commented on PR #982: URL: https://github.com/apache/parquet-mr/pull/982#issuecomment-1379431375 same, we have certain jobs that can't function without a patched jar. Seems to get worse with the more columns you read. Our worst offender (table with thousands of columns), can

[jira] [Commented] (PARQUET-2075) Unified Rewriter Tool

2023-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675613#comment-17675613 ] ASF GitHub Bot commented on PARQUET-2075: - wgtmac commented on code in PR #1014: URL:

[jira] [Commented] (PARQUET-2075) Unified Rewriter Tool

2023-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675611#comment-17675611 ] ASF GitHub Bot commented on PARQUET-2075: - wgtmac commented on code in PR #1014: URL:

[GitHub] [parquet-mr] wgtmac commented on a diff in pull request #1014: PARQUET-2075: Implement unified file rewriter

2023-01-11 Thread GitBox
wgtmac commented on code in PR #1014: URL: https://github.com/apache/parquet-mr/pull/1014#discussion_r1067083773 ## parquet-hadoop/src/test/java/org/apache/parquet/hadoop/rewrite/ParquetRewriterTest.java: ## @@ -0,0 +1,308 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [parquet-mr] wgtmac commented on a diff in pull request #1014: PARQUET-2075: Implement unified file rewriter

2023-01-11 Thread GitBox
wgtmac commented on code in PR #1014: URL: https://github.com/apache/parquet-mr/pull/1014#discussion_r1067082884 ## parquet-hadoop/src/test/java/org/apache/parquet/hadoop/rewrite/ParquetRewriterTest.java: ## @@ -0,0 +1,308 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Commented] (PARQUET-2075) Unified Rewriter Tool

2023-01-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675610#comment-17675610 ] ASF GitHub Bot commented on PARQUET-2075: - wgtmac commented on code in PR #1014: URL:

[GitHub] [parquet-mr] wgtmac commented on a diff in pull request #1014: PARQUET-2075: Implement unified file rewriter

2023-01-11 Thread GitBox
wgtmac commented on code in PR #1014: URL: https://github.com/apache/parquet-mr/pull/1014#discussion_r1067082250 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/rewrite/RewriteOptions.java: ## @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF)