[jira] [Commented] (PARQUET-2212) Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634575#comment-17634575 ] ASF GitHub Bot commented on PARQUET-2212: - parthchandra commented on code in PR #1008: URL:

[GitHub] [parquet-mr] parthchandra commented on a diff in pull request #1008: PARQUET-2212: Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread GitBox
parthchandra commented on code in PR #1008: URL: https://github.com/apache/parquet-mr/pull/1008#discussion_r1023355113 ## parquet-hadoop/src/main/java/org/apache/parquet/ParquetReadOptions.java: ## @@ -44,6 +46,9 @@ public class ParquetReadOptions { private static final int

[jira] [Commented] (PARQUET-2213) Add an alternative InputFile.newStream that allow an input range

2022-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634446#comment-17634446 ] ASF GitHub Bot commented on PARQUET-2213: - sunchao commented on PR #1010: URL:

[GitHub] [parquet-mr] sunchao commented on pull request #1010: PARQUET-2213: add InputFile.newStream with a read range

2022-11-15 Thread GitBox
sunchao commented on PR #1010: URL: https://github.com/apache/parquet-mr/pull/1010#issuecomment-1315616637 Thanks @steveloughran . I like your idea of introducing a builder api, although we need to think how it can be used by different implementations of `InputFile`, not only for Hadoop.

[jira] [Resolved] (PARQUET-2206) Microbenchmark for ColumnReadaer ReadBatch and Skip

2022-11-15 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved PARQUET-2206. - Fix Version/s: cpp-11.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (PARQUET-2206) Microbenchmark for ColumnReadaer ReadBatch and Skip

2022-11-15 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated PARQUET-2206: Component/s: parquet-cpp > Microbenchmark for ColumnReadaer ReadBatch and Skip >

[jira] [Assigned] (PARQUET-2206) Microbenchmark for ColumnReadaer ReadBatch and Skip

2022-11-15 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned PARQUET-2206: --- Assignee: fatemah > Microbenchmark for ColumnReadaer ReadBatch and Skip >

[jira] [Commented] (PARQUET-2213) Add an alternative InputFile.newStream that allow an input range

2022-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634325#comment-17634325 ] ASF GitHub Bot commented on PARQUET-2213: - steveloughran commented on code in PR #1010: URL:

[GitHub] [parquet-mr] steveloughran commented on a diff in pull request #1010: PARQUET-2213: add InputFile.newStream with a read range

2022-11-15 Thread GitBox
steveloughran commented on code in PR #1010: URL: https://github.com/apache/parquet-mr/pull/1010#discussion_r1022697746 ## parquet-common/src/main/java/org/apache/parquet/io/InputFile.java: ## @@ -41,4 +41,16 @@ public interface InputFile { */ SeekableInputStream

[jira] [Commented] (PARQUET-632) Parquet file in invalid state while writing to S3 from EMR

2022-11-15 Thread Emil Kleszcz (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634320#comment-17634320 ] Emil Kleszcz commented on PARQUET-632: -- The same issue was observed in spark 3.2.1 when writing a

[jira] [Commented] (PARQUET-2212) Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634301#comment-17634301 ] ASF GitHub Bot commented on PARQUET-2212: - ggershinsky commented on code in PR #1008: URL:

[GitHub] [parquet-mr] ggershinsky commented on a diff in pull request #1008: PARQUET-2212: Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread GitBox
ggershinsky commented on code in PR #1008: URL: https://github.com/apache/parquet-mr/pull/1008#discussion_r1022648985 ## parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ColumnChunkPageReadStore.java: ## @@ -133,11 +135,33 @@ public DataPage readPage() { public

[jira] [Commented] (PARQUET-2212) Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634292#comment-17634292 ] ASF GitHub Bot commented on PARQUET-2212: - ggershinsky commented on code in PR #1008: URL:

[GitHub] [parquet-mr] ggershinsky commented on a diff in pull request #1008: PARQUET-2212: Add ByteBuffer api for decryptors to allow direct memory to be decrypted

2022-11-15 Thread GitBox
ggershinsky commented on code in PR #1008: URL: https://github.com/apache/parquet-mr/pull/1008#discussion_r1022637484 ## parquet-hadoop/src/main/java/org/apache/parquet/ParquetReadOptions.java: ## @@ -44,6 +46,9 @@ public class ParquetReadOptions { private static final int