[jira] [Commented] (PARQUET-2069) Parquet file containing arrays, written by Parquet-MR, cannot be read again by Parquet-MR

2022-11-02 Thread Sabarishan (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628086#comment-17628086 ] Sabarishan commented on PARQUET-2069: - Is there a plan to fix this issue ? I have encountered the

Re: Add FilteredPageReader to filter rows based on page statistics

2022-11-02 Thread Fatemah Panahi
What do we think about introducing a dependency on arrow::compute::Expression for specifying and evaluating the filter? Is that acceptable? On Tue, Nov 1, 2022 at 10:42 AM Fatemah Panahi wrote: > Hi Micah, > > Answers inline. > > Another item that we need to think about is whether we want to >

[jira] [Commented] (PARQUET-2196) Support LZ4_RAW codec

2022-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627833#comment-17627833 ] ASF GitHub Bot commented on PARQUET-2196: - shangxinli merged PR #1000: URL:

[jira] [Commented] (PARQUET-2196) Support LZ4_RAW codec

2022-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627757#comment-17627757 ] ASF GitHub Bot commented on PARQUET-2196: - shangxinli commented on PR #1000: URL:

[GitHub] [parquet-mr] shangxinli commented on pull request #1000: PARQUET-2196: Support LZ4_RAW codec

2022-11-02 Thread GitBox
shangxinli commented on PR #1000: URL: https://github.com/apache/parquet-mr/pull/1000#issuecomment-1300583034 LGTM, let's see if there are comments from others, otherwise we can merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [parquet-mr] shangxinli merged pull request #995: PARQUET-1711: support recursive proto schemas by limiting recursion depth

2022-11-02 Thread GitBox
shangxinli merged PR #995: URL: https://github.com/apache/parquet-mr/pull/995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (PARQUET-1711) [parquet-protobuf] stack overflow when work with well known json type

2022-11-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627754#comment-17627754 ] ASF GitHub Bot commented on PARQUET-1711: - shangxinli merged PR #995: URL:

[GitHub] [parquet-mr] shangxinli commented on pull request #995: PARQUET-1711: support recursive proto schemas by limiting recursion depth

2022-11-02 Thread GitBox
shangxinli commented on PR #995: URL: https://github.com/apache/parquet-mr/pull/995#issuecomment-1300567095 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: Modular encryption to support arrays and nested arrays

2022-11-02 Thread nicolas paris
Thanks for your help. > > The goal is to make the exception print something like: > *Caused by: org.apache.parquet.crypto.ParquetCryptoRuntimeException: > Encrypted column [rider] not in file schema column list: [foo] , > [rider.list.element.foo] , [rider.list.element.bar] , [ts] , [uuid]* >

[jira] [Assigned] (PARQUET-2209) [C++] Optimize skip for the case that number of values to skip equals page size

2022-11-02 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned PARQUET-2209: --- Assignee: fatemah > [C++] Optimize skip for the case that number of values to

[jira] [Resolved] (PARQUET-2209) [C++] Optimize skip for the case that number of values to skip equals page size

2022-11-02 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved PARQUET-2209. - Fix Version/s: cpp-11.0.0 Resolution: Fixed Issue resolved by pull request