[jira] [Commented] (PARQUET-1968) FilterApi support In predicate

2021-05-25 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351199#comment-17351199 ] Xinli Shang commented on PARQUET-1968: -- Go ahead to work on it. Thanks Huaxin! >

Re: Parquet sync meeting May 2021

2021-05-25 Thread Micah Kornfield
> > Iceberg filtering / V2 api > 3. > Adopt Arrow as data model Curious if more notes, or discussion around the two points above will happen on the mailing list? Or are there relevant JIRAs? Thanks, Micah On Tue, May 25, 2021 at 9:45 AM Xinli shang wrote: > 5/25/2021 > > Atten

Parquet sync meeting May 2021

2021-05-25 Thread Xinli shang
5/25/2021 Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky 1. Parquet 1.12.0 post release issues: 1. Release 1.12.1? Let's wait a bit since the testing and integration is still going on. Better to have more fixes for the release. 2. Two integer overfl

[jira] [Commented] (PARQUET-2052) Integer overflow when writing huge binary using dictionary encoding

2021-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351192#comment-17351192 ] ASF GitHub Bot commented on PARQUET-2052: - sunchao commented on pull request #9

[jira] [Commented] (PARQUET-1968) FilterApi support In predicate

2021-05-25 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351193#comment-17351193 ] Huaxin Gao commented on PARQUET-1968: - [~shangxinli] [~rdblue] Hi Xinli and Ryan, I

[GitHub] [parquet-mr] sunchao commented on pull request #910: PARQUET-2052: Integer overflow when writing huge binary using dictionary encoding

2021-05-25 Thread GitBox
sunchao commented on pull request #910: URL: https://github.com/apache/parquet-mr/pull/910#issuecomment-848039158 Thanks @gszadovszky and @shangxinli for taking a look. > It is another question if all the encoders used for writing data pages for binary values are prepared for simila

[jira] [Commented] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList

2021-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350959#comment-17350959 ] ASF GitHub Bot commented on PARQUET-1633: - eadwright edited a comment on pull r

[GitHub] [parquet-mr] eadwright edited a comment on pull request #902: PARQUET-1633 Fix integer overflow

2021-05-25 Thread GitBox
eadwright edited a comment on pull request #902: URL: https://github.com/apache/parquet-mr/pull/902#issuecomment-847752354 @gszadovszky Awesome, appreciated. Also note the file uploaded isn't corrupt as such, it just goes beyond 32-bit limits. -- This is an automated message from the Apa

[jira] [Commented] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList

2021-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350958#comment-17350958 ] ASF GitHub Bot commented on PARQUET-1633: - eadwright commented on pull request

[GitHub] [parquet-mr] eadwright commented on pull request #902: PARQUET-1633 Fix integer overflow

2021-05-25 Thread GitBox
eadwright commented on pull request #902: URL: https://github.com/apache/parquet-mr/pull/902#issuecomment-847752354 Awesome, appreciated. Also note the file uploaded isn't corrupt as such, it just goes beyond 32-bit limits. -- This is an automated message from the Apache Git Service. To

[jira] [Created] (PARQUET-2053) Pluggable key material store

2021-05-25 Thread Gidon Gershinsky (Jira)
Gidon Gershinsky created PARQUET-2053: - Summary: Pluggable key material store Key: PARQUET-2053 URL: https://issues.apache.org/jira/browse/PARQUET-2053 Project: Parquet Issue Type: Improv

[jira] [Commented] (PARQUET-1633) Integer overflow in ParquetFileReader.ConsecutiveChunkList

2021-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350914#comment-17350914 ] ASF GitHub Bot commented on PARQUET-1633: - gszadovszky commented on pull reques

[GitHub] [parquet-mr] gszadovszky commented on pull request #902: PARQUET-1633 Fix integer overflow

2021-05-25 Thread GitBox
gszadovszky commented on pull request #902: URL: https://github.com/apache/parquet-mr/pull/902#issuecomment-847669598 @eadwright, I'll try to look into this this week and produce a java code to reproduce the issue. -- This is an automated message from the Apache Git Service. To respond