[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969483#comment-16969483 ] Xinli Shang commented on PARQUET-1681: -- Hi [~rdblue], do you still remember or document it

[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Ryan Blue (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969493#comment-16969493 ] Ryan Blue commented on PARQUET-1681: Looks like it might be 

[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Ryan Blue (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969491#comment-16969491 ] Ryan Blue commented on PARQUET-1681: I think we should be able to work around this instead of

[jira] [Assigned] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinli Shang reassigned PARQUET-1681: Assignee: Xinli Shang > Avro's isElementType() change breaks the reading of some

[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Ryan Blue (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969489#comment-16969489 ] Ryan Blue commented on PARQUET-1681: The Avro check should ignore record names if the record is the

[jira] [Comment Edited] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Xinli Shang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969483#comment-16969483 ] Xinli Shang edited comment on PARQUET-1681 at 11/7/19 6:28 PM: --- Hi

Re: [VOTE] Add BYTE_STREAM_SPLIT encoding to Apache Parquet

2019-11-07 Thread Gabor Szadovszky
+1 for adding BYTE_STREAM_SPLIT encoding to parquet-format. On Tue, Nov 5, 2019 at 11:22 PM Wes McKinney wrote: > +1 from me on adding the FP encoding > > On Sat, Nov 2, 2019 at 4:51 AM Radev, Martin wrote: > > > > Hello all, > > > > > > thanks for the vote Ryan and to Wes for the feedback. >

[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969911#comment-16969911 ] Fokko Driesprong commented on PARQUET-1681: --- [~rdblue] AVRO-2400 was a huge regression bug

[jira] [Resolved] (PARQUET-1645) Bump Apache Avro to 1.9.1

2019-11-07 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved PARQUET-1645. --- Resolution: Duplicate > Bump Apache Avro to 1.9.1 > - > >

[jira] [Commented] (PARQUET-1645) Bump Apache Avro to 1.9.1

2019-11-07 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969904#comment-16969904 ] Fokko Driesprong commented on PARQUET-1645: --- Thanks for tagging me in here. Allow me to

[jira] [Commented] (PARQUET-1645) Bump Apache Avro to 1.9.1

2019-11-07 Thread Michael Heuer (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969351#comment-16969351 ] Michael Heuer commented on PARQUET-1645: I am very curious about this – Parquet vs Avro version

[jira] [Created] (PARQUET-1688) [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7

2019-11-07 Thread Kouhei Sutou (Jira)
Kouhei Sutou created PARQUET-1688: - Summary: [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7 Key: PARQUET-1688 URL: https://issues.apache.org/jira/browse/PARQUET-1688

[jira] [Commented] (PARQUET-1688) [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7

2019-11-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969731#comment-16969731 ] Wes McKinney commented on PARQUET-1688: --- I think this duplicates ARROW-7088 > [C++]

Re: [VOTE] Add BYTE_STREAM_SPLIT encoding to Apache Parquet

2019-11-07 Thread Junjie Chen
+1 from me to add BYTE_STREAM_SPLIT to parquet-format. Gabor Szadovszky 于2019年11月7日周四 下午6:07写道： > > +1 for adding BYTE_STREAM_SPLIT encoding to parquet-format. > > On Tue, Nov 5, 2019 at 11:22 PM Wes McKinney wrote: > > > +1 from me on adding the FP encoding > > > > On Sat, Nov 2, 2019 at 4:51

[jira] [Commented] (PARQUET-1688) [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7

2019-11-07 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969737#comment-16969737 ] Wes McKinney commented on PARQUET-1688: --- in PARQUET. I'll close ARROW-7088 > [C++]

[jira] [Updated] (PARQUET-1396) Cryptodata Interface for Schema Activation of Parquet Encryption

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky updated PARQUET-1396: -- Fix Version/s: (was: 1.11.0) > Cryptodata Interface for Schema Activation of

[jira] [Commented] (PARQUET-1396) Cryptodata Interface for Schema Activation of Parquet Encryption

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969043#comment-16969043 ] Gabor Szadovszky commented on PARQUET-1396: --- As it is related to encryption which is not

[jira] [Commented] (PARQUET-1397) Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969044#comment-16969044 ] Gabor Szadovszky commented on PARQUET-1397: --- As it is related to encryption which is not

[jira] [Updated] (PARQUET-1397) Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky updated PARQUET-1397: -- Fix Version/s: (was: 1.11.0) > Sample of usage Parquet-1396 and Parquet-1178 for

[jira] [Commented] (PARQUET-1645) Bump Apache Avro to 1.9.1

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969045#comment-16969045 ] Gabor Szadovszky commented on PARQUET-1645: --- [~fokko], is it really targeted to 1.11.0? >

[jira] [Resolved] (PARQUET-1667) Close InputStream after usage

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1667. --- Resolution: Won't Fix Based on the discussion in the PR I'm closing this. > Close

[jira] [Commented] (PARQUET-1676) Remove hive modules

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969049#comment-16969049 ] Gabor Szadovszky commented on PARQUET-1676: --- The parent PARQUET-1666 is targeted to 1.12.0.

[jira] [Commented] (PARQUET-1408) parquet-tools SimpleRecord does not display empty fields

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969038#comment-16969038 ] Gabor Szadovszky commented on PARQUET-1408: --- As this issue is not a regression since 1.10.0

[jira] [Updated] (PARQUET-1408) parquet-tools SimpleRecord does not display empty fields

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky updated PARQUET-1408: -- Fix Version/s: (was: 1.11.0) > parquet-tools SimpleRecord does not display empty

[GitHub] [parquet-site] gszadovszky merged pull request #1: PARQUET-1674: The announcement email on the web site does not comply with ASF rules

2019-11-07 Thread GitBox
gszadovszky merged pull request #1: PARQUET-1674: The announcement email on the web site does not comply with ASF rules URL: https://github.com/apache/parquet-site/pull/1 This is an automated message from the Apache Git

[jira] [Updated] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky updated PARQUET-1681: -- Fix Version/s: (was: 1.11.0) > Avro's isElementType() change breaks the reading

[jira] [Commented] (PARQUET-1681) Avro's isElementType() change breaks the reading of some parquet(1.8.1) files

2019-11-07 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969042#comment-16969042 ] Gabor Szadovszky commented on PARQUET-1681: --- I am removing the target 1.11.0 as this is an

Merged C++ Parquet Encryption implementation PARQUET-1300

2019-11-07 Thread Wes McKinney
hi folks, I recently merged https://github.com/apache/arrow/pull/4826 containing the bulk of the Parquet C++ encrypted file implementation: https://github.com/apache/arrow/commit/41753ace481a82dea651c54639ec4adbae169187 This patch has been in progress for over a year with numerous rounds of

[jira] [Comment Edited] (PARQUET-1688) [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7

2019-11-07 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969734#comment-16969734 ] Kouhei Sutou edited comment on PARQUET-1688 at 11/8/19 1:56 AM: Oh,

[jira] [Commented] (PARQUET-1688) [C++] StreamWriter/StreamReader can't be built with g++ 4.8.5 on CentOS 7

2019-11-07 Thread Kouhei Sutou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969734#comment-16969734 ] Kouhei Sutou commented on PARQUET-1688: --- Oh, sorry. I missed it. Should we track this in ARROW-