[jira] [Comment Edited] (PARQUET-1025) Support new min-max statistics in parquet-mr

2017-10-30 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225566#comment-16225566 ] Zoltan Ivanfi edited comment on PARQUET-1025 at 10/30/17 7:30 PM: -- Ah,

[jira] [Commented] (PARQUET-1025) Support new min-max statistics in parquet-mr

2017-10-30 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225566#comment-16225566 ] Zoltan Ivanfi commented on PARQUET-1025: Ah, no, sorry. I started working on in June/July, but

[jira] [Assigned] (PARQUET-1025) Support new min-max statistics in parquet-mr

2017-10-30 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Ivanfi reassigned PARQUET-1025: -- Assignee: (was: Zoltan Ivanfi) > Support new min-max statistics in parquet-mr >

[jira] [Commented] (PARQUET-1025) Support new min-max statistics in parquet-mr

2017-10-30 Thread Lars Volker (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225545#comment-16225545 ] Lars Volker commented on PARQUET-1025: -- [~zi] - Can you give a brief update on this effort? Are you

[jira] [Created] (PARQUET-1152) Parquet-thrift doesn't compile with Thrift 0.9.3

2017-10-30 Thread Nandor Kollar (JIRA)
Nandor Kollar created PARQUET-1152: -- Summary: Parquet-thrift doesn't compile with Thrift 0.9.3 Key: PARQUET-1152 URL: https://issues.apache.org/jira/browse/PARQUET-1152 Project: Parquet

Re: Best way to read parquet files from HDFS parquet-cpp

2017-10-30 Thread Felipe Aramburu
Thanks Wes! Very useful Felipe On Mon, Oct 30, 2017 at 9:55 AM, Wes McKinney wrote: > hi Felipe -- you need to check the Status results returned by these > Arrow function calls. Possibly one of the calls is failing, but the > failure is going unchecked. > > If you compile

Re: Best way to read parquet files from HDFS parquet-cpp

2017-10-30 Thread Wes McKinney
hi Felipe -- you need to check the Status results returned by these Arrow function calls. Possibly one of the calls is failing, but the failure is going unchecked. If you compile with clang, it will warn you when you forget to check a Status. If you use C++ exceptions for error handling, it may

[jira] [Commented] (PARQUET-1151) [C++] Add build options / configuration to use static runtime libraries with MSVC

2017-10-30 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224995#comment-16224995 ] Wes McKinney commented on PARQUET-1151: --- [~Max Risuhin] could you advise about this? See e-mail

Re: Windows Static Libs

2017-10-30 Thread Wes McKinney
Opened two JIRAs for this https://issues.apache.org/jira/browse/ARROW-1755 https://issues.apache.org/jira/browse/PARQUET-1151 Let's discuss there -- I will ping Max Risuhin who has done a bunch of work on the Windows side of the build systems for Arrow and Parquet - Wes On Sun, Oct 29, 2017 at

[jira] [Created] (PARQUET-1151) [C++] Add build options / configuration to use static runtime libraries with MSVC

2017-10-30 Thread Wes McKinney (JIRA)
Wes McKinney created PARQUET-1151: - Summary: [C++] Add build options / configuration to use static runtime libraries with MSVC Key: PARQUET-1151 URL: https://issues.apache.org/jira/browse/PARQUET-1151

Re: Migrating parquet-cpp to gitbox

2017-10-30 Thread Wes McKinney
Thanks. I opened https://issues.apache.org/jira/browse/INFRA-15402 On Mon, Oct 30, 2017 at 3:52 AM, Uwe L. Korn wrote: > +1, please go ahead. This is improved my Arrow workflow a lot, happy to > see it for Parquet, too. > > On Mon, Oct 30, 2017, at 06:16 AM, Lars Volker wrote:

Re: Best way to read parquet files from HDFS parquet-cpp

2017-10-30 Thread Uwe L. Korn
Hello Felipe, from a brief look, this code seems to be fine. Note that in the recent version of Arrow, HdfsClient was merged into HadoopFileSystem and thus the code will slightly differ there (should be only naming changes for you). You should update to avoid running into any difficulties because

[jira] [Resolved] (PARQUET-1150) C++: Hide statically linked boost symbols

2017-10-30 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved PARQUET-1150. -- Resolution: Fixed Issue resolved by pull request 416

Best way to read parquet files from HDFS parquet-cpp

2017-10-30 Thread Felipe Aramburu
I tried making some simple changes to the reader-writer.cc example to test it working with hdfs. I am pretty sure I have set up my hdfs properly because I can do things like create directories. I copied over the parquet file generate by the test to hdfs and tried to load it in as follows: