Re: Apache Parquet for .NET

2017-11-27 Thread Ryan Blue
Ivan, It would be great to have you join the Parquet community. We have bi-weekly sync over Google Hangouts that you might want to join so we can talk about it. rb On Thu, Nov 23, 2017 at 7:11 AM, Wes McKinney wrote: > hi Ivan, > > I would be excited to have you join the

[jira] [Commented] (PARQUET-1064) Deprecate type-defined sort ordering for INTERVAL type

2017-11-27 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267688#comment-16267688 ] Ryan Blue commented on PARQUET-1064: I don't have an opinion either way. I would have left out the

[jira] [Commented] (PARQUET-845) Efficient storage for several INT_8 and INT_16

2017-11-27 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267680#comment-16267680 ] Ryan Blue commented on PARQUET-845: --- Parquet will use an efficient encoding by default and you can see

[jira] [Comment Edited] (PARQUET-845) Efficient storage for several INT_8 and INT_16

2017-11-27 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264329#comment-16264329 ] Fernando Pereira edited comment on PARQUET-845 at 11/27/17 6:28 PM:

[jira] [Comment Edited] (PARQUET-845) Efficient storage for several INT_8 and INT_16

2017-11-27 Thread Fernando Pereira (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264329#comment-16264329 ] Fernando Pereira edited comment on PARQUET-845 at 11/27/17 6:21 PM:

[jira] [Commented] (PARQUET-1064) Deprecate type-defined sort ordering for INTERVAL type

2017-11-27 Thread Zoltan Ivanfi (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267128#comment-16267128 ] Zoltan Ivanfi commented on PARQUET-1064: On a second thought, even though the comparison order

[jira] [Commented] (PARQUET-1166) [API Proposal] Add GetRecordBatchReader in parquet/arrow/reader.h

2017-11-27 Thread Xianjin YE (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266954#comment-16266954 ] Xianjin YE commented on PARQUET-1166: - All right then, I will send pr soon and will try to reuse

Re: parquet-cpp question : ParquetFileWriter and Arrow schema conversion

2017-11-27 Thread Wes McKinney
You can see some sample usages in the Cython wrappers of this code for Python: https://github.com/apache/arrow/blob/master/python/pyarrow/_parquet.pyx On Mon, Nov 27, 2017 at 6:58 AM, Sandeep Joshi wrote: > thanks! Is there sample code on how to use these APIs to learn

[jira] [Commented] (PARQUET-1166) [API Proposal] Add GetRecordBatchReader in parquet/arrow/reader.h

2017-11-27 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266926#comment-16266926 ] Wes McKinney commented on PARQUET-1166: --- Sounds good to me. This is actually already basically the

Re: parquet-cpp question : ParquetFileWriter and Arrow schema conversion

2017-11-27 Thread Sandeep Joshi
thanks! Is there sample code on how to use these APIs to learn best practices ? I am looking at https://github.com/apache/arrow/tree/master/cpp/src/arrow/python but that only covers Arrow itself -Sandeep On Sun, Nov 26, 2017 at 9:57 PM, Wes McKinney wrote: > I think you