[jira] [Created] (ARROW-2008) [Python] Type inference for int32 NumPy arrays as list return int64 and then conversion fails

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2008: --- Summary: [Python] Type inference for int32 NumPy arrays as list return int64 and then conversion fails Key: ARROW-2008 URL: https://issues.apache.org/jira/browse/ARROW-2008

[jira] [Created] (ARROW-2007) [Python] Sequence converter for float32 not implemented

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2007: --- Summary: [Python] Sequence converter for float32 not implemented Key: ARROW-2007 URL: https://issues.apache.org/jira/browse/ARROW-2007 Project: Apache Arrow

[jira] [Created] (ARROW-2006) [C++] Add option to trim excess padding when writing IPC messages

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2006: --- Summary: [C++] Add option to trim excess padding when writing IPC messages Key: ARROW-2006 URL: https://issues.apache.org/jira/browse/ARROW-2006 Project: Apache Arrow

Help triaging Arrow GitHub issues

2018-01-17 Thread Wes McKinney
hi folks, We have 23 open issues on GitHub: https://github.com/apache/arrow/issues While having the GitHub issues is helpful for capturing bug reports and lightweight interactions with the community, it isn't a good long-term place to manage the project's development roadmap or priorities --

[jira] [Created] (ARROW-2005) [Python] pyflakes warnings on Cython files not failing build

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2005: --- Summary: [Python] pyflakes warnings on Cython files not failing build Key: ARROW-2005 URL: https://issues.apache.org/jira/browse/ARROW-2005 Project: Apache Arrow

Re: Arrow-Parquet converters in Java

2018-01-17 Thread Li Jin
Hi Sidd, Thanks for the information. This could be a very useful tool. Li On Wed, Jan 17, 2018 at 3:05 PM, Siddharth Teotia wrote: > Hi Li, > > We do have support for Parquet <-> Arrow reader/writer in Dremio OSS. > Please take a look here: > >

Re: Trying to build to build pyarrow for python 2.7

2018-01-17 Thread simba nyatsanga
Hi Wes, Great, thanks for the information. On Tue, 16 Jan 2018 at 20:19 Wes McKinney wrote: > hi Simba -- the PyPI / pip wheels will only be updated when there is a > new release. We'll either make a 0.8.1 release or 0.9.0 sometime in > February depending on how

[jira] [Created] (ARROW-2004) [C++] Add shrink_to_fit option in BufferBuilder::Resize

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2004: --- Summary: [C++] Add shrink_to_fit option in BufferBuilder::Resize Key: ARROW-2004 URL: https://issues.apache.org/jira/browse/ARROW-2004 Project: Apache Arrow

Re: Arrow policy on rewriting git history?

2018-01-17 Thread Robert Nishihara
Got it (I remember that discussion actually). The status quo is OK for us.. longer term we'll switch to using releases. On Wed, Jan 17, 2018 at 7:50 AM Wes McKinney wrote: > We have been rebasing master after releases so that the release tag > (and commits for the

Arrow-Parquet converters in Java

2018-01-17 Thread Li Jin
Hey folks, I know this is supported in C++, but is there a library to convert between Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow format to Parquet files). Jacques and Sidd, does Dremio has some library to do this? Thanks, Li

[jira] [Created] (ARROW-2003) [Python] Do not use deprecated kwarg in pandas.core.internals.make_block

2018-01-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-2003: --- Summary: [Python] Do not use deprecated kwarg in pandas.core.internals.make_block Key: ARROW-2003 URL: https://issues.apache.org/jira/browse/ARROW-2003 Project: Apache

Re: Arrow policy on rewriting git history?

2018-01-17 Thread Wes McKinney
We have been rebasing master after releases so that the release tag (and commits for the changelog, Java package metadata, etc.) appears in master. This only affects PRs merged while the release vote is open, but it's understandably not ideal. There was a prior mailing list thread where we