Troubleshooting large number of nested items

2018-04-04 Thread Bryant Menn
I am attempting to troubleshoot and provide a patch if I am capable for ARROW-2367 (https://issues.apache.org/jira/browse/ARROW-2367). From what I can tell from gdb on a debug build of master, I believe the issue to be lists in individual rows in an Pandas dataframe/series being stored as a single

[jira] [Created] (ARROW-2397) Document changes in Tensor encoding in IPC.md.

2018-04-04 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2397: --- Summary: Document changes in Tensor encoding in IPC.md. Key: ARROW-2397 URL: https://issues.apache.org/jira/browse/ARROW-2397 Project: Apache Arrow

Re: Aapche process questions

2018-04-04 Thread Wes McKinney
Yes, that is correct. We don't want to create confusion between releases made by the Apache project and unofficial development releases On Wed, Apr 4, 2018, 10:17 PM Andy Grove wrote: > Wes, > > We talked about nightlies and downstream dependencies and I just want to be >

Re: Aapche process questions

2018-04-04 Thread Andy Grove
Wes, We talked about nightlies and downstream dependencies and I just want to be clear I'm understanding what you are suggesting. Apologies if I'm being a bit slow. I think we are in agreement that nightlies make sense for now because things are moving fast and this Rust library is very new. I

[jira] [Created] (ARROW-2396) Unify Rust Errors

2018-04-04 Thread Maximilian Roos (JIRA)
Maximilian Roos created ARROW-2396: -- Summary: Unify Rust Errors Key: ARROW-2396 URL: https://issues.apache.org/jira/browse/ARROW-2396 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-2394) [Python] Correct flake8 errors in benchmarks

2018-04-04 Thread Alex Hagerman (JIRA)
Alex Hagerman created ARROW-2394: Summary: [Python] Correct flake8 errors in benchmarks Key: ARROW-2394 URL: https://issues.apache.org/jira/browse/ARROW-2394 Project: Apache Arrow Issue

Re: Aapche process questions

2018-04-04 Thread Andy Grove
Wes, Thanks for the feedback. A nightly release sounds appealing in these early days. Technically, I assume this is just a case of configuring travis to update the minor version number and run a "cargo publish" on master once per day (if there are changes)? >From a process point of view, what

[jira] [Created] (ARROW-2393) [C++] arrow/status.h does not define ARROW_CHECK needed for ARROW_CHECK_OK

2018-04-04 Thread dennis lucero (JIRA)
dennis lucero created ARROW-2393: Summary: [C++] arrow/status.h does not define ARROW_CHECK needed for ARROW_CHECK_OK Key: ARROW-2393 URL: https://issues.apache.org/jira/browse/ARROW-2393 Project:

Re: What do people think about a one day get together?

2018-04-04 Thread Wes McKinney
I'm +1 on the idea of a Arrow conference. June is a pretty busy month for me, so I would prefer another time, but I can arrange to make it if we do it then. - Wes On Wed, Apr 4, 2018 at 1:06 PM, Siddharth Teotia wrote: > +1. I would love to attend. > > On Tue, Apr 3, 2018

Re: What do people think about a one day get together?

2018-04-04 Thread Siddharth Teotia
+1. I would love to attend. On Tue, Apr 3, 2018 at 4:18 PM, Kevin Moore wrote: > Sounds great. Quilt Data may be able to sponsor some of the refreshment > costs. > > > Kevin Moore > CEO, Quilt Data, Inc. > ke...@quiltdata.io | LinkedIn

[jira] [Created] (ARROW-2392) pyarrow RecordBatchStreamWriter allows writing batches with different schemas

2018-04-04 Thread Ernesto Ocampo (JIRA)
Ernesto Ocampo created ARROW-2392: - Summary: pyarrow RecordBatchStreamWriter allows writing batches with different schemas Key: ARROW-2392 URL: https://issues.apache.org/jira/browse/ARROW-2392

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

2018-04-04 Thread Phillip Cloud
I didn't realize one needs chrome to use google meet, so it'll be a minute or so before I'm there. On Wed, Apr 4, 2018 at 11:54 AM Wes McKinney wrote: > hi Sidd -- your e-mail is on the Google calendar invite, not sure how > to send a link to it > > Here is the link for the

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

2018-04-04 Thread Wes McKinney
hi Sidd -- your e-mail is on the Google calendar invite, not sure how to send a link to it Here is the link for the meeting: https://meet.google.com/vtm-teks-phx On Wed, Apr 4, 2018 at 11:48 AM, Siddharth Teotia wrote: > Can someone please send me the link to gcal? For

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

2018-04-04 Thread Siddharth Teotia
Got it: https://meet.google.com/vtm-teks-phx On Wed, Apr 4, 2018 at 8:48 AM, Siddharth Teotia wrote: > Can someone please send me the link to gcal? For some reason it has > vanished from my calendar. > > On Wed, Apr 4, 2018 at 7:49 AM, Li Jin wrote:

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

2018-04-04 Thread Siddharth Teotia
Can someone please send me the link to gcal? For some reason it has vanished from my calendar. On Wed, Apr 4, 2018 at 7:49 AM, Li Jin wrote: > Sorry I have a conflict today so won't be able to join. > > Li > > On Wed, Apr 4, 2018 at 1:53 AM, Bhaskar Mookerji

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

2018-04-04 Thread Li Jin
Sorry I have a conflict today so won't be able to join. Li On Wed, Apr 4, 2018 at 1:53 AM, Bhaskar Mookerji wrote: > Can someone attending this send out notes afterwards? It would be very much > appreciated. > > Thanks, > Buro > > On Tue, Apr 3, 2018 at 2:44 PM, Wes

Re: Aapche process questions

2018-04-04 Thread Wes McKinney
hi Andy, > My argument for doing this is that although other Rust developers can set up > a github dependency in their Cargo,toml, this just isn't a natural way to > work in Rust so we are making it hard for people to experiment with Arrow. Being penalized by the language for not using a

[jira] [Created] (ARROW-2391) Segmentation fault from PyArrow when mapping Pandas datetime column to pyarrow.date64

2018-04-04 Thread Dave Challis (JIRA)
Dave Challis created ARROW-2391: --- Summary: Segmentation fault from PyArrow when mapping Pandas datetime column to pyarrow.date64 Key: ARROW-2391 URL: https://issues.apache.org/jira/browse/ARROW-2391

Aapche process questions

2018-04-04 Thread Andy Grove
Hi, I've been creating some frustrations for myself this week because I'm not sure how to work efficiently now that the Rust version of Apache Arrow is in the official Apache repo. It seems I have two conflicting requirements: 1. I want Apache Arrow [Rust] to be a community-driven high quality

Re: Next Arrow sync call

2018-04-04 Thread Phillip Cloud
Please add me as well. On Thu, Mar 29, 2018 at 3:36 PM Li Jin wrote: > Please add me in the gcal invite too. Thx > On Thu, Mar 29, 2018 at 3:12 PM Paul Taylor wrote: > > > I'd like to join the gcal invite as well. Thanks! > > > > > On Mar 29, 2018, at

[jira] [Created] (ARROW-2390) [C++/Python] CheckPyError() could inspect exception type

2018-04-04 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2390: - Summary: [C++/Python] CheckPyError() could inspect exception type Key: ARROW-2390 URL: https://issues.apache.org/jira/browse/ARROW-2390 Project: Apache Arrow

[jira] [Created] (ARROW-2389) [C++] Add StatusCode::OverflowError

2018-04-04 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-2389: - Summary: [C++] Add StatusCode::OverflowError Key: ARROW-2389 URL: https://issues.apache.org/jira/browse/ARROW-2389 Project: Apache Arrow Issue Type: Wish