Troubleshooting large number of nested items

I am attempting to troubleshoot and provide a patch if I am capable for ARROW-2367 (https://issues.apache.org/jira/browse/ARROW-2367). From what I can tell from gdb on a debug build of master, I believe the issue to be lists in individual rows in an Pandas dataframe/series being stored as a single

[jira] [Created] (ARROW-2397) Document changes in Tensor encoding in IPC.md.

Robert Nishihara created ARROW-2397: --- Summary: Document changes in Tensor encoding in IPC.md. Key: ARROW-2397 URL: https://issues.apache.org/jira/browse/ARROW-2397 Project: Apache Arrow Iss

Re: Aapche process questions

Yes, that is correct. We don't want to create confusion between releases made by the Apache project and unofficial development releases On Wed, Apr 4, 2018, 10:17 PM Andy Grove wrote: > Wes, > > We talked about nightlies and downstream dependencies and I just want to be > clear I'm understanding

Some more info on Rust and crates.io

So, I'm still learning about the Rust packaging process too.I tried releasing my project DataFusion by specifying the Arrow github repo as a dependency instead of referencing crates.io and this is the error I received. I thought it would be worth sharing. $ cargo publish Updating registry `htt

Re: Aapche process questions

Wes, We talked about nightlies and downstream dependencies and I just want to be clear I'm understanding what you are suggesting. Apologies if I'm being a bit slow. I think we are in agreement that nightlies make sense for now because things are moving fast and this Rust library is very new. I c

[jira] [Created] (ARROW-2396) Unify Rust Errors

Maximilian Roos created ARROW-2396: -- Summary: Unify Rust Errors Key: ARROW-2396 URL: https://issues.apache.org/jira/browse/ARROW-2396 Project: Apache Arrow Issue Type: Improvement

Re: Aapche process questions

Hi Andy, You're free to do whatever you like outside of Apache infrastructure -- I don't think we can have the apache/arrow Travis publishing artifacts to crates.io, though. If you want to have some scripts in the repo to help with creating nightlies, that's totally fine, but this isn't something

[jira] [Created] (ARROW-2395) [Python] Correct flake8 errors outside of benchmarks

Alex Hagerman created ARROW-2395: Summary: [Python] Correct flake8 errors outside of benchmarks Key: ARROW-2395 URL: https://issues.apache.org/jira/browse/ARROW-2395 Project: Apache Arrow Iss

[jira] [Created] (ARROW-2394) [Python] Correct flake8 errors in benchmarks

Alex Hagerman created ARROW-2394: Summary: [Python] Correct flake8 errors in benchmarks Key: ARROW-2394 URL: https://issues.apache.org/jira/browse/ARROW-2394 Project: Apache Arrow Issue Type:

Re: Aapche process questions

Wes, Thanks for the feedback. A nightly release sounds appealing in these early days. Technically, I assume this is just a case of configuring travis to update the minor version number and run a "cargo publish" on master once per day (if there are changes)? >From a process point of view, what is

[jira] [Created] (ARROW-2393) [C++] arrow/status.h does not define ARROW_CHECK needed for ARROW_CHECK_OK

dennis lucero created ARROW-2393: Summary: [C++] arrow/status.h does not define ARROW_CHECK needed for ARROW_CHECK_OK Key: ARROW-2393 URL: https://issues.apache.org/jira/browse/ARROW-2393 Project: Apa

Re: What do people think about a one day get together?

I'm +1 on the idea of a Arrow conference. June is a pretty busy month for me, so I would prefer another time, but I can arrange to make it if we do it then. - Wes On Wed, Apr 4, 2018 at 1:06 PM, Siddharth Teotia wrote: > +1. I would love to attend. > > On Tue, Apr 3, 2018 at 4:18 PM, Kevin Moore

Re: What do people think about a one day get together?

+1. I would love to attend. On Tue, Apr 3, 2018 at 4:18 PM, Kevin Moore wrote: > Sounds great. Quilt Data may be able to sponsor some of the refreshment > costs. > > > Kevin Moore > CEO, Quilt Data, Inc. > ke...@quiltdata.io | LinkedIn > (415) 497-

[jira] [Created] (ARROW-2392) pyarrow RecordBatchStreamWriter allows writing batches with different schemas

Ernesto Ocampo created ARROW-2392: - Summary: pyarrow RecordBatchStreamWriter allows writing batches with different schemas Key: ARROW-2392 URL: https://issues.apache.org/jira/browse/ARROW-2392 Project

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

I didn't realize one needs chrome to use google meet, so it'll be a minute or so before I'm there. On Wed, Apr 4, 2018 at 11:54 AM Wes McKinney wrote: > hi Sidd -- your e-mail is on the Google calendar invite, not sure how > to send a link to it > > Here is the link for the meeting: https://meet

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

hi Sidd -- your e-mail is on the Google calendar invite, not sure how to send a link to it Here is the link for the meeting: https://meet.google.com/vtm-teks-phx On Wed, Apr 4, 2018 at 11:48 AM, Siddharth Teotia wrote: > Can someone please send me the link to gcal? For some reason it has > vanis

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

Got it: https://meet.google.com/vtm-teks-phx On Wed, Apr 4, 2018 at 8:48 AM, Siddharth Teotia wrote: > Can someone please send me the link to gcal? For some reason it has > vanished from my calendar. > > On Wed, Apr 4, 2018 at 7:49 AM, Li Jin wrote: > >> Sorry I have a conflict today so won't b

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

Can someone please send me the link to gcal? For some reason it has vanished from my calendar. On Wed, Apr 4, 2018 at 7:49 AM, Li Jin wrote: > Sorry I have a conflict today so won't be able to join. > > Li > > On Wed, Apr 4, 2018 at 1:53 AM, Bhaskar Mookerji > wrote: > > > Can someone attending

Re: Arrow sync tomorrow: 12:00 US/Eastern, please review packaging thread

Sorry I have a conflict today so won't be able to join. Li On Wed, Apr 4, 2018 at 1:53 AM, Bhaskar Mookerji wrote: > Can someone attending this send out notes afterwards? It would be very much > appreciated. > > Thanks, > Buro > > On Tue, Apr 3, 2018 at 2:44 PM, Wes McKinney wrote: > > > hi fo

Re: Aapche process questions

hi Andy, > My argument for doing this is that although other Rust developers can set up > a github dependency in their Cargo,toml, this just isn't a natural way to > work in Rust so we are making it hard for people to experiment with Arrow. Being penalized by the language for not using a centra

[jira] [Created] (ARROW-2391) Segmentation fault from PyArrow when mapping Pandas datetime column to pyarrow.date64

Dave Challis created ARROW-2391: --- Summary: Segmentation fault from PyArrow when mapping Pandas datetime column to pyarrow.date64 Key: ARROW-2391 URL: https://issues.apache.org/jira/browse/ARROW-2391 Pro

Aapche process questions

Hi, I've been creating some frustrations for myself this week because I'm not sure how to work efficiently now that the Rust version of Apache Arrow is in the official Apache repo. It seems I have two conflicting requirements: 1. I want Apache Arrow [Rust] to be a community-driven high quality p

Re: Next Arrow sync call

Please add me as well. On Thu, Mar 29, 2018 at 3:36 PM Li Jin wrote: > Please add me in the gcal invite too. Thx > On Thu, Mar 29, 2018 at 3:12 PM Paul Taylor wrote: > > > I'd like to join the gcal invite as well. Thanks! > > > > > On Mar 29, 2018, at 11:10 AM, Wes McKinney > wrote: > > > > >

[jira] [Created] (ARROW-2390) [C++/Python] CheckPyError() could inspect exception type

Antoine Pitrou created ARROW-2390: - Summary: [C++/Python] CheckPyError() could inspect exception type Key: ARROW-2390 URL: https://issues.apache.org/jira/browse/ARROW-2390 Project: Apache Arrow

[jira] [Created] (ARROW-2389) [C++] Add StatusCode::OverflowError

Antoine Pitrou created ARROW-2389: - Summary: [C++] Add StatusCode::OverflowError Key: ARROW-2389 URL: https://issues.apache.org/jira/browse/ARROW-2389 Project: Apache Arrow Issue Type: Wish