[RESULT] [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-21 Thread Antoine Pitrou
Hello, The vote succeeds with 3 +1 (binding) and 2 +1 (non-binding). I'll soon open a JIRA for the specification and the C++ implementation, so that we can merge those timely. Regards Antoine. On Tue, 11 Feb 2020 20:06:33 +0100 Antoine Pitrou wrote: > Hello, > > We have been discussing

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-18 Thread Wes McKinney
A week has passed, I would say we should move forward with merging patches related to this. Any last words (in the next 12 hours or so)? On Tue, Feb 18, 2020 at 7:48 AM Krisztián Szűcs wrote: > > +1 (binding) > > On Tue, Feb 18, 2020 at 10:47 AM Antoine Pitrou wrote: > > > > > > There has also

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-18 Thread Krisztián Szűcs
+1 (binding) On Tue, Feb 18, 2020 at 10:47 AM Antoine Pitrou wrote: > > > There has also been interest from DuckDB: > https://github.com/cwida/duckdb/issues/151 > > Regards > > Antoine. > > > On Tue, 18 Feb 2020 02:37:43 -0600 > Wes McKinney wrote: > > As I recall TFX developers weighed in that

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-18 Thread Antoine Pitrou
There has also been interest from DuckDB: https://github.com/cwida/duckdb/issues/151 Regards Antoine. On Tue, 18 Feb 2020 02:37:43 -0600 Wes McKinney wrote: > As I recall TFX developers weighed in that this would be helpful for > TensorFlow-related use cases where they are concerns about

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-18 Thread Wes McKinney
As I recall TFX developers weighed in that this would be helpful for TensorFlow-related use cases where they are concerns about C++ ABI compatibility. Since this project has been ongoing for about 5 months (see also related discussion around implementation guidelines for third parties [1]) there

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-17 Thread Micah Kornfield
I reviewed the spec again (not the implementation). I'm +1 on this. I was wondering if we shared/received feedback on this with any other communities? Thanks, Micah On Sun, Feb 16, 2020 at 8:13 PM Micah Kornfield wrote: > I will try to review tomorrow and cast a vote. > > On Fri, Feb 14,

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-16 Thread Micah Kornfield
I will try to review tomorrow and cast a vote. On Fri, Feb 14, 2020 at 5:41 AM Wes McKinney wrote: > There is only 1 binding +1 vote so far, we should probably wait for > three before closing the vote (it's possible that lazy consensus could > be employed here but not much harm in waiting a few

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-14 Thread Wes McKinney
There is only 1 binding +1 vote so far, we should probably wait for three before closing the vote (it's possible that lazy consensus could be employed here but not much harm in waiting a few more days) On Thu, Feb 13, 2020 at 8:15 PM Francois Saint-Jacques wrote: > > +1 > > On Thu, Feb 13, 2020

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-13 Thread Francois Saint-Jacques
+1 On Thu, Feb 13, 2020 at 9:08 PM Fan Liya wrote: > > +1 (binding) > > On Thu, Feb 13, 2020 at 11:52 AM Wes McKinney wrote: > > > +1 (binding) > > > > On Tue, Feb 11, 2020 at 4:29 PM Antoine Pitrou wrote: > > > > > > > > > Ah, you're right, it's PR 6040: > > >

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-13 Thread Fan Liya
+1 (binding) On Thu, Feb 13, 2020 at 11:52 AM Wes McKinney wrote: > +1 (binding) > > On Tue, Feb 11, 2020 at 4:29 PM Antoine Pitrou wrote: > > > > > > Ah, you're right, it's PR 6040: > > https://github.com/apache/arrow/pull/6040 > > > > Similarly, the C++ implementation is at PR 6026: > >

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-12 Thread Wes McKinney
+1 (binding) On Tue, Feb 11, 2020 at 4:29 PM Antoine Pitrou wrote: > > > Ah, you're right, it's PR 6040: > https://github.com/apache/arrow/pull/6040 > > Similarly, the C++ implementation is at PR 6026: > https://github.com/apache/arrow/pull/6026 > > Regards > > Antoine. > > > Le 11/02/2020 à

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-11 Thread Antoine Pitrou
Ah, you're right, it's PR 6040: https://github.com/apache/arrow/pull/6040 Similarly, the C++ implementation is at PR 6026: https://github.com/apache/arrow/pull/6026 Regards Antoine. Le 11/02/2020 à 23:17, Wes McKinney a écrit : > hi Antoine, PR 5442 seems to no longer be the right one.

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-11 Thread Wes McKinney
hi Antoine, PR 5442 seems to no longer be the right one. Which open PR contains the specification now? On Tue, Feb 11, 2020 at 1:06 PM Antoine Pitrou wrote: > > > Hello, > > We have been discussing the creation of a minimalist C-based data > interface for applications to exchange Arrow columnar

[VOTE] Adopt Arrow in-process C Data Interface specification

2020-02-11 Thread Antoine Pitrou
Hello, We have been discussing the creation of a minimalist C-based data interface for applications to exchange Arrow columnar data structures with each other. Some notable features of this interface include: * A small amount of header-only C code can be copied independently into third-party

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-09 Thread Antoine Pitrou
Right, I'll give it a try in a few days. Best regards Antoine. Le 09/12/2019 à 12:46, Wes McKinney a écrit : > While it's unfortunate to have to re-examine some basic design issues > at this stage, I agree with Jacques's point that it would be nice if > we can accommodate (without great

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-09 Thread Wes McKinney
While it's unfortunate to have to re-examine some basic design issues at this stage, I agree with Jacques's point that it would be nice if we can accommodate (without great hardship) the use case where a stream/pipeline of record batches are passed in C that does not require the called function to

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-08 Thread Fan Liya
+1, as this is useful IMO. Best, Liya Fan On Sat, Dec 7, 2019 at 12:21 PM Jacques Nadeau wrote: > -1 (binding) > > I'm voting -1 on this. I posted the thinking why on the PR. The high-level > is that I think it needs to better address the pipelined use case as right > now it fails to support

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-06 Thread Jacques Nadeau
-1 (binding) I'm voting -1 on this. I posted the thinking why on the PR. The high-level is that I think it needs to better address the pipelined use case as right now it fails to support that at all and has too much weight to ignore that use case. I actually would have posted it here but totally

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-06 Thread Wes McKinney
Hello, Could more PMC members take a look at this work? Thank you On Tue, Dec 3, 2019 at 1:50 PM Neal Richardson wrote: > > +1 (non-binding) > > On Tue, Dec 3, 2019 at 10:56 AM Wes McKinney wrote: > > > +1 (binding) > > > > On Tue, Dec 3, 2019 at 12:54 PM Wes McKinney wrote: > > > > > >

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-03 Thread Neal Richardson
+1 (non-binding) On Tue, Dec 3, 2019 at 10:56 AM Wes McKinney wrote: > +1 (binding) > > On Tue, Dec 3, 2019 at 12:54 PM Wes McKinney wrote: > > > > hello, > > > > We have been discussing the creation of a minimalist C-based data > > interface for applications to exchange Arrow columnar data

Re: [VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-03 Thread Wes McKinney
+1 (binding) On Tue, Dec 3, 2019 at 12:54 PM Wes McKinney wrote: > > hello, > > We have been discussing the creation of a minimalist C-based data > interface for applications to exchange Arrow columnar data structures > with each other. Some notable features of this interface include: > > * A

[VOTE] Adopt Arrow in-process C Data Interface specification

2019-12-03 Thread Wes McKinney
hello, We have been discussing the creation of a minimalist C-based data interface for applications to exchange Arrow columnar data structures with each other. Some notable features of this interface include: * A small amount of header-only C code can be copied into downstream applications, no