Re: R Date class lost when column used for partitioning

2024-03-01 Thread Andrew Piskorski
On Fri, Mar 01, 2024 at 03:39:54PM -0900, Bryce Mecum wrote: > Try specifying a schema to `open_dataset` with d1 specified as > date32[day]. When I do that, I get the correct type for that field and > the values look correct too. > > schm <- schema(bb) > new_schm <- schm$SetField(6,

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Jean-Baptiste Onofré
+1 (non binding) Regards JB On Fri, Mar 1, 2024 at 12:33 PM Andrew Lamb wrote: > > Hello, > > As we have discussed[1][2] I would like to vote on the proposal to > create a new Apache Top Level Project for DataFusion. The text of the > proposed resolution and background document is copy/pasted

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Denny Lee
+1 (non-binding) On Fri, Mar 1, 2024 at 18:58 kazuyuki tanimura wrote: > +1 (non-binding) > > Kazu > > > On Mar 1, 2024, at 5:44 PM, L. C. Hsieh wrote: > > > > +1 (binding) > > > > On Fri, Mar 1, 2024 at 1:25 PM Joris Van den Bossche > > wrote: > >> > >> +1 (binding) > >> > >> On Fri, 1 Mar

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread kazuyuki tanimura
+1 (non-binding) Kazu > On Mar 1, 2024, at 5:44 PM, L. C. Hsieh wrote: > > +1 (binding) > > On Fri, Mar 1, 2024 at 1:25 PM Joris Van den Bossche > wrote: >> >> +1 (binding) >> >> On Fri, 1 Mar 2024 at 22:18, Sutou Kouhei wrote: >>> >>> +1 >>> >>> In >>> "[VOTE] Move Arrow DataFusion

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread L. C. Hsieh
+1 (binding) On Fri, Mar 1, 2024 at 1:25 PM Joris Van den Bossche wrote: > > +1 (binding) > > On Fri, 1 Mar 2024 at 22:18, Sutou Kouhei wrote: > > > > +1 > > > > In > > "[VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project" > > on Fri, 1 Mar 2024 06:33:08 -0500, > >

[DISCUSS] [FlightSQL] Supporting parameters and prepared statements with a stateless server

2024-03-01 Thread Adam Curtis
Hello, We would like to support prepared statements with bind parameters with a stateless service. This was discussed previously on the mailing list [1]. The original ticket outlining the proposed design can be found here [2]. I have prepared a specific proposal and would like feedback in

Re: R Date class lost when column used for partitioning

2024-03-01 Thread Bryce Mecum
Hi Andrew, thanks for the question. Try specifying a schema to `open_dataset` with d1 specified as date32[day]. When I do that, I get the correct type for that field and the values look correct too. schm <- schema(bb) new_schm <- schm$SetField(6, arrow::field("d1", arrow::date32())) bb <-

Re: [VOTE] Protocol for Dissociated Arrow IPC Transports

2024-03-01 Thread Matt Topol
> @pgwhalen: As a potential "end user developer," (and aspiring contributor) this immediately excited me when I first saw it. Yay! Good to hear that! > @pgwhalen: And it wasn't clear to me whether updating batches in place (and the producer/consumer coordination that comes with that) was

Re: [VOTE] Flight RPC: add 'fallback' URI scheme

2024-03-01 Thread Sutou Kouhei
+1 In <421fbc7b-f441-4b0a-8626-a8d2dfff0...@app.fastmail.com> "[VOTE] Flight RPC: add 'fallback' URI scheme" on Tue, 27 Feb 2024 09:01:36 -0500, "David Li" wrote: > I would like to propose a 'reuse connection' URI scheme for Flight RPC. This > proposal was previously discussed at [1]. A

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Joris Van den Bossche
+1 (binding) On Fri, 1 Mar 2024 at 22:18, Sutou Kouhei wrote: > > +1 > > In > "[VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project" > on Fri, 1 Mar 2024 06:33:08 -0500, > Andrew Lamb wrote: > > > Hello, > > > > As we have discussed[1][2] I would like to vote on the

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Sutou Kouhei
+1 In "[VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project" on Fri, 1 Mar 2024 06:33:08 -0500, Andrew Lamb wrote: > Hello, > > As we have discussed[1][2] I would like to vote on the proposal to > create a new Apache Top Level Project for DataFusion. The text of the >

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Daniël Heres
+1 (binding) On Fri, Mar 1, 2024, 19:05 Chao Sun wrote: > +1 (non-binding) > > On Fri, Mar 1, 2024 at 9:59 AM QP Hou wrote: > > > +1 (binding) > > > > exciting milestone :) > > > > On Fri, Mar 1, 2024 at 9:49 AM David Li wrote: > > > > > > +1 > > > > > > On Fri, Mar 1, 2024, at 12:06, Jorge

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Chao Sun
+1 (non-binding) On Fri, Mar 1, 2024 at 9:59 AM QP Hou wrote: > +1 (binding) > > exciting milestone :) > > On Fri, Mar 1, 2024 at 9:49 AM David Li wrote: > > > > +1 > > > > On Fri, Mar 1, 2024, at 12:06, Jorge Cardoso Leitão wrote: > > > +1 - great work!!! > > > > > > On Fri, Mar 1, 2024 at

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Matt Topol
+1 (binding) On Fri, Mar 1, 2024, 12:58 PM QP Hou wrote: > +1 (binding) > > exciting milestone :) > > On Fri, Mar 1, 2024 at 9:49 AM David Li wrote: > > > > +1 > > > > On Fri, Mar 1, 2024, at 12:06, Jorge Cardoso Leitão wrote: > > > +1 - great work!!! > > > > > > On Fri, Mar 1, 2024 at 5:49 PM

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread QP Hou
+1 (binding) exciting milestone :) On Fri, Mar 1, 2024 at 9:49 AM David Li wrote: > > +1 > > On Fri, Mar 1, 2024, at 12:06, Jorge Cardoso Leitão wrote: > > +1 - great work!!! > > > > On Fri, Mar 1, 2024 at 5:49 PM Micah Kornfield > > wrote: > > > >> +1 (binding) > >> > >> On Friday, March 1,

Re: [VOTE] Flight RPC: add 'fallback' URI scheme

2024-03-01 Thread David Li
My vote: +1 On Wed, Feb 28, 2024, at 15:50, Joel Lubinitsky wrote: > +1 > > On Wed, Feb 28, 2024 at 3:22 PM Andrew Lamb wrote: > >> +1 >> >> >> On Tue, Feb 27, 2024 at 9:06 AM David Li wrote: >> >> > I would like to propose a 'reuse connection' URI scheme for Flight RPC. >> > This proposal was

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread David Li
+1 On Fri, Mar 1, 2024, at 12:06, Jorge Cardoso Leitão wrote: > +1 - great work!!! > > On Fri, Mar 1, 2024 at 5:49 PM Micah Kornfield > wrote: > >> +1 (binding) >> >> On Friday, March 1, 2024, Uwe L. Korn wrote: >> >> > +1 (binding) >> > >> > On Fri, Mar 1, 2024, at 2:37 PM, Andy Grove wrote:

VectorSchemaRoot reuse when using dictionary encoded field

2024-03-01 Thread Juan Vimberg
Hi folks! I'm trying to use a dictionary encoded field but I'm not sure how to do so and keep reusing the same VectorSchemaRoot. All the examples I could find recreate the SchemaRoot. I saw somebody had the same question a while ago and was directed

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Jorge Cardoso Leitão
+1 - great work!!! On Fri, Mar 1, 2024 at 5:49 PM Micah Kornfield wrote: > +1 (binding) > > On Friday, March 1, 2024, Uwe L. Korn wrote: > > > +1 (binding) > > > > On Fri, Mar 1, 2024, at 2:37 PM, Andy Grove wrote: > > > +1 (binding) > > > > > > On Fri, Mar 1, 2024 at 6:20 AM Weston Pace > >

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Wes McKinney
+1 (binding) On Fri, Mar 1, 2024 at 09:49 Micah Kornfield wrote: > +1 (binding) > > On Friday, March 1, 2024, Uwe L. Korn wrote: > > > +1 (binding) > > > > On Fri, Mar 1, 2024, at 2:37 PM, Andy Grove wrote: > > > +1 (binding) > > > > > > On Fri, Mar 1, 2024 at 6:20 AM Weston Pace > > wrote: >

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Micah Kornfield
+1 (binding) On Friday, March 1, 2024, Uwe L. Korn wrote: > +1 (binding) > > On Fri, Mar 1, 2024, at 2:37 PM, Andy Grove wrote: > > +1 (binding) > > > > On Fri, Mar 1, 2024 at 6:20 AM Weston Pace > wrote: > > > >> +1 (binding) > >> > >> On Fri, Mar 1, 2024 at 3:33 AM Andrew Lamb > wrote: > >>

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Uwe L. Korn
+1 (binding) On Fri, Mar 1, 2024, at 2:37 PM, Andy Grove wrote: > +1 (binding) > > On Fri, Mar 1, 2024 at 6:20 AM Weston Pace wrote: > >> +1 (binding) >> >> On Fri, Mar 1, 2024 at 3:33 AM Andrew Lamb wrote: >> >> > Hello, >> > >> > As we have discussed[1][2] I would like to vote on the proposal

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Andy Grove
+1 (binding) On Fri, Mar 1, 2024 at 6:20 AM Weston Pace wrote: > +1 (binding) > > On Fri, Mar 1, 2024 at 3:33 AM Andrew Lamb wrote: > > > Hello, > > > > As we have discussed[1][2] I would like to vote on the proposal to > > create a new Apache Top Level Project for DataFusion. The text of the

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Weston Pace
+1 (binding) On Fri, Mar 1, 2024 at 3:33 AM Andrew Lamb wrote: > Hello, > > As we have discussed[1][2] I would like to vote on the proposal to > create a new Apache Top Level Project for DataFusion. The text of the > proposed resolution and background document is copy/pasted below > > If the

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.9.1 RC1

2024-03-01 Thread Andrew Lamb
+1 (binding) Verified on M3 mac Thank you Raphael Andrew On Fri, Mar 1, 2024 at 2:45 AM L. C. Hsieh wrote: > > +1 (binding) > > Verified on M1 Mac. > > Thanks Raphael. > > > On Thu, Feb 29, 2024 at 11:10 PM Raphael Taylor-Davies > wrote: > > > > Hi, > > > > I would like to propose a release

[VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread Andrew Lamb
Hello, As we have discussed[1][2] I would like to vote on the proposal to create a new Apache Top Level Project for DataFusion. The text of the proposed resolution and background document is copy/pasted below If the community is in favor of this, we plan to submit the resolution to the ASF board

Re: [DISCUSS][RFC] Draft Proposal for new Top Level Project for DataFusion

2024-03-01 Thread Andrew Lamb
Thank you everyone for your help and support on this document. Other edits to the document were: 1. Added existing arrow committer and DataFusion / arrow-rs contributor yangjiang Yang Jiang (ebay) to proposed committer list (was not included initially inadvertently) 2. Add Wes to the proposed PMC