Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 37.1.0 RC2

2024-04-19 Thread Andy Grove
+1 (binding) Verified on Ubuntu 24.04.4 LTS. Thanks, Andrew. On Thu, Apr 18, 2024 at 8:04 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > On Thu, Apr 18, 2024 at 2:20 PM Andrew Lamb wrote: > > > > I would like to propose a release of Apache Arrow

Re: [DISCUSSION] New Flags for Arrow C Interface Schema

2024-04-19 Thread Dewey Dunnington
Thanks for bringing this up! Could you share the motivation where this distinction is important in the context of transfer across the C data interface? The "struct == record batch" concept has always made sense to me because in R, a data.frame can have a column that is also a data.frame and there

[DISCUSSION] New Flags for Arrow C Interface Schema

2024-04-19 Thread Matt Topol
Hey everyone, With some of the other developments surrounding libraries adopting the Arrow C Data interfaces, there's been a consistent question about handling tables (record batch) vs columns vs scalars. Right now, a Record Batch is sent through the C interface as a struct column whose children

[VOTE][Format] JSON canonical extension type

2024-04-19 Thread Rok Mihevc
Hi all, Following discussions [1][2] and preliminary implementation work (by Pradeep Gollakota) [3] I would like to propose a vote to add language for JSON canonical extension type to CanonicalExtensions.rst as in PR [4] and written below. A draft C++ implementation PR can be seen here [3]. [1]

[VOTE][Format] UUID canonical extension type

2024-04-19 Thread Rok Mihevc
Hi all, Following initial requests [1][2] and recent tangential ML discussion [3] I would like to propose a vote to add language for UUID canonical extension type to CanonicalExtensions.rst as in PR [4] and written below. A draft C++ and Python implementation PR can be seen here [5]. [1]