Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 25.0.0 RC3

2023-05-22 Thread Andrew Lamb
+1 (binding) Thanks Andy On Sat, May 20, 2023 at 1:05 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks Andy. > > On Sat, May 20, 2023 at 6:41 AM Andy Grove wrote: > > > > Hi, > > > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > >

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-22 Thread Weston Pace
Trying to settle on one option is a fruitless endeavor. Each type has pros and cons. I would also predict that the largest existing usage of Arrow is shuttling data from one system to another. The newly proposed format doesn't appear to have any significant advantage for that use case (if

[RESULT][VOTE][RUST] Release Apache Arrow Rust 40.0.0 RC1

2023-05-22 Thread Raphael Taylor-Davies
With 4 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-40.0.0/ It has also been released to crates.io Thank you to everyone who helped verify this release Raphael On 20/05/2023 20:47, Will Jones wrote:

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-22 Thread Will Jones
Hello Arrow devs, I don't understand why we would start deprecating features in the Arrow > format. Even starting this talk might already be a bad idea PR-wise. > I agree we don't want to make breaking changes to the Arrow format. But several maintainers have already stated they have no interest

[VOTE][Format] Add experimental ArrowDeviceArray to C-Data API

2023-05-22 Thread Matt Topol
Hello, Now that there's a rough consensus and a toy example POC[1], I would like to propose an official enhancement to the Arrow C-Data API specification as described in the PR[2]. The new ArrowDeviceArray/ArrowDeviceArrayStream structs would be considered "experimental" and the documentation

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-22 Thread Andrew Lamb
Can someone help distill down the primary rationale and usecase for adding ArrayView to the Arrow Spec? >From the above discussions, the stated rationale seems to be fast (zero-copy) interchange with Velox. This thread has qualitatively enumerated the benefits of (offset+len) encoding over the

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-22 Thread Antoine Pitrou
Hi, I don't understand why we would start deprecating features in the Arrow format. Even starting this talk might already be a bad idea PR-wise. As for implementing conversions at the I/O boundary, it's a reasonably policy, but it still requires work by implementors and it's not granted

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.6.0 RC1

2023-05-22 Thread Raphael Taylor-Davies
With 4 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-object-store-rs-0.6.0/ It has also been released to crates.io Thank you to everyone who helped verify this release Raphael On 18/05/2023 10:25,