Re: [VOTE][RUST] Release Apache Arrow Rust 6.4.0 RC1

2021-12-13 Thread Neal Richardson
+1 Ran the verification script on aarch64-apple-darwin. Neal On Mon, Dec 13, 2021 at 12:09 AM Benson Muite wrote: > +1 non binding. Ran script on Rocky Linux 8. > > Steps: > dnf -y update > dnf -y install gcc tar git > git clone https://github.com/apache/arrow-rs > cd arrow-rs/dev/release > ba

Re: [VOTE][RUST] Release Apache Arrow Rust 6.4.0 RC1

2021-12-13 Thread Jorge Cardoso Leitão
+1 Thank you! On Fri, Dec 10, 2021 at 9:50 PM Andy Grove wrote: > +1 (binding) > > Thank you, Andrew, and everyone else involved in the input validation work. > This definitely helps address one of the biggest criticisms of the crate. > > Andy. > > On Fri, Dec 10, 2021 at 12:30 PM Andrew Lamb

Re: [VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-13 Thread David Li
Are any other PMC members able to look at this? > > > OK by me. We could also create a branch to merge the PRs add the > > > integration tests, and then merge all at once. Kyle, is this an ok solution? Would you & your team be able to get integration tests done reasonably soon? There's some se

Re: [VOTE] Proposed addition to Arrow Flight: Arrow Flight RPC

2021-12-13 Thread Kyle Porter
Thanks David, Yes, the team is actually already looking at adding the cross language tests apologies for not communicating that earlier On Mon., Dec. 13, 2021, 12:18 p.m. David Li, wrote: > Are any other PMC members able to look at this? > > > > > OK by me. We could also create a branch to mer

[Rust] Comparison kernels for DictionaryArrays and scalars

2021-12-13 Thread Andrew Lamb
Matthew Turner and I have been working on working out how specialized dictionary / scalar comparison kernels would work in arrow on [1]. We have been playing around with possible APIs (e.g. `eq_dyn_scalar`) and would love any additional community suggestions / comments Thank you, Andrew [1] htt

Re: [VOTE][RUST] Release Apache Arrow Rust 6.4.0 RC1

2021-12-13 Thread Jörn Horstmann
+1 (non-binding) Successfully ran the integration tests of our engine against the specified commit On Mon, Dec 13, 2021 at 5:09 PM Jorge Cardoso Leitão < jorgecarlei...@gmail.com> wrote: > +1 > > Thank you! > > On Fri, Dec 10, 2021 at 9:50 PM Andy Grove wrote: > > > +1 (binding) > > > > Thank y

Re: [DISCUSS] Adding new columnar memory layouts to Arrow (in-memory, IPC, C ABI)

2021-12-13 Thread Andrew Lamb
Thank you for writing this down Wes I think my project is very interested in the RLE encoding and constant view. The StringView, as written, seems fairly tightly tied to C/C++, though I may be mistaken. I think allowing Rust to consume such StringViews would be possible but it seems very unlikely

Re: [DISCUSS] Adding new columnar memory layouts to Arrow (in-memory, IPC, C ABI)

2021-12-13 Thread Micah Kornfield
Hi Wes, I'm also in favor of most of this, I need to think more about the new list layout, and I think the RLE encoding as proposed contains redundancies with dictionary encoding data we might not want. A further question on this, do you expect all of this to be packaged up as a RecordBatch for IP