[RESULT][VOTE][RUST] Release Apache Arrow Rust 52.0.0 RC1

2024-06-06 Thread Raphael Taylor-Davies
, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 52.0.0. This release candidate is based on commit: f42218ae5d9c9f0b9ea3365f2b1e6025a43b8c71 [1] The proposed release tarball and signatures are hosted at [2]. The changelog

[VOTE][RUST] Release Apache Arrow Rust 52.0.0 RC1

2024-06-03 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 52.0.0. This release candidate is based on commit: f42218ae5d9c9f0b9ea3365f2b1e6025a43b8c71 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [DISCUSS] Statistics through the C data interface

2024-05-31 Thread Raphael Taylor-Davies
I'm likely missing something here, but why can't statistics be returned as arrow arrays encoded using the C data interface? My understanding of the C data interface is as a specification for exchanging arrow payloads, with it left to higher level protocols, such as ADBC, to assign semantic

Re: [DISCUSS] Statistics through the C data interface

2024-05-22 Thread Raphael Taylor-Davies
Hi, One potential challenge with encoding statistics in the schema metadata is that some systems may consider this metadata as part of assessing schema equivalence. However, I think the bigger question is what the intended use-case for these statistics is? Often query engines want to

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.10.1 RC1

2024-05-14 Thread Raphael Taylor-Davies
 this release Raphael On 10/05/2024 18:29, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.10.1. This is primarily motivated by a major bug introduced by 0.10.0 [1] This release candidate is based on commit

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.10.1 RC1

2024-05-10 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.10.1. This is primarily motivated by a major bug introduced by 0.10.0 [1] This release candidate is based on commit: 3d3ddb2108502854da98654ada85364d5627ef21 [2] The proposed release tarball

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.10.0 RC1

2024-04-22 Thread Raphael Taylor-Davies
: +1(binding) Verified on m1 macbook Thanks Raphael Raphael Taylor-Davies 于 2024年4月18日周四 下午6:55写道: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.10.0. This release candidate is based on commit: cd3331989d65f6d56830f9ffa758b4c96d10f4be [1

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.10.0 RC1

2024-04-18 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.10.0. This release candidate is based on commit: cd3331989d65f6d56830f9ffa758b4c96d10f4be [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

[RESULT][VOTE][RUST] Release Apache Arrow Rust 51.0.0 RC1

2024-03-18 Thread Raphael Taylor-Davies
With 5 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-51.0.0 It has also been released to crates.io Thank you to everyone who helped verify this release On 3/15/24 20:40, Raphael Taylor-Davies wrote: Hi

[VOTE][RUST] Release Apache Arrow Rust 51.0.0 RC1

2024-03-15 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 51.0.0. This release candidate is based on commit: ada986c7ec8f8fe4f94235c8aaeba4995392ee72 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.9.1 RC1

2024-03-04 Thread Raphael Taylor-Davies
wrote: +1 (binding) Verified on M3 mac Thank you Raphael Andrew On Fri, Mar 1, 2024 at 2:45 AM L. C. Hsieh wrote: +1 (binding) Verified on M1 Mac. Thanks Raphael. On Thu, Feb 29, 2024 at 11:10 PM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.9.1 RC1

2024-02-29 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.9.1. This release candidate is based on commit: 30151220c29fa5e01365c2a4e153de01d5d2c041 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

[ANNOUNCE] New Arrow committer: Jeffrey Vo

2024-02-06 Thread Raphael Taylor-Davies
On behalf of the Arrow PMC, I am happy to announce that Jeffrey Vo has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! Raphael Taylor-Davies

Re: [Python][Rust] Is Arrow Rust supposed to support S3-compatible storage with non-public certificates?

2024-01-25 Thread Raphael Taylor-Davies
On a related note, version 0.9.0 switched to using the system CAs by default [1], and so if you've added your private CA chain into there it should work. [1]: https://github.com/apache/arrow-rs/pull/5056 On 25 January 2024 09:17:55 GMT, Raphael Taylor-Davies wrote: >The ticket for support

Re: [Python][Rust] Is Arrow Rust supposed to support S3-compatible storage with non-public certificates?

2024-01-25 Thread Raphael Taylor-Davies
The ticket for supporting self-signed certificates can be found here [1]. If you switch the TLS backend to OpenSSL it may respect the SSL_CERT_FILE environment variable, but I'm not very familiar with the particulars of that library. This would require customising the Rust build, however, which

[RESULT][VOTE][RUST] Release Apache Arrow Rust 50.0.0 RC1

2024-01-12 Thread Raphael Taylor-Davies
With 5 +1 votes (4 binding) the release is approved The release is available here: It has also been released to crates.io. Thank you to everyone who helped verify this release On 09/01/2024 10:24, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust

[VOTE][RUST] Release Apache Arrow Rust 50.0.0 RC1

2024-01-09 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 50.0.0. This release candidate is based on commit: db811083669df66992008c9409b743a2e365adb0 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.9.0 RC1

2024-01-08 Thread Raphael Taylor-Davies
With 3 +1 votes (3 binding) the release is approved The release is available here: It has also been released to crates.io. Thank you to everyone who helped verify this release On 05/01/2024 13:29, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Object

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.9.0 RC1

2024-01-05 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.9.0. This release candidate is based on commit: cb16050ec732872d5995c7420cc6858749bbf743 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

Re: [DISCUSS] [DATAFUSION] PMC for new DataFusion top level project

2023-12-20 Thread Raphael Taylor-Davies
wed by the process) >> >> From what I can tell, this means the PMC would be the following from the >> current Arrow PMC [3]: >> >> Andy Grove (NVidia) >> Andrew Lamb (InfuxData) >> Daniël Heres (Coralogix) >> Jie Wen (SelectDB) >> Kun Liu (Eb

Re: [DISCUSS] Protocol for exchanging Arrow data over REST APIs

2023-11-20 Thread Raphael Taylor-Davies
Regards, Raphael Taylor-Davies [1]: https://arrow.apache.org/docs/format/Columnar.html#ipc-streaming-format [2]: https://docs.rs/arrow-flight/latest/arrow_flight/sql/server/trait.FlightSqlService.html [3]: https://docs.rs/arrow-flight/latest/arrow_flight/encode/struct.FlightDataEncoderBuilder.html

[RESULT][VOTE][RUST] Release Apache Arrow Rust 49.0.0 RC1

2023-11-13 Thread Raphael Taylor-Davies
wrote: +1 (binding) Verified on Intel Mac. Thanks Raphael. On Tue, Nov 7, 2023 at 1:38 PM Andy Grove wrote: +1 (binding) Verified on Ubuntu 22.04.3 LTS. Thanks, Raphael. On Tue, Nov 7, 2023 at 2:22 PM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow

Re: [VOTE][RUST] Release Apache Arrow Rust 48.0.1 RC1

2023-11-09 Thread Raphael Taylor-Davies
+1 (binding) Verified on x86_64 GNU/Linux On 09/11/2023 20:31, Andrew Lamb wrote: As discussed on [5], I would like to propose a patch release of Apache Arrow Rust Implementation, version 48.0.1 to include two bug fixes. This release candidate is based on commit:

Re: decimal64

2023-11-09 Thread Raphael Taylor-Davies
Perhaps my maths is incorrect, but a decimal64 would have a maximum precision of 18, not 19? log(9223372036854775807) = 18.9? On 09/11/2023 16:01, Curt Hagenlocher wrote: Recently, someone opened an issue on GitHub ([C++] Decimal64/32 support? · Issue #38622 · apache/arrow (github.com)

[VOTE][RUST] Release Apache Arrow Rust 49.0.0 RC1

2023-11-07 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 49.0.0. This release candidate is based on commit: 747dcbf0670aeab2ede474edb3c4f22028d6a7e6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 33.0.0 RC1

2023-11-07 Thread Raphael Taylor-Davies
, 2023 at 6:41 AM Raphael Taylor-Davies wrote: I intend to cut a new arrow release later this week, I would prefer we wait for this. On 07/11/2023 11:39, Andrew Lamb wrote: Perhaps we can create an arrow 48.1.0 patch release to include the fix? On Tue, Nov 7, 2023 at 12:48 AM Will Jones wrote

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 33.0.0 RC1

2023-11-07 Thread Raphael Taylor-Davies
. That likely narrows the scope of who is affected. If this bug is present in DataFusion 33, then delta-rs will likely skip upgrading until 34. If we're the only downstream project this parsing issue affects, then I think it's fine to release. On Mon, Nov 6, 2023 at 8:22 PM Raphael Taylor-Davies wrote

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 33.0.0 RC1

2023-11-06 Thread Raphael Taylor-Davies
Hi, To further clarify the bug concerns the serde compatibility feature that allows converting a serde compatible data structure to arrow [1]. It will not impact workloads reading JSON. I am not sure this is a sufficiently fundamental bug to warrant special concern, but happy to defer to

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.8.0 RC1

2023-11-06 Thread Raphael Taylor-Davies
!' Release candidate looks good! So it looks good then. +1 if test issues can be ignored. On Thu, Nov 2, 2023 at 1:31 PM Raphael Taylor-Davies wrote: Aah, because the release script bails out on the first error? You could either: - Remove set -e from the top of the script to have it continue

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.8.0 RC1

2023-11-02 Thread Raphael Taylor-Davies
, I just felt there was prior precedent for not holding releases back on test issues. On 02/11/2023 20:07, L. C. Hsieh wrote: Hmm, I think we cannot run the verification script unless the issue is fixed? On Thu, Nov 2, 2023 at 6:40 AM Raphael Taylor-Davies wrote: Aah, that was a mistake

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.8.0 RC1

2023-11-02 Thread Raphael Taylor-Davies
"directory/child.txt" }] note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace failures: local::tests::invalid_path ``` On Thu, Nov 2, 2023 at 7:48 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Ob

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.8.0 RC1

2023-11-02 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.8.0. This release candidate is based on commit: ad211fe324d259bf9fea1c43a3a82b3c833f6d7a [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

[RESULT][VOTE][RUST] Release Apache Arrow Rust 48.0.0 RC2

2023-10-23 Thread Raphael Taylor-Davies
 this release On 18/10/2023 14:59, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 48.0.0 *RC2*. Please note that there were issues with the first release candidate that required cutting a second. This release candidate

Re: Apache Arrow file format

2023-10-18 Thread Raphael Taylor-Davies
To further what others have already mentioned, the IPC file format is primarily optimised for IPC use-cases, that is exchanging the entire contents between processes. It is relatively inexpensive to encode and decode, and supports all arrow datatypes, making it ideal for things like

[VOTE][RUST] Release Apache Arrow Rust 48.0.0 RC2

2023-10-18 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 48.0.0 *RC2*. Please note that there were issues with the first release candidate that required cutting a second. This release candidate is based on commit: 51ac6fec8755147cd6b1dfe7d76bfdcfacad0463 [1]

Re: [DISCUSS][Rust][DataFusion][HiveMetaStore] Possible Metastore integration with Data Fusion

2023-10-04 Thread Raphael Taylor-Davies
Hi, I think [1] might be a good place to start and handle coordination for this undertaking. I suspect it would probably want to live under the datafusion-contrib organisation, similar to HDFS [2] Kind Regards, Raphael [1]: https://github.com/apache/arrow-datafusion/issues/2209 [2]:

Re: [DISCUSS][C++] Raw pointer string views

2023-10-02 Thread Raphael Taylor-Davies
gView, I think it would help to get some input from those at DuckDB and Velox on their perspective Andrew On Mon, Oct 2, 2023 at 9:17 AM Raphael Taylor-Davies wrote: Oh I'm with you on it being a precedent we want to be very careful about setting, but if there isn't a meaningful performance differe

Re: [DISCUSS][C++] Raw pointer string views

2023-10-02 Thread Raphael Taylor-Davies
and dereferencing raw pointers embedded in data buffers). There could even be an argument for making some of them canonical extension types if there's enough anteriority in favor. Regards Antoine. Le 02/10/2023 à 15:00, Raphael Taylor-Davies a écrit : I think what would really help would be some

Re: [DISCUSS][C++] Raw pointer string views

2023-10-02 Thread Raphael Taylor-Davies
I think what would really help would be some concrete numbers, do we have any numbers comparing the performance of the offset and pointer based representations? If there isn't a significant performance difference between them, would the systems that currently use a pointer-based approach be

Re: [VOTE][Format] Add ListView and LargeListView Arrays to Arrow Format

2023-10-02 Thread Raphael Taylor-Davies
+1 On 02/10/2023 13:53, Antoine Pitrou wrote: Hello, +1 and thanks for working on this! There'll probably be some minor comments to the format PR, but those don't deter from accepting these new layouts into the standard. Regards Antoine. Le 29/09/2023 à 14:09, Felipe Oliveira Carvalho

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.7.1 RC1

2023-09-29 Thread Raphael Taylor-Davies
With 5 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-object-store-rs-0.7.1/ It has also been released to crates.io Thank you to everyone who helped verify this release On 26/09/2023 17:01, Raphael Taylor

Re: [VOTE][Format] Add ListView and LargeListView Arrays to Arrow Format

2023-09-29 Thread Raphael Taylor-Davies
Hi Felipe, Can I confirm that DuckDB and Velox use the same encoding for these types, and so we aren't going to run into similar issues as [1]? Kind Regards, Raphael Taylor-Davies [1]: https://lists.apache.org/thread/l8t1vj5x1wdf75mdw3wfjvnxrfy5xomy On 29/09/2023 13:09, Felipe Oliveira

Re: [DISCUSS][C++] Raw pointer string views

2023-09-28 Thread Raphael Taylor-Davies
FWIW Rust wouldn't have issues using raw pointers, I can't speak for other languages though. They would be more expensive to validate, but validation is not going to be cheap regardless. I could definitely see a world where view types use pointers and IPC coerces to/from the large non-view

Re: [DISCUSS][C++] Raw pointer string views

2023-09-27 Thread Raphael Taylor-Davies
Do you have any benchmarks comparing kernels with native pointer array support, compared to those that must first convert to the offset representation? I think this would help ground this discussion empirically. On 27 September 2023 22:25:02 BST, Benjamin Kietzman wrote: >Hello all, > >@Gang

Re: [DISCUSS][C++] Raw pointer string views

2023-09-26 Thread Raphael Taylor-Davies
contiguous buffers which could end up being >very significant depending on the shape and size of the data. The pointer >-based solution wouldn't be allowed in IPC though, only across the C Data >interface (correct me if I'm wrong). > >--Matt > >On Tue, Sep 26, 2023, 6

Re: [DISCUSS][C++] Raw pointer string views

2023-09-26 Thread Raphael Taylor-Davies
Hi, Is the motivation here to avoid DuckDB and Velox having to duplicate the conversion logic from pointer-based to offset-based, or to allow arrow-cpp to operate directly on pointer-based arrays? If it is the former, I personally wouldn't have thought the conversion logic sufficiently

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.7.1 RC1

2023-09-26 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.7.1. This release candidate is based on commit: 4ef7917bd57b701e30def8511b5fd8a7961f2fcf [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

[RESULT][VOTE][RUST] Release Apache Arrow Rust 47.0.0 RC1

2023-09-22 Thread Raphael Taylor-Davies
With 4 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-47.0.0 It has also been released to crates.io Thank you to everyone who helped verify this release On 19/09/2023 14:20, Raphael Taylor-Davies wrote

Re: [VOTE][RUST] Release Apache Arrow Rust 47.0.0 RC1

2023-09-19 Thread Raphael Taylor-Davies
://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh On 19/09/2023 14:18, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 47.0.0. This release candidate is based on commit

[VOTE][RUST] Release Apache Arrow Rust 47.0.0 RC1

2023-09-19 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 47.0.0. This release candidate is based on commit: 1d6feeacebb8d0d659d493b783ba381940973745 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [FlightSQL] Supporting binding parameters to prepared statements with a stateless server

2023-09-14 Thread Raphael Taylor-Davies
by the clients and sent with each request. This sort of maps to the ticket notion already present in many of the APIs, but could perhaps be formalized. Kind Regards, Raphael Taylor-Davies On 14/09/2023 11:52, Andrew Lamb wrote: Hello, As FlightSQL gets more widely adopted across the ecosystem

[RESULT][VOTE][RUST] Release Apache Arrow Rust 46.0.0 RC1

2023-08-24 Thread Raphael Taylor-Davies
With 3 +1 votes (3 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-46.0.0/ It has also been released to crates.io Thank you to everyone who helped verify this release On 21/08/2023 16:40, Raphael Taylor-Davies wrote

[VOTE][RUST] Release Apache Arrow Rust 46.0.0 RC1

2023-08-21 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 46.0.0. This release candidate is based on commit: 90449ffb2ea6ceef43ce8fc97084b3373975f357 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.7.0 RC1

2023-08-18 Thread Raphael Taylor-Davies
With 3 +1 votes (3 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-object-store-rs-0.7.0/ It has also been released to crates.io Thank you to everyone who helped verify this release On 15/08/2023 10:57, Raphael Taylor

Re: [VOTE][Format] Add Utf8View Arrays to Arrow Format

2023-08-18 Thread Raphael Taylor-Davies
+1 (binding) Despite my earlier misgivings, I think this will be a valuable addition to the specification. To clarify I've interpreted this as a vote on both Utf8View and BinaryView as in the linked PR. On 28/06/2023 20:34, Benjamin Kietzman wrote: Hello, I'd like to propose adding

Re: [Vote][Format] C Data Interface Format string for REE

2023-08-16 Thread Raphael Taylor-Davies
+1 (binding) On 16/08/2023 16:58, Matt Topol wrote: It would be nice to get approval from authors of other implementations such as Rust, C#, Javascript... I'm hoping that some of them see this and participate in the vote. *crosses fingers* On Wed, Aug 16, 2023 at 11:10 AM Antoine Pitrou

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.7.0 RC1

2023-08-15 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.7.0. This release candidate is based on commit: 77fe72ddd40c1d39068ad580b975504d57032060 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

Re: Null buffer spec incompatibility between arrow2 and arrow-C++

2023-08-02 Thread Raphael Taylor-Davies
ize in bytes of the corresponding buffer would be 0. This is supported by arrow-rs [2], and I believe arrow2 is incorrect in not supporting this. I would recommend taking this up with the arrow2 maintainers [3]. Kind Regards, Raphael Taylor-Davies [1]: https://github.com/apache/arrow/pull/1480

[RESULT][VOTE][RUST] Release Apache Arrow Rust 45.0.0 RC1

2023-08-02 Thread Raphael Taylor-Davies
) Verified on my M1 Mac. Thanks Raphael ! On Mon, Jul 31, 2023 at 12:32 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 45.0.0. This release candidate is based on commit: 16744e5ac08d9ead6c51ff6e08d8b91e87460c52 [1

Re: [DISCUSS][Format] Draft implementation of string view array format

2023-07-31 Thread Raphael Taylor-Davies
to provide efficient safe APIs. Otherwise I don't see any major blockers towards getting these standardised, thank you for your continued efforts in this space. Kind Regards, Raphael Taylor-Davies [1]: https://github.com/apache/arrow-rs/pull/4585 On 12/07/2023 17:35, Pedro Eugenio Rocha Pedreira

[VOTE][RUST] Release Apache Arrow Rust 45.0.0 RC1

2023-07-30 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 45.0.0. This release candidate is based on commit: 16744e5ac08d9ead6c51ff6e08d8b91e87460c52 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[RESULT][VOTE][RUST] Release Apache Arrow Rust 44.0.0 RC1

2023-07-18 Thread Raphael Taylor-Davies
(binding) Verified on x86_64 mac Looks like another very nice release. Thanks for keeping the train moving Andrew On Fri, Jul 14, 2023 at 2:05 PM L. C. Hsieh wrote: +1 (binding) Verified on M1 Mac. Thanks Raphael. On Fri, Jul 14, 2023 at 10:44 AM Raphael Taylor-Davies wrote: Hi, I would like

[VOTE][RUST] Release Apache Arrow Rust 44.0.0 RC1

2023-07-14 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 44.0.0. This release candidate is based on commit: 8f44472e5c773f0daec1965253143e94d14c55e5 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [DISCUSS] Canonical alternative layout proposal

2023-07-13 Thread Raphael Taylor-Davies
etc. Ian [5]https://lists.apache.org/thread/7x2714wookjqgkoykxpq9jtpyrgx2bx2 On Thu, Jul 13, 2023 at 11:00 AM Raphael Taylor-Davies r.taylordav...@googlemail.com.invalid wrote: I like this proposal, I think it strikes a pragmatic balance between preserving interoperability whilst stil

Re: [DISCUSS] Canonical alternative layout proposal

2023-07-13 Thread Raphael Taylor-Davies
I like this proposal, I think it strikes a pragmatic balance between preserving interoperability whilst still allowing new ideas to be incorporated into the standard. Thank you for writing this up. On 13/07/2023 10:22, Matt Topol wrote: I don't have much to add but I do want to second Jacob's

Re: [DISCUSS][Format] Draft implementation of string view array format

2023-07-10 Thread Raphael Taylor-Davies
DuckDb or consuming a velox task as a record batch stream into a different system) and these sorts of challenges are in the forefront. On Fri, Jul 7, 2023 at 7:53 AM Raphael Taylor-Davies wrote: Thus the approach you describe for validating an entire character buffer as UTF-8 then checking offsets

Re: [DISCUSS][Format] Draft implementation of string view array format

2023-07-07 Thread Raphael Taylor-Davies
that output is getting sparse or fragmented. It's also worth noting that unlike an explicit selection vector a Utf8View array (however sparse or fragmented) will still benefit from the prefix comparison fast path. Sincerely, Ben Kietzman On Sun, Jul 2, 2023 at 8:01 AM Raphael Taylor-Davies wrote: I

[RESULT][VOTE][RUST] Release Apache Arrow Rust 43.0.0 RC1

2023-07-03 Thread Raphael Taylor-Davies
With 5 +1 votes (5 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-43.0.0 It has also been released to crates.io Thank you to everyone who helped verify this release Raphael On 30/06/2023 16:26, Raphael Taylor-Davies

Re: [DISCUSS] UTF-8 validation

2023-07-02 Thread Raphael Taylor-Davies
on this note, this interpretation doesn't appear to have caused issues so far. On 2 July 2023 13:07:20 BST, Antoine Pitrou wrote: > > >Le 02/07/2023 à 14:00, Raphael Taylor-Davies a écrit : >> >> More an observation than an issue, but UTF-8 validation for StringArray can >&g

Re: [DISCUSS][Format] Draft implementation of string view array format

2023-07-02 Thread Raphael Taylor-Davies
can be improved in less intrusive ways using dictionaries or selection vectors. Kind Regards, Raphael Taylor-Davies On 02/07/2023 11:46, Andrew Lamb wrote: * This is the first layout where the number of buffers depends on the data and not the schema. I think this is the most architectura

[VOTE][RUST] Release Apache Arrow Rust 43.0.0 RC1

2023-06-30 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 43.0.0. This release candidate is based on commit: 414235e7630d05cccf0b9f5032ebfc0858b8ae5b [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-06-14 Thread Raphael Taylor-Davies
this is a reasonable price to pay for avoiding the ecosystem fragmentation that would potentially result from introducing alternative layouts for common types such as strings, whilst also avoiding the need to reimplement a load of kernels. What do people think? Kind Regards, Raphael Taylor-Davies On 14

Scalars in Apache Arrow Rust

2023-06-09 Thread Raphael Taylor-Davies
already grappled with, I would very much appreciate any feedback the community can give. To avoid bifurcating the discussion, please comment on the GitHub PR. I look forward to hearing your thoughts. Kind Regards, Raphael Taylor-Davies [1]: https://docs.rs/arrow-arith/latest/arrow_arith

[RESULT][VOTE][RUST] Release Apache Arrow Rust 41.0.0 RC1

2023-06-06 Thread Raphael Taylor-Davies
) Verified on M1 Mac. Thanks Raphael. On Fri, Jun 2, 2023 at 11:55 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 41.0.0. This release candidate is based on commit: e1badc0542ca82e2304cc3f51a9d25ea2dbb74eb [1] The proposed release

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.6.1 RC1

2023-06-06 Thread Raphael Taylor-Davies
on mac x86_64 Thank you Raphael On Fri, Jun 2, 2023 at 2:23 PM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.6.1. This release candidate is based on commit: f323097584eaa8edb1193b4fb67bccadd39594f6 [1] The proposed

[VOTE][RUST] Release Apache Arrow Rust 41.0.0 RC1

2023-06-02 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 41.0.0. This release candidate is based on commit: e1badc0542ca82e2304cc3f51a9d25ea2dbb74eb [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.6.1 RC1

2023-06-02 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.6.1. This release candidate is based on commit: f323097584eaa8edb1193b4fb67bccadd39594f6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

[RESULT][VOTE][RUST] Release Apache Arrow Rust 40.0.0 RC1

2023-05-22 Thread Raphael Taylor-Davies
at 8:49 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 40.0.0. This release candidate is based on commit: 25bfccca58ff219d9f59ba9f4d75550493238a4f [1] The proposed release tarball and signatures are hosted at [2]. The changelog

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.6.0 RC1

2023-05-22 Thread Raphael Taylor-Davies
, Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.6.0. This release candidate is based on commit: ec7706c1f2aeef5a289e46d1df7785e5c93e6bfb [1] The proposed release tarball and signatures are hosted at [2]. The changelog

[VOTE][RUST] Release Apache Arrow Rust 40.0.0 RC1

2023-05-19 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 40.0.0. This release candidate is based on commit: 25bfccca58ff219d9f59ba9f4d75550493238a4f [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.6.0 RC1

2023-05-18 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.6.0. This release candidate is based on commit: ec7706c1f2aeef5a289e46d1df7785e5c93e6bfb [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-05-11 Thread Raphael Taylor-Davies
is probably a better way to represent variable length lists than what arrow settled upon, I'm not yet convinced it is sufficiently better to incentivise broad ecosystem adoption. Kind Regards, Raphael Taylor-Davies On 11/05/2023 21:20, Will Jones wrote: Hi Felipe, Thanks for the additional details

[RESULT][VOTE][RUST] Release Apache Arrow Rust 39.0.0 RC1

2023-05-09 Thread Raphael Taylor-Davies
With 4 +1 votes (4 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/arrow/arrow-rs-39.0.0 It has also been released to crates.io Thank you to everyone who helped verify this release Raphael On 05/05/2023 15:45, Raphael Taylor-Davies

[VOTE][RUST] Release Apache Arrow Rust 39.0.0 RC1

2023-05-05 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 39.0.0. This release candidate is based on commit: 575a199fa669d75833c13a2a69d71255b9a9f2e6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [DISCUSS][Format] Starting the draft implementation of the ArrayView array format

2023-04-25 Thread Raphael Taylor-Davies
Unless I am missing something, I think the selection use-case could be equally well served by a dictionary-encoded BinarArray/ListArray, and would have the benefit of not requiring any modifications to the existing format or kernels. The major additional flexibility of the proposed encoding

[RESULT][VOTE][RUST] Release Apache Arrow Rust 38.0.0 RC1

2023-04-25 Thread Raphael Taylor-Davies
: +1 (binding) Verified on x86 mac Thank you Raphael On Fri, Apr 21, 2023 at 2:00 PM L. C. Hsieh wrote: +1 (binding) Verified on M1 Mac. Thanks Raphael. On Fri, Apr 21, 2023 at 7:47 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation

[VOTE][RUST] Release Apache Arrow Rust 38.0.0 RC1

2023-04-21 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 38.0.0. This release candidate is based on commit: bbd57c615213bc6e80fb0192674942f688e5f6a8 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [VOTE][RUST] Release Apache Arrow Rust 37.0.0 RC2

2023-04-10 Thread Raphael Taylor-Davies
verified on x86 linux. Thanks Raphael On Sat, Apr 8, 2023 at 8:42 PM Andrew Lamb wrote: +1 (binding) verified on x86 mac Thank you Raphael On Fri, Apr 7, 2023 at 1:42 PM L. C. Hsieh wrote: +1 (binding) Verified on M1 Mac. Thanks Raphael. On Fri, Apr 7, 2023 at 9:27 AM Raphael Taylor

[VOTE][RUST] Release Apache Arrow Rust 37.0.0 RC2

2023-04-07 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 37.0.0. There were some complications with the first release candidate, so please make sure you are verifying RC2 with the latest version of the verification scripts. This release candidate is based on

[RESULT][VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.6 RC2

2023-04-03 Thread Raphael Taylor-Davies
Yıldırım wrote: +1 (non-binding) verified on mac m1. On Sat, Apr 1, 2023 at 4:05 AM Jacob Wujciak wrote: +1 (non-binding) verified on manjaro On Fri, Mar 31, 2023 at 10:00 PM Raphael Taylor-Davies wrote: Thank you for double checking, ApplicationDefaultCredentialsFile is in a crate private

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.6 RC2

2023-03-31 Thread Raphael Taylor-Davies
PM L. C. Hsieh wrote: > >> Oh, I verified RC1 wrongly. Then for RC2, >> >> +1 (binding) >> >> Verified on M1 Mac. >> >> Thanks Raphael. >> >> >> >> On Fri, Mar 31, 2023 at 10:34 AM Raphael Taylor-Davies >> wrote: >> &

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.6 RC2

2023-03-31 Thread Raphael Taylor-Davies
, Mar 31, 2023 at 4:29 AM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.5.6. This release candidate is based on commit: 234b7847ecb737e96df3f4623df7b330b34b3d1b [1] The proposed release tarball and signatures

[VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.6 RC2

2023-03-31 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Object Store Implementation, version 0.5.6. This release candidate is based on commit: 234b7847ecb737e96df3f4623df7b330b34b3d1b [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

Re: OpenTelemetry + Arrow

2023-03-30 Thread Raphael Taylor-Davies
dapter>, and the two articles (see links below), I believe that fostering collaboration between open-source projects like these is essential and mutually beneficial. These articles would serve as a fitting complement to the three introductory articles that Andrew Lamb and Raphael Taylor-Davies co

[DISCUSS][RUST]: Breaking Change to Schema Representation

2023-03-29 Thread Raphael Taylor-Davies
Hi All, The Rust Arrow implementation stores metadata for child arrays in a struct called Field [1]. This encodes the name, nullability, datatype, and other metadata about that array. Currently the various schema representations, such as DataType [2] and Schema [3], store uniquely owned

[RESULT][VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-28 Thread Raphael Taylor-Davies
: +1 (non-binding) Verified on Mac M1 On Mon, Mar 27, 2023, at 2:13 AM, Ian Joiner wrote: +1 (Non-binding) Ian Verified on my HP / Ubuntu 22.04 / AMD64 On Fri, Mar 24, 2023 at 3:24 PM Raphael Taylor-Davies wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation

[VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-24 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 36.0.0. This release candidate is based on commit: 71ecc39f36c8f38a5fc93bc3878a607c831b2f12 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Raphael Taylor-Davies
I'm neutral on whether this should be a release blocker, but something I noticed when verifying the arrow 36 release candidate is that DataFusion main currently depends on two different versions of arrow-rs, see [1]. Just an FYI [1]:

Re: Removing old arrow & object-store releases from svn

2023-03-21 Thread Raphael Taylor-Davies
Hi Andy, Thank you for bringing this to my attention, I will update the object store release scripts to cleanup the old releases, inline with what we do for arrow-rs. Kind Regards, Raphael On 20/03/2023 15:07, Andy Grove wrote: Hi, There are many versions of arrow and object-store-rs in

Re: Apache Arrow PGP Key

2023-03-20 Thread Raphael Taylor-Davies
Hi, I could be mistaken, but I was under the impression the KEYS file only contained GPG keys of PMC members Kind Regards, Raphael On 20 March 2023 02:21:02 GMT, Sutou Kouhei wrote: >Hi, > >Could any PMC member help this? > >Thanks, >-- >kou > >In > "Apache Arrow PGP Key" on Tue, 14 Mar

  1   2   >