+1 as well (binding)
Le 28/06/2021 à 17:28, Ben Kietzman a écrit :
+1 (binding)
On Mon, Jun 28, 2021 at 5:35 AM Wes McKinney <wesmck...@gmail.com> wrote:
+1 (binding)
On Mon, Jun 28, 2021 at 11:08 AM Daniël Heres <danielhe...@gmail.com>
wrote:
+1 (non binding)
Great work Jorge!
On Mon, Jun 28, 2021, 10:26 Weston Steimel <weston.stei...@gmail.com>
wrote:
+1
On Sun, 27 Jun 2021, 07:41 Jorge Cardoso Leitão, <
jorgecarlei...@gmail.com
wrote:
Hi,
I would like to bring to this mailing list a proposal to donate the
source
code of arrow2 [1] and parquet2 [2] as experimental repositories [3]
within
Apache Arrow, conditional on IP clearance.
The specific PRs are:
* https://github.com/apache/arrow-experimental-rs-arrow2/pull/1
* https://github.com/apache/arrow-experimental-rs-parquet2/pull/1
The source code contains rewrites of the arrow and parquet crates
with
safety and security in mind. In particular,
* no buffer transmutes
* no unsafe APIs marked as safe
* parquet's implementation is unsafe free
There are many other important features, such as big endian support
and
IPC
2.0 support. There is one regression over latest: support nested
types in
parquet read and write. I observe no negative impact on performance.
See a longer discussion in [4] over the reasons why the current rust
implementation is susceptible to safety violations. In particular,
many
core APIs of the crate are considered security vulnerabilities under
RustSec's [5] definitions, and are difficult to address on its
current
design.
I validated that it is possible to migrate DataFusion [6] and Polars
[7]
without further code changes.
The vote will be open for at least 72 hours.
[ ] +1 Accept the code donation as experimental repos.
[ ] +0
[ ] -1 Do not accept the code donation as experimental repos
because...
[1]
https://github.com/apache/arrow/blob/master/docs/source/developers/experimental_repos.rst
[2] https://github.com/jorgecarleitao/arrow2
[3] https://github.com/jorgecarleitao/parquet2
[4] https://github.com/jorgecarleitao/arrow2#faq
[5] https://rustsec.org/
[6] https://github.com/apache/arrow-datafusion/pull/68
[7] https://github.com/pola-rs/polars
