Re: [Discuss] [Rust] Arrow2/parquet2 going foward

2021-08-05 Thread Adam Lippai
Not taking sides, just two technical notes below. Server.org clearly defines ( https://semver.org/#how-do-i-know-when-to-release-100) the versions >1.0.0. * If it's used in production, it's 1.0.0. * If it provides an API others depend on then it's 1.0.0. * If you intend to keep backward

Re: [DISCUSS] Developing an "Arrow Compute IR [Intermediate Representation]" to decouple language front ends from Arrow-native compute engines

2021-08-05 Thread Julian Hyde
Wes, Thanks for this. I’ve added comments to the doc and to the PR. The biggest surprise is that this language does full relational operations. I was expecting that it would do fragments of the operations. Consider join. A distributed hybrid hash join needs to partition rows into output

Re: Review request for Dataset Java API PRs

2021-08-05 Thread Hongze Zhang
Thanks everyone for the quick response! By the way I might raise this review request a little bit late because I was working on some other projects in the last few months either. Now I just have some time to push this forward. :) About ARROW-11776: On Wed, 2021-08-04 at 08:45 -0700, Micah