Re: Datafusion's Java binding is available in Maven Central

2022-05-16 Thread Jiayu Liu
nt, I'm curious about what motivated the > > decision to not use the c-data-interface? Was it strictly a matter of > > timing or familiarity, or is there some advantage to the approach you > took? > > > > I ask because I'm in the process of moving other JNI interfaces to &

Re: Datafusion's Java binding is available in Maven Central

2022-05-16 Thread Jiayu Liu
and .dylib files are shipped: currently it's packaged separately, I had doubts about shipping both into a .jar, because combined they exceed > 50MB. [1]: https://repo1.maven.org/maven2/org/apache/arrow/arrow-c-data/8.0.0/ On May 11, 2022, Jiayu Liu wrote: > Hi dev@arrow, > > Recently

Datafusion's Java binding is available in Maven Central

2022-05-11 Thread Jiayu Liu
Hi dev@arrow, Recently I've created and published a Java binding[1] to datafusion[2], as part of datafusion-contrib projects[3]. I've updated the README.md[4] so people can pick it up via maven[5] or gradle. Any feedback or contributions are welcome! [1]:

Re: [VOTE][RUST] Release Apache Arrow Rust 13.0.0 RC1

2022-05-02 Thread Jiayu Liu
+1 (non-binding) Verified on M1 macos Monterey by running the verification script On Tue, May 3, 2022 at 2:02 AM Andy Grove wrote: > +1 (binding). > > Verified on Ubuntu 20.04.3 LTS (AMD) and macOS 12.3.1 (M1) > > On Mon, May 2, 2022 at 11:49 AM Chao Sun wrote: > > > +1 (non-binding),

Re: [Vote][Datafusion][Python] Release Python binding of Apache Arrow Datafusion 0.5.0 RC1

2022-03-10 Thread Jiayu Liu
defined, and `col` > is > defined directly in the datafusion module itself. The following > worked> > > > >>> df = df.select(datafusion.col("a") + datafusion.col("b")) > > >>> result = df.collect()[0] > > >>> result.colu

Re: [Vote][Datafusion][Python] Release Python binding of Apache Arrow Datafusion 0.5.0 RC1

2022-03-09 Thread Jiayu Liu
t; Hi Jaiyu -- thanks for leading this effort -- I would be happy to > help test > > this release -- do you have any suggestions about how to do so (i.e. > > instructions for installing the wheel, what commands to try, etc?) > > > > On Wed, Mar 9, 2022 at 10:14 AM Jiayu L

Re: [Vote][Datafusion][Python] Release Python binding of Apache Arrow Datafusion 0.5.0 RC1

2022-03-09 Thread Jiayu Liu
for release votes. > > Thanks, > > Andy. > > > > On Wed, Mar 9, 2022 at 6:54 AM Jiayu Liu > wrote: > > > Greetings Arrow dev community, > > > > I am not sure if voting will still be needed in the future but I'd > like > > to propose a release of Apache A

[Vote][Datafusion][Python] Release Python binding of Apache Arrow Datafusion 0.5.0 RC1

2022-03-09 Thread Jiayu Liu
Greetings Arrow dev community, I am not sure if voting will still be needed in the future but I'd like to propose a release of Apache Arrow Datafusion's Python binding (which now lives in https://github.com/datafusion-contrib/datafusion-python) version 0.5.0. The release candidate is based on

Re: [ANNOUNCE] New Arrow PMC member: QP Hou

2022-02-17 Thread Jiayu Liu
Congratulations QP! On Fri, Feb 18, 2022 at 1:32 PM Micah Kornfield wrote: > Congrats! > > On Thu, Feb 17, 2022 at 7:27 PM Weston Pace wrote: > > > Congratulations QP! > > > > On Thu, Feb 17, 2022 at 3:22 PM hao Yang <1371656737...@gmail.com> > wrote: > > > > > > Congratulations QP! > > > > >

Migrating datafusion's python binding to https://github.com/datafusion-contrib/datafusion-python

2021-12-30 Thread Jiayu Liu
Hi, I'm following up with https://github.com/apache/arrow- datafusion/issues/1324 and by using Copybara (https://github.com/google/copybara) the code under datafusion/python dir is migrated to https://github.com/datafusion-contrib/datafusion- python with as much historical context preserved as

RE: [DISCUSS] Community maintained extension repos for Datafusion

2021-11-07 Thread Jiayu Liu
FWIW if there's a way to contribute code pertaining to datafusion I can contribute my version of Java bindings to it. IMO having a central place (instead of linking) for all bindings, 3rd libraries, etc. for datafusion would mean more synergy across different languages but I won't go as far as a

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread Jiayu Liu
. 2021 om 15:33 schreef David Li : > > > Congrats Jiayu! > > > > -David > > > > On Thu, Oct 7, 2021, at 07:21, Benson Muite wrote: > > > Congratulations Jiayu Liu! > > > > > > On 10/7/21 1:56 PM, Andrew Lamb wrote: > > > > Hi, >

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-09-30 Thread Jiayu Liu
Thanks Andrew for facilitating this meeting and very happy to "meet" everyone on the call. Hope you have a great day / evening. On Fri, Oct 1, 2021 at 12:38 AM Andrew Lamb wrote: > Notes from the 16:00 UTC Call: > > Attendees: > Andrew Lamb > Shen Yi Jie > Matt Turner > Zied BF > Remi Dettai >

Re: [DISCUSS] Release Python Datafusion 0.3.0

2021-07-27 Thread Jiayu Liu
A usable Python release would likely boarden use cases and potential scenarios. I wonder what would the versioning be in? should it go along with the datafusion versioning scheme? Either way I'm happy to help with the CI setup and release process. On Wed, Jul 21, 2021 at 9:17 PM Neal Richardson

Re: [Rust][DataFusion] [DISCUSS] Next DataFusion / Ballista official release

2021-07-27 Thread Jiayu Liu
Not sure it's necessarily bundled together but I believe a Python, documentation, etc. release can also be helpful. I can volunteer to help if somehow these works can be parallelized. On Tue, Jul 27, 2021 at 3:29 PM QP Hou wrote: > Following up on this, since delta-rs could really benefit from

Datafusion's vision and roadmap?

2021-06-22 Thread Jiayu Liu
Hi, This is regarding my question about the datafusion's vision and roadmap. As a new contributor, I wonder what would be a vision and roadmap that most of the contributors can/already have be aligned upon. Maybe due to my lack of prior context I might have missed such discussion, or maybe this