Re: [VOTE][RUST][DataFusion] Release DataFusion Python Bindings 36.0.0 RC1

2024-03-10 Thread QP Hou
+1 (binding) On Sun, Mar 10, 2024 at 10:18 AM Andy Grove wrote: > > Bumping this email thread. We need one more +1 PMC vote. > > Thanks, > > Andy. > > On Sun, Mar 3, 2024 at 8:31 PM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M3 Mac. > > > > Thanks Andy. > > > > On Sun, Mar 3, 2024

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

2024-03-01 Thread QP Hou
+1 (binding) exciting milestone :) On Fri, Mar 1, 2024 at 9:49 AM David Li wrote: > > +1 > > On Fri, Mar 1, 2024, at 12:06, Jorge Cardoso Leitão wrote: > > +1 - great work!!! > > > > On Fri, Mar 1, 2024 at 5:49 PM Micah Kornfield > > wrote: > > > >> +1 (binding) > >> > >> On Friday, March 1, 20

Re: [ANNOUNCE] New Arrow committer: Brent Gardner

2023-01-11 Thread QP Hou
Congratulations Brent! On Wed, Jan 11, 2023 at 2:56 PM Andy Grove wrote: > On behalf of the Arrow PMC, I'm happy to announce that Brent Gardner > has accepted an invitation to become a committer on Apache > Arrow. Welcome, and thank you for your contributions! > > Andy. >

Re: [ANNOUNCE] New Arrow PMC chair: Andrew Lamb

2022-12-28 Thread QP Hou
Congrats Andrew and thank you for your continued service to the community! On Wed, Dec 28, 2022 at 6:53 AM Antoine Pitrou wrote: > > > Thank you Andrew for accepting this responsibility! > > > Le 26/12/2022 à 05:53, Sutou Kouhei a écrit : > > I am pleased to announce that we have a new PMC chair

Re: [ANNOUNCE] New Arrow PMC member: Kun Liu

2022-11-14 Thread QP Hou
Congrats Kun! On Mon, Nov 14, 2022 at 10:50 AM David Li wrote: > > Welcome, Kun! > > On Mon, Nov 14, 2022, at 13:27, Ian Joiner wrote: > > Congrats! > > > > On Sun, Nov 13, 2022 at 3:22 PM Sutou Kouhei wrote: > > > >> The Project Management Committee (PMC) for Apache Arrow has invited > >> Kun L

Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-28 Thread QP Hou
+1 (binding) On Fri, Oct 28, 2022 at 10:11 PM L. C. Hsieh wrote: > > +1 (binding) > > Verified on M1 Mac. > > Thanks Andrew! > > On Fri, Oct 28, 2022 at 9:18 PM Raphael Taylor-Davies > wrote: > > > > +1 (binding) > > > > On 29/10/2022 09:13, Andrew Lamb wrote: > > > Hi, > > > > > > I would like

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-27 Thread QP Hou
Congratulations Will! On Thu, Oct 27, 2022 at 6:51 PM Vibhatha Abeykoon wrote: > Congratulations Will! > > On Fri, Oct 28, 2022 at 6:40 AM Li Jin wrote: > > > congrats! > > > > On Thu, Oct 27, 2022 at 9:03 PM Matt Topol > wrote: > > > > > Congrats Will! > > > > > > On Thu, Oct 27, 2022 at 9:02

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 13.0.0 RC1

2022-10-07 Thread QP Hou
+1 (binding) On Fri, Oct 7, 2022 at 3:11 PM Ian Joiner wrote: > +1 (non-binding) > > Verified on my Ubuntu 22.04 / AMD > > On Fri, Oct 7, 2022 at 7:26 AM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow DataFusion > > Implementation, > > version 13.0.0. > >

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.1 RC1

2022-10-07 Thread QP Hou
+1 (binding) On Fri, Oct 7, 2022 at 3:31 PM Ian Joiner wrote: > +1 (Non-binding) > > Never mind. It is slow but it still works. > > On Fri, Oct 7, 2022 at 11:32 AM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Object > > Store Implementation, versio

Re: [VOTE][RUST] Release Apache Arrow Rust 23.0.0 RC2

2022-09-17 Thread QP Hou
+1 binding On Sat, Sep 17, 2022 at 11:39 AM Ashish wrote: > +1 (non-binding) > > validated on M1 Mac > > thanks > Ashish > > On Sat, Sep 17, 2022 at 11:13 AM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M1 Mac. > > > > Thanks, Andrew! > > > > On Sat, Sep 17, 2022 at 11:12 AM Andy G

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.5.0 RC1

2022-09-08 Thread QP Hou
+1 (binding) On Thu, Sep 8, 2022 at 11:16 AM Ashish wrote: > +1 (non-binding) > > validated on M1 Mac > > On Thu, Sep 8, 2022 at 11:03 AM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Object > > Store Implementation, version 0.5.0. > > > > This rele

Re: [ANNOUNCE] New Arrow PMC member: Weston Pace

2022-09-05 Thread QP Hou
Congrats Weston! On Mon, Sep 5, 2022 at 9:38 AM Yaron Gvili wrote: > Congratulations Weston! > > From: Raul Cumplido Dominguez > Sent: Monday, September 5, 2022 10:04 AM > To: dev@arrow.apache.org > Subject: Re: [ANNOUNCE] New Arrow PMC member: Weston Pace > >

Re: [ANNOUNCE] New Arrow PMC member: L. C. Hsieh

2022-09-03 Thread QP Hou
Congrats Liang-Chi! On Sat, Sep 3, 2022 at 8:25 PM Remzi Yang <1371656737...@gmail.com> wrote: > Congratulation Liang-Chi! > > On Sun, 4 Sept 2022 at 05:39, Sutou Kouhei wrote: > > > The Project Management Committee (PMC) for Apache Arrow has invited > > L. C. Hsieh to become a PMC member and we

Re: [VOTE][RUST] Release Apache Arrow Rust 22.0.0 RC1

2022-09-02 Thread QP Hou
+1 (binding) On Fri, Sep 2, 2022 at 8:31 PM Chao Sun wrote: > +1 (non-binding). Verified on Intel Mac > > Thanks Andrew. > > Chao > > On Fri, Sep 2, 2022 at 6:23 PM Remzi Yang <1371656737...@gmail.com> wrote: > > > > +1 (non_binding) Verified on M1 Mac. > > Thank you, Andrew. > > > > On Sat, 3 S

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-22 Thread QP Hou
+1 (binding) On Mon, Aug 22, 2022 at 7:49 AM Ashish wrote: > > +1 (non-binding) > > Hit the same json issue, already discussed. > > On Mon, Aug 22, 2022 at 6:45 AM Andy Grove wrote: > > > That sounds fine to me. > > > > +1 (binding) > > > > Thanks, Andrew and LC. > > > > On Mon, Aug 22, 2022 at

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 11.0.0 RC1

2022-08-17 Thread QP Hou
+1 (binding) On Wed, Aug 17, 2022 at 9:26 AM Francis Du wrote: > +1 (Non-binding) > > Verified on MacOS 12.5 / MBA M2 > > On Wed, 17 Aug 2022 at 16:47, Andrew Lamb wrote: > > > +1 (binding) > > > > Thanks Andy and everyone else who contributed to this release -- this > looks > > like it will be

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.4.0 RC2

2022-08-10 Thread QP Hou
+1 binding! On Wed, Aug 10, 2022 at 12:31 PM L. C. Hsieh wrote: > +1 (non-binding). Verified on Intel Mac. > > Thank you, Andrew! > > On Wed, Aug 10, 2022 at 7:36 AM Andy Grove wrote: > > > > +1 (binding) > > > > Verified on Ubuntu 20.04.4 LTS > > > > Thanks, Andrew! > > > > On Wed, Aug 10, 202

Re: [VOTE][RUST] Release Apache Arrow Rust 20.0.0 RC2

2022-08-06 Thread QP Hou
+1 (binding) On Sat, Aug 6, 2022 at 8:01 AM Andy Grove wrote: > +1 (binding). > Verified on Ubuntu 20.04 LTS > > Thanks, Andrew! > > On Sat, Aug 6, 2022 at 8:00 AM Remzi Yang <1371656737...@gmail.com> wrote: > > > +1 (non-binding) > > Verified on M1 Mac. Thank you, Andrew! > > > > Best Regards,

Re: [VOTE][RUST] Release Apache Arrow Rust 19.0.0 RC1

2022-07-22 Thread QP Hou
+1 (binding) On Fri, Jul 22, 2022 at 5:01 PM L. C. Hsieh wrote: > > +1 (non-binding) > > Tested on Intel Macbook. > > Thanks Andrew! > > On Fri, Jul 22, 2022 at 12:34 PM Ian Joiner wrote: > > > > +1 (Non-binding) > > > > Tested on a MacBook Pro with macOS 12.2.1 & Apple M1 Pro chip > > > > On Fr

Re: [VOTE] Accept donation of Rust Object Store donation

2022-07-18 Thread QP Hou
+1 (binding) On Mon, Jul 18, 2022 at 8:55 AM Andrew Lamb wrote: > > Hello, > > This vote is to determine if the Arrow PMC is in favor of accepting the > donation of the Rust Object Store crate to arrow-rs. > > We have previously discussed this topic [1] and [2]. > > The proposed donation is at [3

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 10.0.0 RC1

2022-07-13 Thread QP Hou
+1 (binding) On Wed, Jul 13, 2022 at 1:24 PM Andrew Lamb wrote: > > +1 (binding) > > Thanks Andy! I know releases are a significant amount of work. > > Andrew > > On Tue, Jul 12, 2022 at 11:45 AM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow DataFusion > >

Re: [VOTE][RUST] Release Apache Arrow Rust 18.0.0 RC1

2022-07-09 Thread QP Hou
+1 (binding) On Sat, Jul 9, 2022 at 12:55 PM Chao Sun wrote: > > +1 (non-binding) verified on Intel Mac. > > Thanks Andrew. > > Chao > > On Sat, Jul 9, 2022 at 10:36 AM L. C. Hsieh wrote: > > > > +1 (non-binding) > > > > Verified on Intel Mac. > > > > Thank you, Andrew! > > > > On Sat, Jul 9, 20

Re: [VOTE][RUST] Release Apache Arrow Rust 17.0.0 RC1

2022-06-24 Thread QP Hou
+1 (binding) On Fri, Jun 24, 2022 at 7:36 PM Remzi Yang <1371656737...@gmail.com> wrote: > > +1 (non-binding). Verified on Mac M1. > Thanks Andrew. > > Remzi > > On Sat, 25 Jun 2022 at 09:33, Chao Sun wrote: > > > +1 (non-binding). Verified on Intel Mac. > > > > Thanks Andrew. > > > > On Fri, Jun

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 9.0.0 RC1

2022-06-13 Thread QP Hou
Sorry that I was under the impression you want to propose another RC including a fix for 2719. +1 (binding) On Mon, Jun 13, 2022 at 2:23 PM Andy Grove wrote: > > We need one more PMC vote to be able to release. It is possible that some > of the PMC members who normally help with DataFusion votes

Re: [VOTE][RUST] Release Apache Arrow Rust 16.0.0 RC1

2022-06-10 Thread QP Hou
+1 (binding) On Fri, Jun 10, 2022 at 11:27 AM Andy Grove wrote: > > +1 (binding) > > Verified on Ubuntu 20.04.4 LTS > > Thanks, Andrew. > > On Fri, Jun 10, 2022 at 11:54 AM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Implementation, > > version 16.

Re: [VOTE][RUST] Release Apache Arrow Rust 15.0.0 RC1

2022-05-27 Thread QP Hou
+1 (binding) Thank you Andrew! On Fri, May 27, 2022 at 10:51 AM L. C. Hsieh wrote: > > +1 (non-binding) > Verified on Intel Mac. > > Thank you, Andrew! > > On Fri, May 27, 2022 at 9:41 AM Chao Sun wrote: > > > > +1 (non-binding) verified on Intel Mac. > > > > Thanks Andrew! > > > > On Fri, May

Re: [VOTE] [Rust] Move Ballista to new arrow-ballista repository

2022-05-17 Thread QP Hou
+1 (binding) On Tue, May 17, 2022 at 1:27 PM David Li wrote: > > +1 (binding) > > On Tue, May 17, 2022, at 16:00, Neal Richardson wrote: > > +1 > > > > On Tue, May 17, 2022 at 12:46 PM Andrew Lamb wrote: > > > >> +1 (binding) > >> > >> On Mon, May 16, 2022 at 9:56 AM Andy Grove wrote: > >> > >>

Re: [Rust] Issues with signing release

2022-05-15 Thread QP Hou
Hi Andy, You are correct that those are alternative options. You actually had your key correctly added to the KEYS file. I believe the issue is that your key is only self-signed, so it cannot be verified through Andrew's web of trust. See key signing party instructions at: https://infra.apache.org

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 8.0.0 RC2

2022-05-15 Thread QP Hou
+1 binding. Thanks Andy for driving this release. On Fri, May 13, 2022 at 4:57 AM Andy Grove wrote: > > Hi, > > I would like to propose a release of Apache Arrow DataFusion Implementation, > version 8.0.0. > > This release candidate is based on commit: > b9f6e6b7c353c1109bd7b306008e006db29b46f8

Re: [VOTE][RUST] Release Apache Arrow Rust 14.0.0 RC1

2022-05-14 Thread QP Hou
+1 (binding) On Fri, May 13, 2022 at 11:12 AM Andrew Lamb wrote: > > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 14.0.0. > > This release candidate is based on commit: > 33e298444f251258dd289c8377c68a80925ab0b4 [1] > > The proposed release tarball and

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 7.1.0 RC1

2022-04-17 Thread QP Hou
+1 (binding) On Sun, Apr 17, 2022 at 5:13 AM Rich wrote: > > +1 (non-binding) > verified at macOS 12.2.1, Intel i7 > > Thanks, > Rich (jychen7) > > > Sent with ProtonMail secure email. > --- Original Message --- > On Tuesday, April 12th, 2022 at 4:44 PM, Andrew Lamb > wrote: > > > > Hi,

Re: [VOTE][RUST] Release Apache Arrow Rust 11.1.0 RC1

2022-04-02 Thread QP Hou
+1 (binding), thanks Andrew! On Fri, Apr 1, 2022 at 8:26 AM Andrew Lamb wrote: > > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 11.1.0. > > This release candidate is based on commit: > eb6b7c65f49794f54d9b11a632172ffa13783ff2 [1] > > The proposed releas

Re: [VOTE][RUST] Release Apache Arrow Rust 11.0.0 RC1

2022-03-18 Thread QP Hou
+1 (binding) Thanks, QP Hou On Fri, Mar 18, 2022 at 1:01 AM Andrew Lamb wrote: > > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 11.0.0. > > This release candidate is based on commit: > 5d6b638111e3f9c72dc8504ea98e46914fc93

Re: [ANNOUNCE] New Arrow committers: Raphael Taylor-Davies, Wang Xudong, Yijie Shen, and Kun Liu

2022-03-09 Thread QP Hou
Congratulations to all, well deserved! On Wed, Mar 9, 2022 at 9:37 AM Daniël Heres wrote: > > Congratulations! > > On Wed, Mar 9, 2022, 18:26 LM wrote: > > > Congrats to you all! > > > > On Wed, Mar 9, 2022 at 9:19 AM Chao Sun wrote: > > > > > Congrats all! > > > > > > On Wed, Mar 9, 2022 at 9:

Re: [Rust] DataFusion + Substrait

2022-03-07 Thread QP Hou
I am also very excited for this, especially the possibility of leveraging it in Ballista. Great work Andy! On Mon, Mar 7, 2022 at 8:31 AM Andy Grove wrote: > > I created a new repo in the datafusion-contrib GitHub org over the weekend > with a starting point for supporting DataFusion as both a pr

Re: [VOTE][RUST] Release Apache Arrow Rust 10.0.0 RC1

2022-03-07 Thread QP Hou
+1 (binding). Thanks Andrew. On Mon, Mar 7, 2022 at 9:17 AM Chao Sun wrote: > > +1 (non-binding) verified on Mac. Thanks Andrew! > > On Mon, Mar 7, 2022 at 7:47 AM Matthew Turner > wrote: > > > > +1 (non-binding) after running release verification script on M1 Mac. > > > > Thanks, Andrew. > > >

Re: [ANNOUNCE] New Arrow committer: Jacob Quinn

2022-02-24 Thread QP Hou
Congratulations and welcome Jacob! Thanks, QP Hou On Thu, Feb 24, 2022 at 4:06 PM Ian Joiner wrote: > > Congrats Jacob! > > On Thursday, February 24, 2022, David Li wrote: > > > Congrats & welcome Jacob! > > > > On Thu, Feb 24, 2022, at 17:39, Rok Mihe

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 7.0.0 RC2

2022-02-15 Thread QP Hou
on of `cargo publish` in this PR [1] > > [1] https://github.com/apache/arrow-datafusion/pull/1830 > > On Mon, Feb 14, 2022 at 10:51 PM QP Hou wrote: > > > +1 non-binding, went release script on Linux arm64. > > > > It failed at the end when executing the `cargo publis

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 7.0.0 RC2

2022-02-14 Thread QP Hou
+1 non-binding, went release script on Linux arm64. It failed at the end when executing the `cargo publish --dry-run` command, but I think this is expected because the datafusion core is now depending on the `datafusion-common` crate. We should probably update the verification script to run publis

Re: Managing usage of the @ApacheArrow Twitter handle and other social media

2022-02-01 Thread QP Hou
To be clear I haven't used that twitter-together action myself, was just using it as an example for how such a workflow could be set up. I imagine it won't be too much work for us to write our own action if needed. Thanks, QP Hou On Tue, Feb 1, 2022 at 5:31 AM Neal Richardson wrote:

Re: Managing usage of the @ApacheArrow Twitter handle and other social media

2022-01-31 Thread QP Hou
I don't know how other projects manage this, but one solution we could evaluate is using github PRs to manage the twitter account. For example, here is a github action that does exactly this https://github.com/gr2m/twitter-together. On Mon, Jan 31, 2022 at 3:14 PM Wes McKinney wrote: > > hi all,

Re: [ANNOUNCE] New Arrow PMC chair: Kouhei Sutou

2022-01-25 Thread QP Hou
Congrats Kou, very well deserved. On Tue, Jan 25, 2022 at 9:53 AM Benson Muite wrote: > > Congratulations Kou! > On 1/25/22 8:44 PM, Vibhatha Abeykoon wrote: > > Congrats Kou! > > > > > > On Tue, Jan 25, 2022 at 11:13 PM Ian Joiner wrote: > > > >> Congrats Kou! > >> > >> On Tuesday, January 25,

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-19 Thread QP Hou
gt; > > One thing that isn't exactly clear to me from the linked issue is how > > > much > > > > > interest there is in the community for maintaining arrow-rs? How > > much > > > is a > > > > > donation of arrow2 a factor here? > > &g

Re: [RUST][DataFusion][Arrow] Switching DataFusion to use arrow2 implementation and the future of arrow

2022-01-16 Thread QP Hou
Hi Wes, I believe what you mentioned is the plan, i.e. move arrow2 to ASF in the long run when it stabalize on its design/API and could benefit from a more rigorous release process. From what I have seen, the project is still undergoing major API changes on a monthly basis, so quick releases and f

Re: Arrow streaming computation engine

2022-01-11 Thread QP Hou
For datafusion (the Rust engine that Weston mentioned), the community is about to start building a PoC for streaming engine. The discussion is happening at https://github.com/apache/arrow-datafusion/issues/1544. On Tue, Jan 11, 2022 at 3:29 PM Weston Pace wrote: > > First, note that there are dif

Re: [VOTE][RUST] Release Apache Arrow Rust 7.0.0 RC1

2022-01-11 Thread QP Hou
+1 (non-binding) On Mon, Jan 10, 2022 at 3:14 PM Andy Grove wrote: > > +1 (binding) > > Thanks, > > Andy. > > On Sat, Jan 8, 2022 at 3:43 AM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Implementation, > > version 7.0.0. > > > > This release candida

Re: [ANNOUNCE] New Arrow PMC member: Daniël Heres

2021-12-21 Thread QP Hou
Congrats Daniël! Thank you for all your awesome work on the rust implementation and datafusion! On Tue, Dec 21, 2021 at 9:49 PM Eduardo Ponce wrote: > > Congrats! > > > On Dec 21, 2021, at 12:18 PM, Wes McKinney wrote: > > > > The Project Management Committee (PMC) for Apache Arrow has invited >

Re: [ANNOUNCE] New Arrow committer: Rémi Dattai

2021-12-08 Thread QP Hou
Congrats Rémi, thank you for your epic work on datafusion :) On Wed, Dec 8, 2021 at 9:00 AM Andrew Lamb wrote: > > Congratulations Rémi! > > On Wed, Dec 8, 2021 at 10:56 AM Nic wrote: > > > Congratulations! :) > > > > On Wed, 8 Dec 2021 at 07:20, Jorge Cardoso Leitão < > > jorgecarlei...@gmail.c

Re: [DISCUSS] Community maintained extension repos for Datafusion

2021-11-18 Thread QP Hou
ataFusion, we might rather use the "experimental" repo > policy (discussed in the past on the mailing list) to keep the work > happening inside Apache. > > On Mon, Nov 15, 2021 at 7:32 AM Andrew Lamb wrote: > > > > Thank you QP > > > > Andrew > >

[RESULT][VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-16 Thread QP Hou
:50 PM Sutou Kouhei wrote: > > +1 > > I ran the followings on Debian GNU/Linux sid: > > dev/release/verify-release-candidate.sh 6.0.0 0 > > > Thanks, > -- > kou > > In > "Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0&quo

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-16 Thread QP Hou
It looks like we just need one more binding vote to get this release out, would appreciate a +1 from another PMC member :) On Sun, Nov 14, 2021 at 4:54 PM Andy Grove wrote: > > +1 (binding) > > I ran the release verification script on Ubuntu 20.04 and also ran the > Ballista integration tests. >

Re: [DISCUSS] Community maintained extension repos for Datafusion

2021-11-14 Thread QP Hou
> > On 11/7/21 9:40 AM, Jiayu Liu wrote: > > > > FWIW if there's a way to contribute code pertaining to datafusion I can > > > > contribute my version of Java bindings to it. > > > > > > > > IMO having a central place (instead of linking) f

[VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread QP Hou
Hi, I would like to propose a release of Apache Arrow Datafusion Implementation, version 6.0.0. This release candidate is based on commit: 7824a8d74093374da8a4f040d23a81b8436b7380 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download,

[DISCUSS] Community maintained extension repos for Datafusion

2021-11-06 Thread QP Hou
Hi all, I would like to propose a new and more community friendly governance model for community contributed and maintained extensions for the datafusion project. Over the last year, many datafusion extensions have been proposed and created by the community including the java binding, s3 and hdfs

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-10-14 Thread QP Hou
M Andrew Lamb wrote: > > > I agree -- since no one has added anything to the agenda, I will cancel it > > (and leave a note in the agenda document to that effect) > > > > On Thu, Oct 14, 2021 at 1:23 AM QP Hou wrote: > > > > > I recommend skipping the meet

Re: [VOTE][RUST] Release Apache Arrow Rust 6.0.0 RC1

2021-10-13 Thread QP Hou
+1 (non-binding) Tested with verification script on Linux 5.4.0-80 Ubuntu x86_64. On Wed, Oct 13, 2021 at 1:23 PM Andy Grove wrote: > > +1 (binding) > > I checked signatures and ran the release verification script on Ubuntu 20.04 > > On Wed, Oct 13, 2021 at 1:35 PM Andrew Lamb wrote: > > > Hi,

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-10-13 Thread QP Hou
I recommend skipping the meeting if there is no proposed item before the meeting starts. Changing to monthly cadence also sounds like a good idea. We can always change it back to bi-weekly or call of ad-hoc meetings if there are more items that need to be discussed. On Wed, Oct 13, 2021 at 12:43

Re: [ANNOUNCE] New Arrow committer: Jiayu Liu

2021-10-07 Thread QP Hou
Congrats Jiayu, welcome to the party! --QP On Thu, Oct 7, 2021 at 3:56 AM Andrew Lamb wrote: > > Hi, > > On behalf of the Arrow PMC, I'm happy to announce that > Jiayu Liu has accepted an invitation to become a > committer on Apache Arrow. Welcome, and thank you for your > contributions! > > > A

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-09-29 Thread QP Hou
I would prefer alternating meeting time to optimize for more attendance and reduce meeting fatigue for those who can attend both. On Wed, Sep 29, 2021 at 1:00 AM Benson Muite wrote: > > Hi, > > Will send a link to a BigBlueButton/OpenVidu instance at 3:45 UTC tomorrow. > > Update the google doc [

Re: [DISCUSS][Julia] How to restart at apache/arrow-julia?

2021-09-20 Thread QP Hou
gt; I'll clarify that I don't feel very strongly on these points, so if there's > > something I'm missing or gaps in my understanding of how the rest of the > > web of projects are coordinating things, I'm all ears. > > > > -Jacob > > &

Re: Re: Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-09-19 Thread QP Hou
; > > > > Thanks, > > > > > Andrew > > > > > > > > > > > > > > > On Fri, Sep 17, 2021 at 6:07 AM Yijie Shen < > > henry.yijies...@gmail.com> > > > > > wrote: > > > > > > > > > > >

Re: [DISCUSS][Rust] Biweekly sync call for arrow/datafusion again?

2021-09-16 Thread QP Hou
I would be interested in meeting with more contributors "face to face" and chime in to help move these major initiatives forward in any way I can :) -- QP On Thu, Sep 16, 2021 at 6:55 AM Rémi Dettai wrote: > > I am also very interested in re-instoring these events, at least > occasionally. > > I

Re: [DISCUSS] Leap seconds/days and day light saving for Duration types

2021-09-16 Thread QP Hou
nths or years (presumably because > >> months and years are too inconsistent). > >> > >> I'm not sure though that this is something that Arrow needs to define. > >> We aren't specifying any invalid ranges of values. I don't foresee > >> any

Re: [DISCUSS] Leap seconds/days and day light saving for Duration types

2021-09-13 Thread QP Hou
system that treated intervals as > comparable (and didn't factor in DST, leap years, etc.) will read and > write intervals the same way as a system that considers intervals > incomparable. > > This question seems to fall into the "compute" space inhabited by > topics like

Re: [DISCUSS] Leap seconds/days and day light saving for Duration types

2021-09-13 Thread QP Hou
On Mon, Sep 13, 2021 at 6:18 AM Antoine Pitrou wrote: > The Duration type is defined with a TimeUnit. You are probably thinking > about the Interval type. > Oops, my bad, yes, it should be Interval type not Duration. > Ok. How about daylight savings? I suppose they are taken into account > as

Re: [DataFusion] Question about async/await?

2021-09-12 Thread QP Hou
Hi Renjie, If by datafusion benchmarks, you are referring to the code in the datafusion/benches folder, then those benchmarks are executed with tokio runtime. You are correct that one should schedule compute bound tasks into a separate task managed by a dedicated thread to avoid blocking the asyn

[DISCUSS] Leap seconds/days and day light saving for Duration types

2021-09-12 Thread QP Hou
Hi, I would like to draw some attention to a format PR aiming to clarify leap seconds, leap days and daylight saving handling semantics for duration types: https://github.com/apache/arrow/pull/11138. This came out of the effort [1] trying to implement Partial and Total order for duration type DAY

Re: [DISCUSS] Use conbench.ursa.dev for arrow-rs and arrow-datafusion

2021-09-12 Thread QP Hou
ks. I don't > know Rust, so I may reach out on zulip (or wherever Arrow Rust folks > talk) for help building arrow-rs. > > $ cargo bench > unresolved imports `parquet::util::DataPageBuilder`, > `parquet::util::DataPageBuilderImpl`, > `parquet::util::InMemoryPageIterato

Re: [DISCUSS][Julia] How to restart at apache/arrow-julia?

2021-09-11 Thread QP Hou
elease (the process is non > > trivial and the current 72 hour voting window adds some backpressure as > > well -- I remember Wes may have said windows shorter than 72 hours might > be > > fine too) > > > > > > On Wed, Sep 8, 2021 at 12:19 AM QP Hou wrote:

Re: [DISCUSS] Use conbench.ursa.dev for arrow-rs and arrow-datafusion

2021-09-11 Thread QP Hou
Thanks Diana a lot for offering to help. Please see my replies inline below. On Sat, Sep 11, 2021 at 8:37 AM Diana Clarke wrote: > If you point me to the existing benchmarks for each project and > instructions on how to execute them, I can let you know the easiest > integration path. > For arrow

[DISCUSS] Use conbench.ursa.dev for arrow-rs and arrow-datafusion

2021-09-10 Thread QP Hou
Hi, I think conbench.ursa.dev works really well for the main arrow repo, especially the ability to request on demand benchmarks during PR reviews by mentioning usrabot in a comment. I am wondering if it is something that arrow-rs and arrow-datafusion could leverage as well to help speed up PR rev

Re: [ANNOUNCE] New Arrow committer: Nic Crane

2021-09-09 Thread QP Hou
Congrats Nic! On Thu, Sep 9, 2021 at 8:47 AM Neal Richardson wrote: > > On behalf of the Apache Arrow PMC, I'm happy to announce that Nic Crane > has accepted an invitation to become a committer on Apache Arrow. > > Welcome and thank you for your contributions! > > Neal

Re: [DISCUSS][Julia] How to restart at apache/arrow-julia?

2021-09-07 Thread QP Hou
A minor note on the Rust side of things. arrow-rs has a 2 weeks release cycle, but arrow-datafusion mostly does release on demand at the moment. Our most uptodate release processes are documented at [1] and [2]. [1]: https://github.com/apache/arrow-rs/blob/master/dev/release/README.md [2]: https:

Re: RESULT Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC3

2021-08-15 Thread QP Hou
ease manager! > > On Sat, Aug 14, 2021 at 9:56 PM QP Hou wrote: > > > The vote has passed with three +1 votes. Thank you to all who helped > > with the release verification. > > > > We have published new versions of datafusion and ballista to crates.io as &g

RESULT Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC3

2021-08-14 Thread QP Hou
eryone! > > > > > > On Fri, Aug 13, 2021, 22:19 Daniël Heres wrote: > > > > > +1 (non binding). Looking good. > > > > > > > > > On Fri, Aug 13, 2021, 07:49 QP Hou wrote: > > > > > > > Good call Ruihang

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC3

2021-08-12 Thread QP Hou
gt; > [1]: https://rust-lang.github.io/rustup/overrides.html#the-toolchain-file > > On Thu, Aug 12, 2021 at 2:14 AM QP Hou wrote: > > > Hi Ruihang, > > > > Thanks for helping with the validation. It would certainly be helpful > > if you could share the

Re: [VOTE][RUST] Release Apache Arrow Rust 5.2.0 RC1

2021-08-12 Thread QP Hou
+1 (non-binding) ran the verification script on Linux 5.4.0 x86_64 On Thu, Aug 12, 2021 at 12:44 PM Andrew Lamb wrote: > > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 5.2.0. > > This release candidate is based on commit: > 7c98c4c60bc776acd09bd3568c66

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC3

2021-08-11 Thread QP Hou
T_DATA`, then run the test > with > "cargo test --all --no-fail-fast" on Linux 5.13.6 with x86_64 chip. > > Did I miss something? I can paste the log here or file an issue if needed. > > Ruihang > > QP Hou : > > > Hi, > > > > I would li

[VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC3

2021-08-10 Thread QP Hou
Hi, I would like to propose a release of Apache Arrow Datafusion Implementation, version 5.0.0. RC3 fixed a cargo publish issue discovered in RC1. This release candidate is based on commit: deb929369c9aaba728ae0c2c49dcd05bfecc8bf8 [1] The proposed release tarball and signatures are hosted at [2]

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC2

2021-08-10 Thread QP Hou
Looks like the commit is off, please ignore this vote while I prepare for a new one. On Tue, Aug 10, 2021 at 10:28 PM QP Hou wrote: > > Hi, > > I would like to propose a release of Apache Arrow Datafusion Implementation, > version 5.0.0. > > Compared to RC1, RC2 fixed a ca

[VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC2

2021-08-10 Thread QP Hou
Hi, I would like to propose a release of Apache Arrow Datafusion Implementation, version 5.0.0. Compared to RC1, RC2 fixed a cargo publish issue for ballista crates. This release candidate is based on commit: 96658eb100436c47601ed10095d74299d2229020 [1] The proposed release tarball and signature

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC1

2021-08-10 Thread QP Hou
ter tonight. Will also add `cargo publish --dry-run` into the release test automation script. Thanks, QP Hou On Tue, Aug 10, 2021 at 4:13 PM Andy Grove wrote: > > Here is a PR to resolve this > > https://github.com/apache/arrow-datafusion/pull/852 > > > On Tue, Aug 10, 2021 at 4

[VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 5.0.0 RC1

2021-08-10 Thread QP Hou
Hi, I would like to propose a release of Apache Arrow Datafusion Implementation, version 5.0.0. This release candidate is based on commit: 96658eb100436c47601ed10095d74299d2229020 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download,

Re: [Rust] Ballista status and benchmarks

2021-08-08 Thread QP Hou
I am not able to load the benchmark graph png, so reattaching it here in case other people have the same issue. On Sun, Aug 8, 2021 at 1:31 PM Andy Grove wrote: > > I wanted to share a quick update on the status of Ballista. > > Ballista is now capable of running some of the TPC-H benchmark queri

Re: [Discuss] [Rust] Arrow2/parquet2 going foward

2021-08-03 Thread QP Hou
Just my two cents. I think we all have the same goal here, which is to accelerate the transitioning of arrow to arrow2 as the official arrow rust implementation. In my opinion, the biggest gain we can get from merging two projects into one repo is to have some kind of a policy to enforce that eve

Re: [Rust][DataFusion] [DISCUSS] Next DataFusion / Ballista official release

2021-08-01 Thread QP Hou
to help if > > somehow these works can be parallelized. > > > > On Tue, Jul 27, 2021 at 3:29 PM QP Hou wrote: > > > > > Following up on this, since delta-rs could really benefit from this > > > release, I have started some initial work with > > >

Re: [ANNOUNCE] New Arrow PMC member: Neville Dipale

2021-07-29 Thread QP Hou
Well deserved, congratulations Neville! On Thu, Jul 29, 2021 at 3:20 PM Wes McKinney wrote: > > The Project Management Committee (PMC) for Apache Arrow has invited > Neville Dipale to become a PMC member and we are pleased to announce > that Neville has accepted. > > Congratulations and welcome!

Re: [Rust][DataFusion] [DISCUSS] Next DataFusion / Ballista official release

2021-07-27 Thread QP Hou
Following up on this, since delta-rs could really benefit from this release, I have started some initial work with https://github.com/apache/arrow-datafusion/pull/780 to move things forward. Others are welcome to join the party. On Fri, Jul 23, 2021 at 12:58 PM Andrew Lamb wrote: > > Does anyone

Re: [ANNOUNCE] New Arrow committer: QP Hou

2021-07-27 Thread QP Hou
Thank you all for the warm welcome! It's been a lot of fun hacking on Arrow together with so many talented engineers :) On Mon, Jul 26, 2021 at 10:37 PM Jorge Cardoso Leitão wrote: > > Congratulations and thank you for all the great work! It is a pleasure to > work with you. > > Best, > Jorge >

Re: [VOTE] Donation of rust arrow2 and parquet2

2021-06-28 Thread QP Hou
+1 (non binding) Really exciting stuff, amazing work Jorge. On Mon, Jun 28, 2021 at 8:32 AM Antoine Pitrou wrote: > > +1 as well (binding) > > > Le 28/06/2021 à 17:28, Ben Kietzman a écrit : > > +1 (binding) > > > > On Mon, Jun 28, 2021 at 5:35 AM Wes McKinney wrote: > > > >> +1 (binding) > >>

Re: Delta Lake support for DataFusion

2021-06-09 Thread QP Hou
extension for delta lake. [1]: https://pandas.pydata.org/docs/ecosystem.html#io Thanks, QP Hou On Wed, Jun 9, 2021 at 11:30 AM Daniël Heres wrote: > > Thanks all for the valuable input! > > I agree following the plugin / model makes a lot of sense for now (either > in arrow-dat

Re: [DataFusion] [Discuss] Output Schema for queries with multiple relations

2021-05-19 Thread QP Hou
. [1]: https://docs.google.com/document/d/1uviWavwEGD3qxwMk2AGkOgp6ENrvKGiMWQhHNbqPwhg/ [2]: https://docs.google.com/document/d/1dbK-3eaTHlzZcHzpTk1h-LA3b7dcxsVBcoZeVKYIPwI/ [3]: https://github.com/apache/arrow-datafusion/pull/55#issuecomment-829296665 Thanks, QP Hou On Wed, May 5, 2021 at 3:

Re: [ANNOUNCE] New Arrow committer: Daniël Heres

2021-04-28 Thread QP Hou
Congrats Daniël, well deserved! Thanks, QP Hou On Wed, Apr 28, 2021 at 6:25 AM Andy Grove wrote: > > On behalf of the Arrow PMC, I'm happy to announce that Daniël has > > accepted an invitation to become a committer on Apache Arrow. > > Welcome, and thank you for your contributions!

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

2021-04-12 Thread QP Hou
On Mon, Apr 12, 2021 at 6:55 AM Andy Grove wrote: > > Hi Krisztian, > > When you say that using GitHub issues is "not the apache way of issue > tracking", are you referring to any particular ASF rules? I see no mention > of JIRA in https://www.apache.org/theapacheway/ and there are other Apache >

Re: [DISCUSS] [Rust] Move Rust components to new repos and process

2021-04-09 Thread QP Hou
On Fri, Apr 9, 2021 at 4:57 PM Weston Pace wrote: > Note, these problems technically exist now with the concept that any > language can release a patch at any time. Also, since Rust isn't > directly compiling against other Arrow libs and we are only talking > about interoperability it's probably

[jira] [Created] (ARROW-9124) DFParser should consume sql query as &str instead of String

2020-06-13 Thread QP Hou (Jira)
QP Hou created ARROW-9124: - Summary: DFParser should consume sql query as &str instead of String Key: ARROW-9124 URL: https://issues.apache.org/jira/browse/ARROW-9124 Project: Apache Arrow I

[jira] [Created] (ARROW-9057) Projection should work on InMemoryScan without error

2020-06-07 Thread QP Hou (Jira)
QP Hou created ARROW-9057: - Summary: Projection should work on InMemoryScan without error Key: ARROW-9057 URL: https://issues.apache.org/jira/browse/ARROW-9057 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-9005) Support sort expression

2020-06-01 Thread QP Hou (Jira)
QP Hou created ARROW-9005: - Summary: Support sort expression Key: ARROW-9005 URL: https://issues.apache.org/jira/browse/ARROW-9005 Project: Apache Arrow Issue Type: Improvement Components

[jira] [Created] (ARROW-8931) [Rust] Support lexical sort in arrow compute kernel

2020-05-24 Thread QP Hou (Jira)
QP Hou created ARROW-8931: - Summary: [Rust] Support lexical sort in arrow compute kernel Key: ARROW-8931 URL: https://issues.apache.org/jira/browse/ARROW-8931 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8906) [Rust] Support reading multiple CSV files for schema inference

2020-05-22 Thread QP Hou (Jira)
QP Hou created ARROW-8906: - Summary: [Rust] Support reading multiple CSV files for schema inference Key: ARROW-8906 URL: https://issues.apache.org/jira/browse/ARROW-8906 Project: Apache Arrow Issue

  1   2   >