Re: [ANNOUNCE] New DataFusion committer: Zhen Wang

2025-10-02 Thread Andrew Lamb
Congratulations!!! On Thu, Oct 2, 2025 at 10:34 AM Andy Grove wrote: > On behalf of the DataFusion PMC, I'm happy to announce that Zhen Wang > has accepted an invitation to become a committer on Apache > DataFusion. Welcome, and thank you for your contributions! > > Andy Grove. >

[RESULT] [VOTE] Release Apache DataFusion 50.1.0 RC1

2025-10-02 Thread Andrew Lamb
ing) > > Verified on mac m4 > > On Mon, Sep 29, 2025 at 8:38 AM Andrew Lamb wrote: > > > To: dev@datafusion.apache.org > > Subject: > > Hi, > > > > I would like to propose a release of Apache DataFusion version 50.1.0. &

Re: [VOTE] Release Apache DataFusion Comet 0.10.1 RC1

2025-10-02 Thread Andrew Lamb
+1 (binding) Verified on Ubuntu x86_64 Thanks Andy -- looks like a good release! Andrew On Wed, Oct 1, 2025 at 7:01 PM Parth Chandra wrote: > +1 > Verified on Mac M3 > Also, built Iceberg with Comet patches and this release candidate. Ran all > iceberg tests for Spark3.4, 3.5. Also ran iceber

[VOTE] Release Apache DataFusion 50.1.0 RC1

2025-09-29 Thread Andrew Lamb
To: dev@datafusion.apache.org Subject: Hi, I would like to propose a release of Apache DataFusion version 50.1.0. This release candidate is based on commit: d5065d6b3a2ed870926fa4f5e8fdb8b472a27ff1 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3].

Re: [VOTE] Release Apache DataFusion Ballista 49.0.0 RC1

2025-09-29 Thread Andrew Lamb
+1 (binding) I verified on x86_64 Thanks Andy and everyone else who helped make this release happen Andrew On Sun, Sep 28, 2025 at 2:28 PM Marko Milenković wrote: > +1 (non-binding) > > Thanks Andy! > > -- > Marko Milenković > > > > > > On 28 Sep 2025, at 18:01, L. C. Hsieh wrote: > > > > +1

[RESULT] [VOTE] Release Apache DataFusion sqlparser-rs 0.59.0 RC1

2025-09-25 Thread Andrew Lamb
Andrew On Wed, Sep 24, 2025 at 7:05 AM Tim Saucer wrote: > +1 (binding) > > On Fri, Sep 19, 2025 at 9:03 AM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache DataFusion sqlparser-rs > version > > 0.59.0. > >

[VOTE] Release Apache DataFusion sqlparser-rs 0.59.0 RC1

2025-09-19 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.59.0. This release candidate is based on commit: 3c61db5dc09871405f04ea715f0a0800072568cc [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify

Re: [VOTE] Release DataFusion Python Bindings 50.0.0 RC1

2025-09-18 Thread Andrew Lamb
+1 (binding) I verified on a Mac M3 Thank you for driving this Andrew On Thu, Sep 18, 2025 at 7:06 AM Tim Saucer wrote: > Hi, > > I would like to propose a release of the Apache DataFusion Python Bindings, > version 50.0.0. > > This release candidate is based on commit: > c3a76553b755ea64b9a1

[ANNOUNCE] New DataFusion committer: Yoav Cohen (yoavcloud)

2025-09-15 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Yoav Cohen has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for all your contributions to sqlparser so far! Andrew

Re: [VOTE] Release Apache DataFusion Comet 0.10.0 RC1

2025-09-15 Thread Andrew Lamb
+1 (binding) I verified on ubuntu 24.04: x86_x64 Thanks Andy! On Sun, Sep 14, 2025 at 7:10 PM Andy Grove wrote: > I just noticed that the changelog link in the original email is incorrect. > The changelog for 0.10.0 can be found here: > > > https://github.com/apache/datafusion-comet/blob/main/

Re: [VOTE] Release Apache DataFusion 50.0.0 RC1

2025-09-14 Thread Andrew Lamb
+1 (binding) I ran the verification script on a Mac M3 Pro Thanks Xudong Andrew On Sat, Sep 13, 2025 at 4:01 PM Oleks V. wrote: > +1 (binding) > > Verified on Mac M3 Pro > > Thanks Xudong > > - > To unsubscribe, e-mail: dev

Re: [CROWDSOURCING] 2025-09-10 DataFusion ASF Board Report

2025-09-10 Thread Andrew Lamb
out with reviews. We continue to actively grow our committer and PMC ranks. We continue to merge multiple PRs a day from multiple committers and have contributions from a wide variety of individuals with a wide variety of employers. On Sun, Aug 31, 2025 at 1:32 PM Andrew Lamb wrote: > I

[DISCUSS] Preparing for DataFusion version 50.0.0

2025-09-07 Thread Andrew Lamb
We are discussing the 50.0.0 release -- please comment on the ticket[1] if you have issues you would like to see addressed or would be willing to help upgrade / test. Thank you very much, Andrew [1]: https://github.com/apache/datafusion/issues/16799

[CROWDSOURCING] 2025-09-10 DataFusion ASF Board Report

2025-08-31 Thread Andrew Lamb
It's time again to provide another board report. As a reminder, the primary reason for these reports is for the board to make sure the project is ok. The actual project details are more likely helpful for other members of the project than the board. With that being said, please feel free to prov

Re: [VOTE] Release DataFusion Python Bindings 49.0.0 RC1

2025-08-25 Thread Andrew Lamb
+1 (binding) Verified on an M3 Mac Thanks (as always) for driving this Tim Andrew On Mon, Aug 25, 2025 at 4:12 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Tim. > > On Mon, Aug 25, 2025 at 10:26 AM Tim Saucer wrote: > > > > Hi, > > > > I would like to propose a rel

Re: [VOTE] Release Apache DataFusion 49.0.2 RC1

2025-08-25 Thread Andrew Lamb
24, 2025 at 7:59 AM Tim Saucer wrote: > +1 binding > > Verified on mac m4. Thanks for the patch! > > On Thu, Aug 21, 2025 at 6:12 PM Andrew Lamb wrote: > > > Hi, > > > > I would like to propose a release of Apache DataFusion version 49.0.2. > > >

[RESULT] [VOTE] Release Apache DataFusion 49.0.2 RC1

2025-08-25 Thread Andrew Lamb
(resending with correct subject) On Mon, Aug 25, 2025 at 7:48 AM Andrew Lamb wrote: > With 5 +1 votes (all binding) the release is approved! > > The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-49.0.2 > > I have also publis

[VOTE] Release Apache DataFusion 49.0.2 RC1

2025-08-21 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 49.0.2. This release candidate is based on commit: f43df3f2ae3aafb347996c58e852cc378807095b [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums and

Re: [VOTE] Release Apache DataFusion Comet 0.9.1 RC1

2025-08-21 Thread Andrew Lamb
+1 (binding) I verified in on a x86_64 / debian 12 Thanks Andy On Thu, Aug 21, 2025 at 10:17 AM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Comet version 0.9.1. > > This release candidate is based on commit: > a168c9a78b3c76aaceed21c2d269bc2686b0b3e8 [1]

49.0.2 release planning

2025-08-20 Thread Andrew Lamb
We are planning another patch release for 49 for bug fixes. If you would like to propose fixes for inclusion please comment on the ticket Release DataFusion 49.0.2 (patch) https://github.com/apache/datafusion/issues/17229 Andrew

[RESULT] [VOTE] Release Apache DataFusion 49.0.1 RC1

2025-08-18 Thread Andrew Lamb
help getting this release out the door Andrew [1]: https://github.com/apache/datafusion/issues/17226 On Thu, Aug 14, 2025 at 10:49 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Andrew. > > On Thu, Aug 14, 2025 at 7:28 AM Andrew Lamb > wrote: >

Re: [VOTE] Release Apache DataFusion 49.0.1 RC1

2025-08-14 Thread Andrew Lamb
;> [SQL] SELECT t1_id, t1_name, t2_name FROM t1 CROSS JOIN t2 ORDER BY > t1_id > >>> [Diff] (-expected|+actual) > >>> - 11 a z > >>> - 11 a y > >>> 11 a x > >>> 11 a w > >>> + 11 a z > >>> + 11 a y > &g

Re: [VOTE] Release Apache DataFusion 49.0.1 RC1

2025-08-14 Thread Andrew Lamb
22 b w > + 33 c x > + 33 c w > 33 c z > 33 c y > - 33 c x > - 33 c w > - 44 d z > - 44 d y > 44 d x > - 44 d w > + 44 d w > + 44 d z > + 44 d y > at > > /tmp/datafusion-49.0.1.RnL9I/apache-datafusion-49.0.1/datafusion/

[VOTE] Release Apache DataFusion 49.0.1 RC1

2025-08-14 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 49.0.1. This release candidate is based on commit: d1a6e9a6558300115d913a54bbea27e141156606 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums and

[RUST] Parquet Reader Improvements Planing

2025-08-07 Thread Andrew Lamb
In case anyone is interested, there are a few interesting projects I wanted to highlight: Xiangpeng and I are working on improving the Parquet reader to detangle CPU and IO and improve predicate performance: - Parquet Reader Improvement Plan / Proposal - July 2025 [1] Ed is working on a custom t

[ANNOUNCE] New DataFusion committer: Qi Zhu (zhuqi-lucas)

2025-08-05 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Qi Zhu (zhuqi-lucas) has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release Apache DataFusion Ballista 48.0.0 RC1

2025-08-01 Thread Andrew Lamb
+1 (binding) Verified on M3 Mac On Thu, Jul 31, 2025 at 7:09 PM Andy Grove wrote: > Hi, > > > I would like to propose a release of Apache DataFusion Ballista version > 48.0.0. > > > This release candidate is based on commit: > 948cab17ea76c7f5e80a679fee919b902f720e91 [1] > > The proposed releas

Re: Should we move the DataFusion Ray project back to datafusion-contrib?

2025-07-30 Thread Andrew Lamb
ince all the software is Apache licensed, if someone wanted to > > work > > > on it for a while there is no reason they couldn't fork the project > > (either > > > in datafusion-contrib or elsewhere) and keep working on it. > > > > Yeah, one t

Re: Should we move the DataFusion Ray project back to datafusion-contrib?

2025-07-29 Thread Andrew Lamb
eded. > > On Mon, Jul 28, 2025, at 23:57, Andrew Lamb wrote: > > I agree moving it back to contrib makes sense unless we can find a new > > champion to help drive it forward within the official repositories. > > > > On Mon, Jul 28, 2025 at 8:40 AM Andy Grove > wrote: >

Re: Should we move the DataFusion Ray project back to datafusion-contrib?

2025-07-28 Thread Andrew Lamb
I agree moving it back to contrib makes sense unless we can find a new champion to help drive it forward within the official repositories. On Mon, Jul 28, 2025 at 8:40 AM Andy Grove wrote: > The DataFusion Ray project [1] originated in datafusion-contrib and was > donated to the Apache DataFusio

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.58.0 RC1

2025-07-24 Thread Andrew Lamb
, Jul 24, 2025 at 3:29 PM Oleks V. wrote: > +1 (binding) > > Verified on Mac M3. > > Thanks! > > On 2025/07/18 13:19:55 Andrew Lamb wrote: > > Hi, > > > > I would like to propose a release of Apache DataFusion sqlparser-rs > version > > 0.58.0. &

[DISCUSS] A more formal DataFusion Improvement Process ?

2025-07-24 Thread Andrew Lamb
The DataFusion lack of a more formal feature proposal has come up recently several times, so I wrote up an idea about such a process here[1]. Andrew [1] https://github.com/apache/datafusion/issues/16886

Re: [VOTE] Release Apache DataFusion 49.0.0 RC1

2025-07-22 Thread Andrew Lamb
+1 (binding) I verified on a Mac M3 Thank you Xudong 🚀 On Tue, Jul 22, 2025 at 7:47 AM Wang Xudong wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 49.0.0. > > This release candidate is based on commit: > 273d37a5968571900bfe9efa1ee89f97914da118 [1] > The propose

[VOTE] Release Apache DataFusion sqlparser-rs 0.58.0 RC1

2025-07-18 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.58.0. This release candidate is based on commit: 40bbcc98340051efe6dc5fc8ea3c853c426d2072 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify

[Discuss] Schema Adapter deprecation

2025-07-16 Thread Andrew Lamb
We are discussing a new way to do schema adaptation on [1] Please leave your thoughts if you have any Andrew [1]: https://github.com/apache/datafusion/issues/16800

Planning for the 49.0.0 release -- week of July 14

2025-07-12 Thread Andrew Lamb
It is time to start preparing the DataFusion 49.0.0 release next week. If you have PRs you think we should include (especially if they are going to change APIs or unreleased APIs) please comment on the issue[1] Thanks, Andrew [1]: https://github.com/apache/datafusion/issues/16235

Re: [VOTE] Release DataFusion Python Bindings 48.0.0 RC1

2025-07-07 Thread Andrew Lamb
+1 (binding) Thanks Tim On Mon, Jul 7, 2025 at 11:19 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Tim. > > > On Mon, Jul 7, 2025 at 6:21 AM Tim Saucer wrote: > > > > Hi, > > > > I would like to propose a release of the Apache DataFusion Python > Bindings, > > version

[RESULT][VOTE] Release Apache DataFusion 48.0.1 RC1

2025-07-07 Thread Andrew Lamb
< renatoj.marroq...@gmail.com> wrote: > +1 (non binding) > > Verified on M3 Mac > > Thanks Andrew! > > El dom, 6 jul 2025 a las 17:03, Xudong Wang () > escribió: > > > > +1 (binding) > > > > Verified on M4 Mac > > > > Thank you,

[VOTE] Release Apache DataFusion 48.0.1 RC1

2025-07-04 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 48.0.1. You can read more about the rationale in this ticket[4]. This release candidate is based on commit: 1dbf5c559c66fa810d62e25df4abb46127bf5fb9 [1] The proposed release tarball and signatures are hosted at [2]. The changelog

Re: [VOTE] Release Apache DataFusion Comet 0.9.0 RC2

2025-07-04 Thread Andrew Lamb
, Andrew. ChatGPT suggests that you > may have corrupted sbt artifacts. Could you try the following? > > rm -rf ~/.sbt/1.0/zinc > rm -rf ~/.ivy2/cache/org.scala-sbt > rm -rf ~/.ivy2/cache/org.scala-lang > rm -rf ~/.m2/repository/org/scala-lang > > On Thu, Jul 3, 2025 at 4:16 AM Andr

Re: [VOTE] Release Apache DataFusion Comet 0.9.0 RC2

2025-07-03 Thread Andrew Lamb
I tried to run the verification script and got the error message below, but I am not sure what to make of it Andrew [INFO] --- scala:4.8.0:compile (scala-compile-first) @ comet-common-spark3.4_2.12 --- [INFO] Compiler bridge file: /Users/andrewlamb/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-com

[DISCUSS] 48.0.1 patch release

2025-07-02 Thread Andrew Lamb
I am planning to make a 48.0.1 release to include some important bug fixes. If you know of anything else that should be included, please comment on the ticket[1] Thanks, Andrew [1]: https://github.com/apache/datafusion/issues/16486

[DISCUSS] Slow cadence of major DataFusion releases?

2025-06-30 Thread Andrew Lamb
I would like to restart the conversation about less frequent major releases[1][2] as a way to make it easier on DataFusion users (though more work for DataFusion contributors). Please share your thoughts on the tickets if you would like, Andrew [1]: https://github.com/apache/datafusion/issues/166

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.57.0 RC2

2025-06-23 Thread Andrew Lamb
wrote: > +1 (binding) > > Verified on Ubuntu 22.04.5 LTS > > Thanks, Andrew. > > On Mon, Jun 16, 2025 at 11:10 AM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M4 Mac. > > > > Thanks Andrew. > > > > On Mon, Jun 16, 2025 at

Re: [VOTE] Release Apache DataFusion Ballista 47.0.0 RC1

2025-06-20 Thread Andrew Lamb
+1 (binding) I verified on an M3 Mac Thanks Andy On Fri, Jun 20, 2025 at 5:42 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Ballista version > 47.0.0. > > This release candidate is based on commit: > 13cd376f48e557979e7704fa133e601d716ddbe9 [1] > The pro

[VOTE] Release Apache DataFusion sqlparser-rs 0.57.0 RC2

2025-06-16 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.57.0. Note this is RC2 (see details on [4]) This release candidate is based on commit: 6f423969b0e723eeded2e5b7c0587aefae91ec54 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is lo

[ANNOUNCE] New DataFusion PMC member: Tim Saucer (timsaucer)

2025-06-16 Thread Andrew Lamb
The Project Management Committee (PMC) for Apache DataFusion has invited Tim Saucer (timsaucer) to become a PMC member and we are pleased to announce that Tim has accepted. Congratulations and welcome!

[ANNOUNCE] New DataFusion committer: Siew Kam Onn (kosiew)

2025-06-16 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Siew Kam Onn (kosiew) has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions!

Re: [CROWDSOURCING] June 2025 ASF Board Report

2025-06-11 Thread Andrew Lamb
wide variety of individuals with a wide variety of employers. On Thu, Jun 5, 2025 at 7:02 AM Andrew Lamb wrote: > We have an ASF board report due in one week (June 11 2025) and I have > started a draft. > > Please feel free to post comments to the doc[1] or the ticket[2] or this

Re: [RESULT][VOTE] Release Apache DataFusion 48.0.0 RC3

2025-06-11 Thread Andrew Lamb
Also, Huge thanks to you Xudong to get this process completed 🏆 On Wed, Jun 11, 2025 at 12:24 PM Wang Xudong wrote: > The vote has passed with 6 +1 votes. Thank you to all who helped with the > release verification. >

Re: [VOTE] Release Apache DataFusion 48.0.0 RC3

2025-06-07 Thread Andrew Lamb
+1 (binding) I ran the verification script on a Mac M3 and reviewed the commits -- it looks good to me. Thank you Xudong Since you have now joined the PMC, I will also add you as an owner to the DataFusion crates on crates.io so that you can publish them yourself if you wish. Andrew On Sat, Ju

Re: [VOTE] Release Apache DataFusion 48.0.0 RC2

2025-06-06 Thread Andrew Lamb
We are having a good discussion about the RC on the tracking issue [1] if anyone would like to follow along: [1]: https://github.com/apache/datafusion/issues/15771 On Fri, Jun 6, 2025 at 10:48 AM Dewey Dunnington wrote: > Thank you for preparing this! > > I did briefly want to call out [1], as

[CROWDSOURCING] June 2025 ASF Board Report

2025-06-05 Thread Andrew Lamb
We have an ASF board report due in one week (June 11 2025) and I have started a draft. Please feel free to post comments to the doc[1] or the ticket[2] or this thread and I will incorporate them [1]: https://docs.google.com/document/d/1UlFqUDSKFT2paY-wbxbDUiyPO6ILlreIk2HpWNjG_iU [2]: https://gith

[DISCUSS] [MAJOR] Equivalence System Overhaul #16217

2025-06-02 Thread Andrew Lamb
Hello DataFusion community, I wanted to get some extra eyes on a PR with a major change to the equivalence code [1]. Please contribute to the github discussion if you are interested. Andrew [1]: https://github.com/apache/datafusion/pull/16217

Re: [VOTE] Release DataFusion Python Bindings 47.0.0 RC1

2025-05-28 Thread Andrew Lamb
1`) > > > > Thanks for working on the release! > > > > Best, > > Kevin Liu > > > > On Mon, May 19, 2025 at 10:41 AM Andrew Lamb > > wrote: > > > > > +1 (binding) > > > > > > Verified on an M3 Mac > > > >

[ANNOUNCE] New DataFusion PMC member: Xudong Wang (xudong963)

2025-05-24 Thread Andrew Lamb
The Project Management Committee (PMC) for Apache DataFusion has invited $Xudong to become a PMC member and we are pleased to announce that he has accepted. Congratulations and welcome!

[ANNOUNCE] New DataFusion committer: Adrian Garcia Badaracco

2025-05-21 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Adrian Garcia Badaracco has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release DataFusion Python Bindings 47.0.0 RC1

2025-05-19 Thread Andrew Lamb
+1 (binding) Verified on an M3 Mac Thank you Tim On Mon, May 19, 2025 at 1:02 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Tim. > > > On Mon, May 19, 2025 at 9:54 AM Tim Saucer wrote: > > > > Hi, > > > > I would like to propose a release of the Apache DataFusion P

Re: [VOTE] Release Apache DataFusion Ballista 46.0.0 RC1

2025-05-05 Thread Andrew Lamb
+1 (binding) I ran the verification script on a Mac M3 Thank you Andy (and Marko who is pushing along Ballista!) Andrew On Mon, May 5, 2025 at 1:07 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Ballista version > 46.0.0. > > This release candidate is ba

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.56.0 RC1

2025-05-02 Thread Andrew Lamb
, 2025 at 9:13 AM Andy Grove wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks, Andrew. > > On Tue, Apr 29, 2025 at 4:24 PM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M4 Mac. > > > > Thanks Andrew. > > > > On T

Re: [VOTE] Release Apache DataFusion Comet 0.8.1 RC1

2025-04-30 Thread Andrew Lamb
+1 (binding) Verified on M3 Mac Thanks Andy! Andrew On Wed, Apr 30, 2025 at 8:51 PM huaxin gao wrote: > +1 (non-binding) > > Verified on M1 Mac. > > Thanks Andy. > > On Wed, Apr 30, 2025 at 5:37 PM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M4 Mac. > > > > Thanks Andy. > > > >

[VOTE] Release Apache DataFusion sqlparser-rs 0.56.0 RC1

2025-04-29 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.56.0. This release candidate is based on commit: a5b9821d1d2fa9c0b8ee73b698a2b0e5f138beaf [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify

[ANNOUNCE] New DataFusion committer: Dmitrii Blaginin (blaginin)

2025-04-29 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Dmitrii Blaginin has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions!

[ANNOUNCE] New DataFusion PMC member: Berkay Şahin (berkay)

2025-04-27 Thread Andrew Lamb
DataFusion community, The Project Management Committee (PMC) for Apache DataFusion has invited Berkay to become a PMC member and we are pleased to announce that Berkay has accepted. Congratulations and welcome!

[VOTE] Release Apache DataFusion 47.0.0 RC1

2025-04-16 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 47.0.0. This release candidate is based on commit: e4433049b04ca2c1e2031eb05d1a0990210f11d6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums and

[BLOG] Blog about User Defined Window Functions

2025-04-15 Thread Andrew Lamb
FYI we are working on a blog about user defined window functions[1] We would appreciate any comments Andrew [1]: https://github.com/apache/datafusion-site/pull/66

Re: [BLOG] Proposed blog post: Worlds fastest TPCH geneerator

2025-04-15 Thread Andrew Lamb
Following up here, the blog has been published[1] Andrew [1]: https://datafusion.apache.org/blog/2025/04/10/fastest-tpch-generator/ On Fri, Apr 4, 2025 at 4:36 PM Andrew Lamb wrote: > Hello, > > We have drafted a proposed Blog post with some others in the DataFusion > communi

[BLOG] Proposed blog post: Worlds fastest TPCH geneerator

2025-04-04 Thread Andrew Lamb
Hello, We have drafted a proposed Blog post with some others in the DataFusion community about our work on a TPCH data generator. We would welcome your feedback: [1]: https://github.com/apache/datafusion-site/pull/67

Re: [VOTE][RUST][Ballista] Release Apache DataFusion Ballista 45.0.0 RC1

2025-04-04 Thread Andrew Lamb
+1 (binding) Looks like a good release to me. I verified on an M3 mac Andrew On Fri, Apr 4, 2025 at 3:08 PM Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > +1 (non-binding) > > verified on M4 Mac. > > Thanks Andy! > > El vie, 4 abr 2025 a las 20:38, L. C. Hsieh () escribió: >

Re: [RESULT] [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-30 Thread Andrew Lamb
I have published the release to crates.io as well https://crates.io/crates/datafusion-python/46.0.0 Thanks again, Andrew On Sun, Mar 30, 2025 at 6:33 AM Andrew Lamb wrote: > With 6 +1 votes (3 binding) the release is approved > > The release is available here: > > https://

[RESULT] [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-30 Thread Andrew Lamb
With 6 +1 votes (3 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-python-46.0.0 Note I did not upload this to crates.io or pypi Andrew On Sat, Mar 29, 2025 at 10:50 AM Andy Grove wrote: > +1 (binding) > > Verif

[DISCUSS] DataFusion 46 Blog

2025-03-25 Thread Andrew Lamb
In the subject of blogging they are coming fast and furious. There is another one for DataFusion 46 that is up for review[1]. Please leave comments if you are interested Andrew [1]: https://github.com/apache/datafusion-site/pull/64

Re: [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-23 Thread Andrew Lamb
+1 (binding) Verified on an M3 mac. Looks like a good release to me. Thanks everyone Andrew On Sat, Mar 22, 2025 at 11:27 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Tim. > > > On Sat, Mar 22, 2025 at 5:36 PM Tim Saucer wrote: > > > > Hi, > > > > I would like to p

[DISCUSS] Another Blog post on Parquet!

2025-03-20 Thread Andrew Lamb
Speaking of blogs, here is another proposed cross posted blog about Parquet filter pushdown for the DataFusion blog site[1]. Please take a look and leave comments if you are interested. [1]: https://github.com/apache/datafusion-site/pull/61

Re: [DISCUSS] Blog on Parquet Pruning

2025-03-20 Thread Andrew Lamb
The blog is now live on https://datafusion.apache.org/blog/2025/03/20/parquet-pruning/ On Wed, Mar 19, 2025 at 2:02 PM Kevin Liu wrote: > Thanks for posting here! Great read. > > Best, > Kevin Liu > > On Tue, Mar 18, 2025 at 1:46 PM Andrew Lamb wrote: > > > There i

[RESULT][VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-19 Thread Andrew Lamb
Resending with proper subject On Wed, Mar 19, 2025 at 2:01 PM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved! > > Success! The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.1 > > I have a

Re: [VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-19 Thread Andrew Lamb
With 4 +1 votes (3 binding) the release is approved! Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.1 I have also uploaded it to crates.io Thanks again, Andrew On Sun, Mar 16, 2025 at 10:38 PM Wayne Xia wrote: > +1 (binding_ > >

[DISCUSS] Blog on Parquet Pruning

2025-03-18 Thread Andrew Lamb
There is a PR to cross post a blog about Parquet pruning on the DataFusion site[1]. Please take a look and leave comments if you are interested. [1]: https://github.com/apache/datafusion-site/pull/60

[ANNOUNCE] New DataFusion committer: Marko Milenković (milenkovicm)

2025-03-17 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Marko Milenković has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! The PMC

Re: [VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-16 Thread Andrew Lamb
+1 (binding) I verified this on Mac M3 Thank you Xudong! Andrew On Sun, Mar 16, 2025 at 7:00 AM Wang Xudong wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 46.0.1. > > This release candidate is based on commit: > 68f29038953d91191a46656968488f1e7bb4c327 [1] > T

Re: [VOTE] Release Apache DataFusion Comet 0.7.0 RC1

2025-03-14 Thread Andrew Lamb
+1 (binding) Looks like a good release to me. Verified on M3 Mac Thanks Andy Andrew On Thu, Mar 13, 2025 at 11:25 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Andy. > > > On Thu, Mar 13, 2025 at 5:57 PM Andy Grove wrote: > > > > Hi, > > > > > > I would like to pro

Re: [CROWDSOURCING] March 2025 ASF Board Report

2025-03-12 Thread Andrew Lamb
Thank you to everyone who contributed to this quarters report. I have submitted to the ASF board and filed a ticket for the next report in June [1] [1]: https://github.com/apache/datafusion/issues/15182 On Mon, Mar 10, 2025 at 8:52 AM Andrew Lamb wrote: > I have incorporated feedback left

Re: Request for Updated Discord Link for GSoC 2025 Participation

2025-03-11 Thread Andrew Lamb
THanks for the report. Can you confirm what link you tried and what error you saw? On Tue, Mar 11, 2025 at 6:08 AM ARKA DASH <23f2001...@ds.study.iitm.ac.in> wrote: > Dear Apache DataFusion Team, > > I hope this email finds you well. My name is Arka Dash, and I am interested > in applying for Goo

Re: [CROWDSOURCING] March 2025 ASF Board Report

2025-03-10 Thread Andrew Lamb
on organizing one in London in April 2025[1]. [1]: https://github.com/apache/datafusion/discussions/14647 On Sat, Mar 1, 2025 at 7:06 AM Andrew Lamb wrote: > Hello Fearless DataFusion(iers)! > > We have an ASF board report due in 2 weeks and I have started a draft. > > Please

Re: discuss: Forward github discussion to dev list

2025-03-08 Thread Andrew Lamb
Thank you Xuanwo, I agree with your broader point that using mailing lists for discussions makes it harder for many to participate (for example they need to already be subscribed to the mailing list to respond to a past comment / thread) We actually do forward all github activity to a mailing lis

[DISCUSS] Adding insta to DataFusion testing

2025-03-07 Thread Andrew Lamb
There is a very nice PR [1] that adds better testing for datafusion-cli, but also adds the insta to the stack. This is yet another test dependency, but I think adds significant value going forward Please comment on the PR if you are interested [1]: https://github.com/apache/datafusion/pull/13672

[RESULT] [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-07 Thread Andrew Lamb
Resending with the correct subject line On Fri, Mar 7, 2025 at 2:25 PM Andrew Lamb wrote: > With 7 +1 votes, 5 binding the release is approved > > Success! The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.0 > > I have

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-07 Thread Andrew Lamb
With 7 +1 votes, 5 binding the release is approved Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.0 I have also uploaded the release to crates.io Thanks again everyone for your help On Thu, Mar 6, 2025 at 11:19 AM Jonah Gao wrote

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.55.0 RC1

2025-03-05 Thread Andrew Lamb
.0 1` on M1 Mac. > > Ran an example, `echo "select 1;" | cargo run --example cli -` > > > > Best, > > Kevin Liu > > > > > > On Thu, Feb 27, 2025 at 11:30 AM L. C. Hsieh wrote: > > > > > +1 (binding) > > > > >

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-04 Thread Andrew Lamb
variable to display a > backtrace > > > failures: > fuzz_cases::sort_fuzz::test_sort_10k_mem > > test result: FAILED. 64 passed; 1 failed; 0 ignored; 0 measured; 0 filtered > out; finished in 74.07s > ``` > > Best, > Kevin Liu > > On Tue, Mar 4, 2025 at 7

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-04 Thread Andrew Lamb
+1 (binding) I ran the verification script on an M3 mac. Thank you so much Xudong! Andrew On Tue, Mar 4, 2025 at 9:47 AM Wang Xudong wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 46.0.0. > > This release candidate is based on commit: > d5ca8307940c1a6345419a2c

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-04 Thread Andrew Lamb
apache/datafusion/pull/14985 > > On Mon, Mar 3, 2025 at 10:04 AM Andrew Lamb > wrote: > > > I think something in rustup changed: > > > https://github.com/apache/datafusion/issues/14982#issuecomment-2694821546 > > > > On Mon, Mar 3, 2025 at 11:58 AM Andy Grove

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
ng the rust-toolchain file > to refer to channel "stable" rather than a specific version number seems to > fix this. > > On Mon, Mar 3, 2025 at 9:25 AM Andrew Lamb wrote: > > > I have a PR with a workaround for the release verification issue[1]. > > > >

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
Mon, Mar 3, 2025 at 10:44 AM Andrew Lamb wrote: > Thanks Xudong! > > I ran the verification script > ``` > $ ./dev/release/verify-release-candidate.sh 46.0.0 1 > ``` > > And it errored in the following way: > > ``` > error: toolchain '1.85.0-aarch64-appl

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
Thanks Xudong! I ran the verification script ``` $ ./dev/release/verify-release-candidate.sh 46.0.0 1 ``` And it errored in the following way: ``` error: toolchain '1.85.0-aarch64-apple-darwin' is not installed help: run `rustup toolchain install 1.85.0-aarch64-apple-darwin` to install it + clea

Re: [VOTE] Release Apache DataFusion Ballista 44.0.0 RC1

2025-03-01 Thread Andrew Lamb
+1 (binding) Verified on M3 Mac Looks like a good release. Thanks Marko for all the work on this one and Andy for doing the release process! Andrew On Sat, Mar 1, 2025 at 2:40 PM Marko Milenković wrote: > +1 non-binding > Verified on Mac M4 > > Thanks Andy! > > Best regards, > > -- > Marko Mi

[CROWDSOURCING] March 2025 ASF Board Report

2025-03-01 Thread Andrew Lamb
Hello Fearless DataFusion(iers)! We have an ASF board report due in 2 weeks and I have started a draft. Please feel free to post comments to the doc[1] or the ticket[2] or this thread and I will incorporate them [1]: https://docs.google.com/document/d/11b2GEmPh5gblWWegeZi3G38e97vRqHSRElkLTwZHrjY

[VOTE] Release Apache DataFusion sqlparser-rs 0.55.0 RC1

2025-02-27 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.55.0. This release candidate is based on commit: ed416548dcfe4a73a3240bbf625fb9010a4925c8 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify

Re: Blog Post for 45 Release

2025-02-25 Thread Andrew Lamb
iu > > On Sun, Feb 23, 2025 at 5:16 AM Andrew Lamb > wrote: > > > Hello DataFusion community. > > > > Bruce has created a blog post for our most recent release[1]. > > > > It looks quite good in my opinion and I plan to merge / publish it > > t

Blog Post for 45 Release

2025-02-23 Thread Andrew Lamb
Hello DataFusion community. Bruce has created a blog post for our most recent release[1]. It looks quite good in my opinion and I plan to merge / publish it tomorrow. Please leave any comments you may have or let us know if you would like more time to review Andrew [1]: https://github.com/apach

  1   2   3   >