Re: [FYI] SPARK-47993: Drop Python 3.8

+1 On Thu, Apr 25, 2024 at 2:08 PM Holden Karau wrote: > +1 > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 > YouTube Live Streams: https://www.youtube.com/user/holdenkarau > > > On Thu,

Re: Re: [VOTE] SPARK-44444: Use ANSI SQL mode by default

+1 Thank you @Dongjoon Hyun ! On Mon, Apr 15, 2024 at 6:33 AM beliefer wrote: > +1 > > > 在 2024-04-15 15:54:07，"Peter Toth" 写道： > > +1 > > Wenchen Fan ezt írta (időpont: 2024. ápr. 15., H, > 9:08): > >> +1 >> >> On Sun, Apr 14, 2024 at 6:28 AM Dongjoon Hyun >> wrote: >> >>> I'll start from

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 Thank you @Hyukjin Kwon On Mon, Apr 1, 2024 at 10:19 AM Felix Cheung wrote: > +1 > -- > *From:* Denny Lee > *Sent:* Monday, April 1, 2024 10:06:14 AM > *To:* Hussein Awala > *Cc:* Chao Sun ; Hyukjin Kwon ; > Mridul Muralidharan ; dev > *Subject:* Re: [VOTE]

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 Thanks @Gengliang Wang ! On Mon, Mar 11, 2024 at 1:09 PM Gengliang Wang wrote: > Hi Steve, > > thanks for the suggestion in this email thread and the SPIP doc! I will > read the Audit Log and seek your feedback through PR reviews during the > implementation process. > > > So worrying about

Re: [ANNOUNCE] Apache Spark 3.5.1 released

Congratulations! Thanks, Xinrong On Thu, Feb 29, 2024 at 11:16 AM Dongjoon Hyun wrote: > Congratulations! > > Bests, > Dongjoon. > > On Wed, Feb 28, 2024 at 11:43 AM beliefer wrote: > >> Congratulations! >> >> >> >> At 2024-02-28 17:43:25, "Jungtaek Lim" >> wrote: >> >> Hi everyone, >> >> We

Re: Welcome to Our New Apache Spark Committer and PMCs

Congratulations! On Mon, Oct 9, 2023 at 5:06 AM Kent Yao wrote: > Congrats! > > Kent > > > 在 2023年10月7日星期六，John Zhuge 写道： > >> Congratulations! >> >> On Fri, Oct 6, 2023 at 6:41 PM Yi Wu >> wrote: >> >>> Congrats! >>> >>> On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: >>>

Re: [VOTE] Release Apache Spark 3.5.0 (RC4)

+1 Thank you for driving the release! On Fri, Sep 8, 2023 at 10:12 AM Jungtaek Lim wrote: > +1 (non-binding) > > Thanks for driving this release! > > On Fri, Sep 8, 2023 at 11:29 AM Holden Karau wrote: > >> +1 pip installing seems to function :) >> >> On Thu, Sep 7, 2023 at 7:22 PM Yuming

Re: Some questions about Spark github action

/build_and_test.yml#L72 to be helpful. Thanks, Xinrong Meng On Thu, Aug 24, 2023 at 11:52 AM Jack Wells wrote: > Hi Jia, > > Github Action workflows are stored in the .github/workflows directory off > the base of the git repo. Here’s a link: > https://github.com/apache/spark/tree/master/.g

Re: Time for Spark v3.5.0 release

+1 Thank you! On Tue, Jul 4, 2023 at 3:04 PM Jungtaek Lim wrote: > +1 > > On Wed, Jul 5, 2023 at 2:23 AM L. C. Hsieh wrote: > >> +1 >> >> Thanks Yuanjian. >> >> On Tue, Jul 4, 2023 at 7:45 AM yangjie01 wrote: >> > >> > +1 >> > >> > >> > >> > 发件人: Maxim Gekk >> > 日期: 2023年7月4日 星期二 17:24 >> >

Re: [VOTE][SPIP] PySpark Test Framework

+1 Thanks for driving that! On Wed, Jun 21, 2023 at 10:25 PM Ruifeng Zheng wrote: > +1 > > On Thu, Jun 22, 2023 at 1:11 PM Dongjoon Hyun > wrote: > >> +1 >> >> Dongjoon >> >> On Wed, Jun 21, 2023 at 8:56 PM Hyukjin Kwon >> wrote: >> >>> +1 >>> >>> On Thu, 22 Jun 2023 at 02:20, Jacek

Re: [VOTE] Release Spark 3.4.1 (RC1)

+1 Thank you! On Wed, Jun 21, 2023 at 1:14 AM Peter Toth wrote: > +1 > > Ruifeng Zheng ezt írta (időpont: 2023. jún. 21., > Sze, 9:43): > >> +1 >> >> On Wed, Jun 21, 2023 at 2:26 PM huaxin gao >> wrote: >> >>> +1 >>> >>> On Tue, Jun 20, 2023 at 11:21 PM Hyukjin Kwon >>> wrote: >>> +1

Re: Apache Spark 3.4.1 Release?

+1. Thank you Doonjoon! Thanks, Xinrong Meng Mridul Muralidharan 于2023年6月9日 周五上午5:22写道： > > +1, thanks Dongjoon ! > > Regards, > Mridul > > On Thu, Jun 8, 2023 at 7:16 PM Jia Fan > wrote: > >> +1 >> >> >> >&g

[UPDATE] Apache Spark 3.5.0 Release Window

Hi All, Apache Spark 3.5.0 Release Window is adjusted by #461 <https://github.com/apache/spark-website/pull/461>. Please check the latest information on the official website https://spark.apache.org/versioning-policy.html. Thanks, Xinrong Meng

Re: Spark 3.4.0 with Hadoop2.7 cannot be downloaded

651> . The option to download Spark 3.4.0 with Hadoop2.7 has been removed from the Downloads page to avoid confusion. Thanks, Xinrong Meng On Wed, Apr 19, 2023 at 11:24 PM Enrico Minack wrote: > Hi, > > selecting Spark 3.4.0 with Hadoop2.7 at > https://spark.apache.org/downloads.html le

Re: [ANNOUNCE] Apache Spark 3.4.0 released

wrote: >>>> >>>>> Thank you Xinrong! >>>>> >>>>> Congratulations everyone! This is a great release with tons of new >>>>> features! >>>>> >>>>> >>>>> >>>&g

[ANNOUNCE] Apache Spark 3.4.0 released

/spark-release-3-4-0.html We would like to acknowledge all community members for contributing to this release. This release would not have been possible without you. Thanks, Xinrong Meng

[VOTE][RESULT] Release Apache Spark 3.4.0 (RC7)

- Yikun Jiang - Yuming Wang - Wenchen Fan (*) - Jia Fan - Peter Toth - Xiao Li (*) - Ye Zhou - Jungtaek Lim - believer - Chris Nauroth - Emil Ejbyfeldt - Lucifer Tyrant *+0:* None *-1:* None --- Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

+1 non-binding Thank you Doogjoon! Wenchen Fan 于2023年4月10日 周一下午11:32写道： > +1 > > On Tue, Apr 11, 2023 at 10:09 AM Hyukjin Kwon wrote: > >> +1 >> >> On Tue, 11 Apr 2023 at 11:04, Ruifeng Zheng wrote: >> >>> +1 (non-binding) >>> >>> Thank you for driving this release! >>> >>>

[VOTE] Release Apache Spark 3.4.0 (RC7)

committer to help target the issue. Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

I am able to proceed with the release now. I'll send an announcement when the RC cut is completed. Xinrong On Fri, Apr 7, 2023 at 9:54 AM Dongjoon Hyun wrote: > Got it. Thank you for sharing the current status. > > Dongjoon. > > On Fri, Apr 7, 2023 at 9:21 AM Xinrong Meng &

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

> > Dongjoon. > > > On Thu, Apr 6, 2023 at 6:17 PM Xinrong Meng > wrote: > >> Thank you! Let me recut the RC then. >> >> On Thu, Apr 6, 2023 at 6:14 PM Hyukjin Kwon wrote: >> >>> Merged the fix. >>> >>> On Fri, 7 Apr 2023

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

Thank you! Let me recut the RC then. On Thu, Apr 6, 2023 at 6:14 PM Hyukjin Kwon wrote: > Merged the fix. > > On Fri, 7 Apr 2023 at 10:07, Xinrong Meng > wrote: > >> Thanks @yangjie01. I marked SPARK-39696 as a blocker. >> >> On Thu, Apr 6, 2023 at 4:35 PM y

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

olve this issue although SPARK-39696 was not set as a blocker when > reported. > > > > Yang Jie > > > > *发件人**: *Xinrong Meng > *日期**: *2023年4月7日 星期五 05:27 > *收件人**: *dev > *主题**: *[VOTE] Release Apache Spark 3.4.0 (RC6) > > > > Please vote on releas

[VOTE] Release Apache Spark 3.4.0 (RC6)

se ping me or a committer to help target the issue. Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

nobody > created a PR yet. > > - Anton > > On 2023/04/05 19:09:13 Xiao Li wrote: > > Hi, Anton, > > > > Could you please provide a complete list of exceptions that are being > used > > in the public connector API? > > > > Thanks, > > >

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

://issues.apache.org/jira/browse/SPARK-40360 >> [3] - >> https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/NoSuchItemException.scala >> >> - Anton >> >> On 2023/04/05 16:23:52 Xinrong Meng wrote: >>

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

Considering the above blockers have been resolved, I am about to cut v3.4.0-rc6 if no objections. On Tue, Apr 4, 2023 at 8:20 AM Xinrong Meng wrote: > Thank you Wenchen for the report. I marked them as blockers just now. > > On Tue, Apr 4, 2023 at 10:52 AM Wenchen Fan wrote: &

Re: Apache Spark 3.2.4 EOL Release?

+1 Hyukjin Kwon 于2023年4月4日 周二下午5:31写道： > +1 > > On Wed, 5 Apr 2023 at 07:31, Mridul Muralidharan wrote: > >> >> +1 >> Sounds good to me. >> >> Thanks, >> Mridul >> >> >> On Tue, Apr 4, 2023 at 1:39 PM huaxin gao wrote: >> >>> +1 >>> >>> On Tue, Apr 4, 2023 at 11:17 AM Chao Sun wrote: >>>

Release Note of Apache Spark 3.4.0

draft release note of Apache Spark 3.4.0. Please feel free to add your comments if any. Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

t; >> > On Mon, Apr 3, 2023 at 1:57 AM yangjie01 wrote: >> >> >> >> +1, checked Java 17 + Scala 2.13 + Python 3.10.10. >> >> >> >> >> >> >> >> 发件人: Herman van Hovell >> >> 日期: 2023年3月31日 星期五 12:12 >> >>

[VOTE] Release Apache Spark 3.4.0 (RC5)

se ping me or a committer to help target the issue. Thanks, Xinrong Meng

Re: Re: [VOTE] Release Apache Spark 3.4.0 (RC4)

to the ticket above for details and instructions. Thanks, Xinrong Meng On Sat, Mar 11, 2023 at 8:33 PM Bjørn Jørgensen wrote: > Ubuntu 23.04 > java --version > openjdk 17.0.6 2023-01-17 > OpenJDK Runtime Environment (build 17.0.6+10-Ubuntu-1) > OpenJDK 64-Bit Server VM (build 17.0.6+10-Ubunt

Re: Re: [VOTE] Release Apache Spark 3.4.0 (RC4)

Thank you @beliefer. On Sat, Mar 11, 2023 at 9:54 AM beliefer wrote: > There is a bug fix. > > https://issues.apache.org/jira/browse/SPARK-42740 > > > > 在 2023-03-10 20:48:30，"Xinrong Meng" 写道： > > https://issues.apache.org/jira/browse/SPARK-42745 can be a

Re: [VOTE] Release Apache Spark 3.4.0 (RC4)

https://issues.apache.org/jira/browse/SPARK-42745 can be a new release blocker, thanks @Peter Toth for reporting that. On Fri, Mar 10, 2023 at 8:21 PM Xinrong Meng wrote: > Please vote on releasing the following candidate(RC4) as Apache Spark > version 3.4.0. > > The vote is open u

Re: [VOTE] Release Apache Spark 3.4.0 (RC3)

ith the RC4 cut if possible. > > Thanks, > Peter > > Xinrong Meng ezt írta (időpont: 2023. márc. > 10., P, 0:07): > >> Thank you Hyukjin! :) >> >> I would prefer to cut v3.4.0-rc4 now if there are no objections. >> >> On Fri, Mar 10, 2023 at 7:01 AM Hyuk

[VOTE] Release Apache Spark 3.4.0 (RC4)

se ping me or a committer to help target the issue. Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.4.0 (RC3)

0, 2023 at 7:58 AM Hyukjin Kwon wrote: > >> I guess directly tagging is fine too I guess. >> I don't mind cutting the RC4 right away either if that's what you prefer. >> >> On Fri, Mar 10, 2023 at 7:06 AM Xinrong Meng >> wrote: >> >>> Hi All, >>

Re: [VOTE] Release Apache Spark 3.4.0 (RC3)

gt;>>>> * f3e69a1fe2 >>>>> * 74cf1a32b0 >>>>> * 0191a5bde0 >>>>> * afced91348 >>>>> | * (tag: v3.4.0-rc3) b9be9ce15a >>>>> |/ >>>>> * 006e838ede >>>>> * fc29b07a31 >>>>> * 8655dfe66d >>

[VOTE] Release Apache Spark 3.4.0 (RC3)

se ping me or a committer to help target the issue. Thanks, Xinrong Meng

[VOTE] Release Apache Spark 3.4.0 (RC2)

committer to help target the issue. Thanks, Xinrong Meng

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

>>>> [INFO] Total time: 05:58 h >>>> [INFO] Finished at: 2023-02-22T22:28:38+01:00 >>>> [INFO] >>>> >>>> [ERROR] Failed to execute goal >>>&g

Re: [DISCUSS] Show Python code examples first in Spark documentation

+1 Good idea! On Thu, Feb 23, 2023 at 7:41 AM Jack Goodson wrote: > Good idea, at the company I work at we discussed using Scala as our > primary language because technically it is slightly stronger than python > but ultimately chose python in the end as it’s easier for other devs to be > on

Re: [VOTE] Release Apache Spark 3.4.0 (RC1)

apache.org" > > gpg: Can't check signature: No public key > > > > Regards, > Mridul > > [1] https://dist.apache.org/repos/dist/dev/spark/KEYS > > > On Tue, Feb 21, 2023 at 10:36 PM Xinrong Meng > wrote: > >> Please vote on releasing the followi

[VOTE] Release Apache Spark 3.4.0 (RC1)

committer to help target the issue. Thanks, Xinrong Meng

Re: Time for Spark 3.4.0 release?

Hi All, Apache Spark 3.4 is cut as https://github.com/apache/spark/tree/branch-3.4. Thanks, Xinrong Meng On Wed, Jan 18, 2023 at 3:45 PM Hyukjin Kwon wrote: > Yeah, these more look like something we should discuss around RC timing. > See "Spark 3.4 release window&

Re: Time for Spark 3.4.0 release?

have other ongoing big items for Spark 3.4. Thanks, Xinrong Meng On Sat, Jan 7, 2023 at 9:16 AM Hyukjin Kwon wrote: > Thanks Xinrong. > > On Sat, Jan 7, 2023 at 9:18 AM Xinrong Meng > wrote: > >> The release window for Apache Spark 3.4.0 is updated per >> http

Re: Time for Spark 3.4.0 release?

gt;>>>>>>> >>>>>>>> Thanks Xinrong! >>>>>>>> >>>>>>>> -Rui >>>>>>>> >>>>>>>> On Tue, Jan 3, 2023 at 9:21 PM 416161...@qq.com < >>>&

Time for Spark 3.4.0 release?

, Xinrong Meng

Re: Welcome Yikun Jiang as a Spark committer

Congratulations, Yikun! Well deserved. On Sun, Oct 9, 2022 at 9:36 PM John Zhuge wrote: > Congratulations, Yikun! > > On Sun, Oct 9, 2022 at 8:52 PM Senthil Kumar wrote: > >> Congratulations Yikun >> >> On Mon, 10 Oct 2022, 09:11 Xiao Li, wrote: >> >>> Congratulations, Yikun! >>> >>> Xiao >>>

Re: Dropping Apache Spark Hadoop2 Binary Distribution?

+1. On Wed, Oct 5, 2022 at 1:53 PM Xiao Li wrote: > +1. > > Xiao > > On Wed, Oct 5, 2022 at 12:49 PM Sean Owen wrote: > >> I'm OK with this. It simplifies maintenance a bit, and specifically may >> allow us to finally move off of the ancient version of Guava (?) >> >> On Mon, Oct 3, 2022 at

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 On Tue, Sep 20, 2022 at 11:08 PM Qian SUN wrote: > +1. > It's valuable, can I be involved in this work? > > Yikun Jiang 于2022年9月19日周一 08:15写道： > >> Hi, all >> >> I would like to start the discussion for supporting Docker Official Image >> for Spark. >> >> This SPIP is proposed to add Docker

Re: Welcome Xinrong Meng as a Spark committer

Thank you All! On Wed, Aug 10, 2022 at 11:00 AM Peter Toth wrote: > Congratulations! > > Bjørn Jørgensen ezt írta (időpont: 2022. aug. > 10., Sze, 12:21): > >> Congratulations :) >> >> tir. 9. aug. 2022 kl. 10:13 skrev Hyukjin Kwon : >> >>> Hi a

Re: Welcoming three new PMC members

Congratulations! Well deserved! On Wed, Aug 10, 2022 at 3:22 AM Bjørn Jørgensen wrote: > Congratulations :) > > tir. 9. aug. 2022 kl. 18:40 skrev Xiao Li : > >> Hi all, >> >> The Spark PMC recently voted to add three new PMC members. Join me in >> welcoming them to their new roles! >> >> New

Re: Update Spark 3.4 Release Window?

, etc. until final release passe On Wed, Jul 20, 2022 at 1:27 PM Xinrong Meng wrote: > Hi All, > > Since Spark 3.3.0 was released on June 16, 2022, shall we update the > release window https://spark.apache.org/versioning-policy.html for Spark > 3.4? > > A proposal is as follow

Update Spark 3.4 Release Window?

, stability and docs. Generally, no new features merged. | November 2022 | Release candidates (RC), voting, etc. until final release passes Thanks! Xinrong Meng

Re: Apache Spark 3.2.2 Release?

+1 Thanks! Xinrong Meng Software Engineer Databricks On Wed, Jul 6, 2022 at 7:25 PM Xiao Li wrote: > +1 > > Xiao > > Cheng Su 于2022年7月6日周三 19:16写道： > >> +1 (non-binding) >> >> Thanks, >> Cheng Su >> >> On Wed, Jul 6, 2022 at 6:01

Re: Introducing "Pandas API on Spark" component in JIRA, and use "PS" PR title component

Great! It saves us from always specifying "Pandas API on Spark" in PR titles. Thanks! Xinrong Meng Software Engineer Databricks On Tue, May 17, 2022 at 1:08 AM Maciej wrote: > Sounds good! > > +1 > > On 5/17/22 06:08, Yikun Jiang wrote: > &