Re: Apache Spark 3.2.4 EOL Release?

Hi, Dongjoon Hyun Maybe we need include the fix of SPARK-39696 in Apache Spark 3.2.4 EOL Release, this will fix a data race issue in access to TaskMetrics.externalAccums when using Scala 2.13.8 and the corresponding Scala 2.13 release of Spark 3.2.x also uses Scala 2.13.8. 1.

Re: Apache Spark 3.2.4 EOL Release?

Thank you for reporting. I'll check that, too. Dongjoon. On Thu, Apr 6, 2023 at 1:13 AM yangjie01 wrote: > Hi, Dongjoon Hyun > > Maybe we need include the fix of SPARK-39696 in Apache Spark 3.2.4 EOL > Release, this will fix a data race issue in access to > TaskMetrics.externalAccums when

Re: Slack for Spark Community: Merging various threads

Hi Mich, If repeated discussions indicate anything, it is that there is no consensus among maintainers regarding using Slack as an *official* communication channel. So which members and whose democracy are w talking about? I don't recall any vote... Oh, and when did we become a democracy

Re: Slack for Spark Community: Merging various threads

Hello Since last Friday we have had 84 members in the sparkcommunitytalk.slack.com so that is a vote for itself in a democratic way (as far as I am concerned.) With regard to the other matters, I agree one can have as much discussion as desired. I leave it to others. I don't have any more to add

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

I suggest placing the fix of SPARK-39696 in the next RC, which is an issue that will be triggered after Scala 2.13.7. 1. https://issues.apache.org/jira/browse/SPARK-39696 2. https://github.com/apache/spark/pull/40663 Yang Jie 发件人: John Zhuge 日期: 2023年4月6日 星期四 13:59 收件人: Anton

Re: Slack for Spark Community: Merging various threads

Thanks Dongjoon, but I don't think this is misleading insofar that this is not a *self-service process* but an invite process which admittedly I did not state explicitly in my previous thread. And thanks for the invite to the-ASF Slack - I just joined :) Saying this, I do completely agree with

Re: [VOTE] Release Apache Spark 3.4.0 (RC5)

Thanks all. I am cutting v3.4.0-rc6 now considering all blockers have been resolved. On Thu, Apr 6, 2023 at 1:07 AM yangjie01 wrote: > I suggest placing the fix of SPARK-39696 in the next RC, which is an issue > that will be triggered after Scala 2.13.7. > > > > 1.

Re: Slack for Spark Community: Merging various threads

Hi, I have been following this thread and want to add my 2 cents. Apache Airflow project got Slack channel and it's self service! I joined it and it costs me zero to use it where as one Mich send requires payed subscription. IMHO, it will be major barrier for people to join just ask a question. I

[VOTE] Release Apache Spark 3.4.0 (RC6)

Please vote on releasing the following candidate(RC6) as Apache Spark version 3.4.0. The vote is open until 11:59pm Pacific time *April 11th* and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.4.0 [ ] -1 Do not release this

Re: Slack for Spark Community: Merging various threads

Additionally. there is no indication that the-asf.slack.com is intended for general support. In particular it states the following > The Apache Software Foundation has a workspace on Slack to provide channels on which people working on the same ASF project, or in

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

Thanks @yangjie01. I marked SPARK-39696 as a blocker. On Thu, Apr 6, 2023 at 4:35 PM yangjie01 wrote: > -1 for me due to this RC not include the fix of SPARK-39696, SPARK-39696 > will fix a data race issue in access to TaskMetrics.externalAccums when > using Scala 2.13.8 and this issue will

Re: Slack for Spark Community: Merging various threads

To me, the most important opportunity here is to create a better support environment for users, and I think it’s super important to allow users to join immediately on their own if we want this to succeed. A lot of users these days do prefer to join a live chat interface to get support for an

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

-1 for me due to this RC not include the fix of SPARK-39696, SPARK-39696 will fix a data race issue in access to TaskMetrics.externalAccums when using Scala 2.13.8 and this issue will cause high-frequency Executor crash when use Scala 2.13 distribution according to the user's

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

Thank you! Let me recut the RC then. On Thu, Apr 6, 2023 at 6:14 PM Hyukjin Kwon wrote: > Merged the fix. > > On Fri, 7 Apr 2023 at 10:07, Xinrong Meng > wrote: > >> Thanks @yangjie01. I marked SPARK-39696 as a blocker. >> >> On Thu, Apr 6, 2023 at 4:35 PM yangjie01 wrote: >> >>> -1 for me

Re: [VOTE] Release Apache Spark 3.4.0 (RC6)

Merged the fix. On Fri, 7 Apr 2023 at 10:07, Xinrong Meng wrote: > Thanks @yangjie01. I marked SPARK-39696 as a blocker. > > On Thu, Apr 6, 2023 at 4:35 PM yangjie01 wrote: > >> -1 for me due to this RC not include the fix of SPARK-39696, SPARK-39696 >> will fix a data race issue in access to

Re: Slack for Spark Community: Merging various threads

Reminds me of a case of flogging a dead horse. This has already been discussed many times and there is no need for further discussion or summary. The newly created stack community sparkcommunitytalk.slack.com is a reality and is there to stay.