Re:[VOTE] Release Apache Spark 3.4.0 (RC7)

[beliefer]

+1




At 2023-04-08 07:29:46, "Xinrong Meng"  wrote:

Please vote on releasing the following candidate(RC7) as Apache Spark version 
3.4.0.

The vote is open until 11:59pm Pacific time April 12th and passes if a majority 
+1 PMC votes are cast, with a minimum of 3 +1 votes.

[ ] +1 Release this package as Apache Spark 3.4.0
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see http://spark.apache.org/

The tag to be voted on is v3.4.0-rc7 (commit 
87a5442f7ed96b11051d8a9333476d080054e5a0):
https://github.com/apache/spark/tree/v3.4.0-rc7

The release files, including signatures, digests, etc. can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/

Signatures used for Spark RCs can be found in this file:
https://dist.apache.org/repos/dist/dev/spark/KEYS

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1441

The documentation corresponding to this release can be found at:
https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/

The list of bug fixes going into 3.4.0 can be found at the following URL:
https://issues.apache.org/jira/projects/SPARK/versions/12351465

This release is using the release script of the tag v3.4.0-rc7.


FAQ

=
How can I help test this release?
=
If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.

If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with an out of date RC going forward).

===
What should happen to JIRA tickets still targeting 3.4.0?
===
The current list of open tickets targeted at 3.4.0 can be found at:
https://issues.apache.org/jira/projects/SPARK and search for "Target Version/s" 
= 3.4.0

Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.

==
But my bug isn't fixed?
==
In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.

Thanks,
Xinrong Meng

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

[Jungtaek Lim]

+1 (non-binding)

Thanks for driving the release!

On Wed, Apr 12, 2023 at 3:41 AM Xinrong Meng 
wrote:

> +1 non-binding
>
> Thank you Doogjoon!
>
> Wenchen Fan 于2023年4月10日 周一下午11:32写道：
>
>> +1
>>
>> On Tue, Apr 11, 2023 at 10:09 AM Hyukjin Kwon 
>> wrote:
>>
>>> +1
>>>
>>> On Tue, 11 Apr 2023 at 11:04, Ruifeng Zheng 
>>> wrote:
>>>
 +1 (non-binding)

 Thank you for driving this release!

 --
 Ruifeng  Zheng
 ruife...@foxmail.com

 



 -- Original --
 *From:* "Yuming Wang" ;
 *Date:* Tue, Apr 11, 2023 09:56 AM
 *To:* "Mridul Muralidharan";
 *Cc:* "huaxin gao";"Chao Sun"<
 sunc...@apache.org>;"yangjie01";"Dongjoon Hyun"<
 dongj...@apache.org>;"Sean Owen";"
 dev@spark.apache.org";
 *Subject:* Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

 +1.

 On Tue, Apr 11, 2023 at 12:17 AM Mridul Muralidharan 
 wrote:

> +1
>
> Signatures, digests, etc check out fine.
> Checked out tag and build/tested with -Phive -Pyarn -Pmesos
> -Pkubernetes
>
> Regards,
> Mridul
>
>
> On Mon, Apr 10, 2023 at 10:34 AM huaxin gao 
> wrote:
>
>> +1
>>
>> On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:
>>
>>> +1 (non-binding)
>>>
>>> On Mon, Apr 10, 2023 at 7:07 AM yangjie01 
>>> wrote:
>>>
 +1 (non-binding)



 *发件人**: *Sean Owen 
 *日期**: *2023年4月10日 星期一 21:19
 *收件人**: *Dongjoon Hyun 
 *抄送**: *"dev@spark.apache.org" 
 *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)



 +1 from me



 On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
 wrote:

 I'll start with my +1.

 I verified the checksum, signatures of the artifacts, and
 documentations.
 Also, ran the tests with YARN and K8s modules.

 Dongjoon.

 On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
 > Please vote on releasing the following candidate as Apache Spark
 version
 > 3.2.4.
 >
 > The vote is open until April 13th 1AM (PST) and passes if a
 majority +1 PMC
 > votes are cast, with a minimum of 3 +1 votes.
 >
 > [ ] +1 Release this package as Apache Spark 3.2.4
 > [ ] -1 Do not release this package because ...
 >
 > To learn more about Apache Spark, please see
 https://spark.apache.org/
 
 >
 > The tag to be voted on is v3.2.4-rc1 (commit
 > 0ae10ac18298d1792828f1d59b652ef17462d76e)
 > https://github.com/apache/spark/tree/v3.2.4-rc1
 
 >
 > The release files, including signatures, digests, etc. can be
 found at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
 
 >
 > Signatures used for Spark RCs can be found in this file:
 > https://dist.apache.org/repos/dist/dev/spark/KEYS
 
 >
 > The staging repository for this release can be found at:
 >
 https://repository.apache.org/content/repositories/orgapachespark-1442/
 
 >
 > The documentation corresponding to this release can be found at:
 > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
 
 >
 > The list of bug fixes going into 3.2.4 can be found at the
 following URL:
 > https://issues.apache.org/jira/projects/SPARK/versions/12352607
 
 >
 > This release is using the release script of the tag v3.2.4-rc1.
 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Jungtaek Lim]

+1 (non-binding)

Thanks for driving the release!

On Wed, Apr 12, 2023 at 10:42 AM Ye Zhou  wrote:

> +1 non-binding
>
> On Tue, Apr 11, 2023 at 18:40 Ye Zhou  wrote:
>
>> Yes, it is not a regression issue. We can fix it after the release.
>>
>> Thanks
>> Ye
>>
>> On Tue, Apr 11, 2023 at 17:42 Xiao Li  wrote:
>>
>>> Thanks for testing it in your environment!
>>>
>>>
 This is a minor issue itself, and only impacts the metrics for
 push-based shuffle, but it will essentially completely eliminate the effort
 in SPARK-36620.
>>>
>>>
>>> Based on my understanding, this is not a regression. It only affects the
>>> new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If
>>> so, it does not block the release RC.
>>>
>>> We should still fix it in 3.4 and the fix will be available in the next
>>> maintenance releases.
>>>
>>> Xiao
>>>
>>>
>>>
>>> Ye Zhou  于2023年4月11日周二 17:14写道：
>>>
 Manually tested the binary in our cluster.
 Started spark-shell application with some shuffle. Found one issue
 which is related to push based shuffle client side metrics introduced in
 https://github.com/apache/spark/pull/36165.
 Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100,
 posted PR there, and verified that the PR fixes the issue.

 This is a minor issue itself, and only impacts the metrics for
 push-based shuffle, but it will essentially completely eliminate the effort
 in SPARK-36620.

 Would like to raise this issue in the voting thread, but hold my
 non-binding -1 here.


 On Tue, Apr 11, 2023 at 1:06 AM Peter Toth 
 wrote:

> +1
>
> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K,
> 9:09):
>
>> +1
>>
>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>
>>> +1
>>>
>>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang 
>>> wrote:
>>>
 +1.

 On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
 wrote:

> +1 (non-binding)
>
> Also ran the docker image related test (signatures/standalone/k8s)
> with rc7: https://github.com/apache/spark-docker/pull/32
>
> Regards,
> Yikun
>
>
> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
> wrote:
>
>> +1
>>
>> * Built fine with Scala 2.13
>> and 
>> -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>> * Ran some demos on Java 17
>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> 
>> "The Internals Of" Online Books 
>> Follow me on https://twitter.com/jaceklaskowski
>>
>> 
>>
>>
>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
>> xinrong.apa...@gmail.com> wrote:
>>
>>> Please vote on releasing the following candidate(RC7) as Apache
>>> Spark version 3.4.0.
>>>
>>> The vote is open until 11:59pm Pacific time *April 12th* and
>>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
>>> votes.
>>>
>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see
>>> http://spark.apache.org/
>>>
>>> The tag to be voted on is v3.4.0-rc7 (commit
>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>>
>>> The release files, including signatures, digests, etc. can be
>>> found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>> The staging repository for this release can be found at:
>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>>
>>> The documentation corresponding to this release can be found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>>
>>> The list of bug fixes going into 3.4.0 can be found at the
>>> following URL:
>>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>>
>>> This release is using the release script of the tag v3.4.0-rc7.
>>>
>>>
>>> FAQ
>>>
>>> =
>>> How can I help test this release?
>>> =
>>> If you are a Spark user, you can help us test this release by
>>> taking
>>> an existing Spark workload and running on this release
>>> candidate, then

Spark Multiple Hive Metastore Catalog Support

[Ankit Gupta]

Hi All

The question is regarding the support of multiple Remote Hive Metastore
catalogs with Spark. Starting Spark 3, multiple catalog support is added in
spark, but have we implemented any CatalogPlugin that can help us configure
multiple Remote Hive Metastore Catalogs ? If yes, can anyone help me with
the Fully Qualified Class Name that I can try using for configuring a Hive
Metastore Catalog. If not, I would like to work on the implementation of
the CatalogPlugin that we can use to configure multiple Hive Metastore
Servers' .

Thanks and Regards.

Ankit Prakash Gupta
+91 8750101321
info.ank...@gmail.com

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Ye Zhou]

+1 non-binding

On Tue, Apr 11, 2023 at 18:40 Ye Zhou  wrote:

> Yes, it is not a regression issue. We can fix it after the release.
>
> Thanks
> Ye
>
> On Tue, Apr 11, 2023 at 17:42 Xiao Li  wrote:
>
>> Thanks for testing it in your environment!
>>
>>
>>> This is a minor issue itself, and only impacts the metrics for
>>> push-based shuffle, but it will essentially completely eliminate the effort
>>> in SPARK-36620.
>>
>>
>> Based on my understanding, this is not a regression. It only affects the
>> new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If
>> so, it does not block the release RC.
>>
>> We should still fix it in 3.4 and the fix will be available in the next
>> maintenance releases.
>>
>> Xiao
>>
>>
>>
>> Ye Zhou  于2023年4月11日周二 17:14写道：
>>
>>> Manually tested the binary in our cluster.
>>> Started spark-shell application with some shuffle. Found one issue which
>>> is related to push based shuffle client side metrics introduced in
>>> https://github.com/apache/spark/pull/36165.
>>> Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100,
>>> posted PR there, and verified that the PR fixes the issue.
>>>
>>> This is a minor issue itself, and only impacts the metrics for
>>> push-based shuffle, but it will essentially completely eliminate the effort
>>> in SPARK-36620.
>>>
>>> Would like to raise this issue in the voting thread, but hold my
>>> non-binding -1 here.
>>>
>>>
>>> On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:
>>>
 +1

 Jia Fan  ezt írta (időpont: 2023. ápr. 11., K,
 9:09):

> +1
>
> Wenchen Fan  于2023年4月11日周二 14:32写道：
>
>> +1
>>
>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>
>>> +1.
>>>
>>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
>>> wrote:
>>>
 +1 (non-binding)

 Also ran the docker image related test (signatures/standalone/k8s)
 with rc7: https://github.com/apache/spark-docker/pull/32

 Regards,
 Yikun


 On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
 wrote:

> +1
>
> * Built fine with Scala 2.13
> and 
> -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
> * Ran some demos on Java 17
> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>
> Pozdrawiam,
> Jacek Laskowski
> 
> "The Internals Of" Online Books 
> Follow me on https://twitter.com/jaceklaskowski
>
> 
>
>
> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
> xinrong.apa...@gmail.com> wrote:
>
>> Please vote on releasing the following candidate(RC7) as Apache
>> Spark version 3.4.0.
>>
>> The vote is open until 11:59pm Pacific time *April 12th* and
>> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
>> votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.4.0
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>
>> The tag to be voted on is v3.4.0-rc7 (commit
>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>
>> The release files, including signatures, digests, etc. can be
>> found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>
>> Signatures used for Spark RCs can be found in this file:
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>> The staging repository for this release can be found at:
>>
>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>
>> The documentation corresponding to this release can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>
>> The list of bug fixes going into 3.4.0 can be found at the
>> following URL:
>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>
>> This release is using the release script of the tag v3.4.0-rc7.
>>
>>
>> FAQ
>>
>> =
>> How can I help test this release?
>> =
>> If you are a Spark user, you can help us test this release by
>> taking
>> an existing Spark workload and running on this release candidate,
>> then
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and
>> install
>> the current RC and see if anything important breaks, in the
>> Java/Scala
>> you can add the 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Ye Zhou]

Yes, it is not a regression issue. We can fix it after the release.

Thanks
Ye

On Tue, Apr 11, 2023 at 17:42 Xiao Li  wrote:

> Thanks for testing it in your environment!
>
>
>> This is a minor issue itself, and only impacts the metrics for push-based
>> shuffle, but it will essentially completely eliminate the effort
>> in SPARK-36620.
>
>
> Based on my understanding, this is not a regression. It only affects the
> new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If so,
> it does not block the release RC.
>
> We should still fix it in 3.4 and the fix will be available in the next
> maintenance releases.
>
> Xiao
>
>
>
> Ye Zhou  于2023年4月11日周二 17:14写道：
>
>> Manually tested the binary in our cluster.
>> Started spark-shell application with some shuffle. Found one issue which
>> is related to push based shuffle client side metrics introduced in
>> https://github.com/apache/spark/pull/36165.
>> Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted
>> PR there, and verified that the PR fixes the issue.
>>
>> This is a minor issue itself, and only impacts the metrics for push-based
>> shuffle, but it will essentially completely eliminate the effort
>> in SPARK-36620.
>>
>> Would like to raise this issue in the voting thread, but hold my
>> non-binding -1 here.
>>
>>
>> On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:
>>
>>> +1
>>>
>>> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):
>>>
 +1

 Wenchen Fan  于2023年4月11日周二 14:32写道：

> +1
>
> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>
>> +1.
>>
>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
>> wrote:
>>
>>> +1 (non-binding)
>>>
>>> Also ran the docker image related test (signatures/standalone/k8s)
>>> with rc7: https://github.com/apache/spark-docker/pull/32
>>>
>>> Regards,
>>> Yikun
>>>
>>>
>>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
>>> wrote:
>>>
 +1

 * Built fine with Scala 2.13
 and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
 * Ran some demos on Java 17
 * Mac mini / Apple M2 Pro / Ventura 13.3.1

 Pozdrawiam,
 Jacek Laskowski
 
 "The Internals Of" Online Books 
 Follow me on https://twitter.com/jaceklaskowski

 


 On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
 xinrong.apa...@gmail.com> wrote:

> Please vote on releasing the following candidate(RC7) as Apache
> Spark version 3.4.0.
>
> The vote is open until 11:59pm Pacific time *April 12th* and
> passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
> votes.
>
> [ ] +1 Release this package as Apache Spark 3.4.0
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> The tag to be voted on is v3.4.0-rc7 (commit
> 87a5442f7ed96b11051d8a9333476d080054e5a0):
> https://github.com/apache/spark/tree/v3.4.0-rc7
>
> The release files, including signatures, digests, etc. can be
> found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
>
> https://repository.apache.org/content/repositories/orgapachespark-1441
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>
> The list of bug fixes going into 3.4.0 can be found at the
> following URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>
> This release is using the release script of the tag v3.4.0-rc7.
>
>
> FAQ
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by
> taking
> an existing Spark workload and running on this release candidate,
> then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and
> install
> the current RC and see if anything important breaks, in the
> Java/Scala
> you can add the staging repository to your projects resolvers and
> test
> with the RC (make sure to clean up the artifact cache before/after
> so
> you don't end up building with an out of date RC going forward).

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Xiao Li]

Thanks for testing it in your environment!


> This is a minor issue itself, and only impacts the metrics for push-based
> shuffle, but it will essentially completely eliminate the effort
> in SPARK-36620.


Based on my understanding, this is not a regression. It only affects the
new enhancements https://issues.apache.org/jira/browse/SPARK-36620 If so,
it does not block the release RC.

We should still fix it in 3.4 and the fix will be available in the next
maintenance releases.

Xiao



Ye Zhou  于2023年4月11日周二 17:14写道：

> Manually tested the binary in our cluster.
> Started spark-shell application with some shuffle. Found one issue which
> is related to push based shuffle client side metrics introduced in
> https://github.com/apache/spark/pull/36165.
> Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted
> PR there, and verified that the PR fixes the issue.
>
> This is a minor issue itself, and only impacts the metrics for push-based
> shuffle, but it will essentially completely eliminate the effort
> in SPARK-36620.
>
> Would like to raise this issue in the voting thread, but hold my
> non-binding -1 here.
>
>
> On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:
>
>> +1
>>
>> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):
>>
>>> +1
>>>
>>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>>
 +1

 On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:

> +1.
>
> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
> wrote:
>
>> +1 (non-binding)
>>
>> Also ran the docker image related test (signatures/standalone/k8s)
>> with rc7: https://github.com/apache/spark-docker/pull/32
>>
>> Regards,
>> Yikun
>>
>>
>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
>> wrote:
>>
>>> +1
>>>
>>> * Built fine with Scala 2.13
>>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>>> * Ran some demos on Java 17
>>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>>
>>> Pozdrawiam,
>>> Jacek Laskowski
>>> 
>>> "The Internals Of" Online Books 
>>> Follow me on https://twitter.com/jaceklaskowski
>>>
>>> 
>>>
>>>
>>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng <
>>> xinrong.apa...@gmail.com> wrote:
>>>
 Please vote on releasing the following candidate(RC7) as Apache
 Spark version 3.4.0.

 The vote is open until 11:59pm Pacific time *April 12th* and
 passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 
 votes.

 [ ] +1 Release this package as Apache Spark 3.4.0
 [ ] -1 Do not release this package because ...

 To learn more about Apache Spark, please see
 http://spark.apache.org/

 The tag to be voted on is v3.4.0-rc7 (commit
 87a5442f7ed96b11051d8a9333476d080054e5a0):
 https://github.com/apache/spark/tree/v3.4.0-rc7

 The release files, including signatures, digests, etc. can be found
 at:
 https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/

 Signatures used for Spark RCs can be found in this file:
 https://dist.apache.org/repos/dist/dev/spark/KEYS

 The staging repository for this release can be found at:

 https://repository.apache.org/content/repositories/orgapachespark-1441

 The documentation corresponding to this release can be found at:
 https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/

 The list of bug fixes going into 3.4.0 can be found at the
 following URL:
 https://issues.apache.org/jira/projects/SPARK/versions/12351465

 This release is using the release script of the tag v3.4.0-rc7.


 FAQ

 =
 How can I help test this release?
 =
 If you are a Spark user, you can help us test this release by taking
 an existing Spark workload and running on this release candidate,
 then
 reporting any regressions.

 If you're working in PySpark you can set up a virtual env and
 install
 the current RC and see if anything important breaks, in the
 Java/Scala
 you can add the staging repository to your projects resolvers and
 test
 with the RC (make sure to clean up the artifact cache before/after
 so
 you don't end up building with an out of date RC going forward).

 ===
 What should happen to JIRA tickets still targeting 3.4.0?
 ===
 The current list of open tickets targeted at 3.4.0 can be found at:
 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Ye Zhou]

Manually tested the binary in our cluster.
Started spark-shell application with some shuffle. Found one issue which is
related to push based shuffle client side metrics introduced in
https://github.com/apache/spark/pull/36165.
Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted PR
there, and verified that the PR fixes the issue.

This is a minor issue itself, and only impacts the metrics for push-based
shuffle, but it will essentially completely eliminate the effort
in SPARK-36620.

Would like to raise this issue in the voting thread, but hold my
non-binding -1 here.


On Tue, Apr 11, 2023 at 1:06 AM Peter Toth  wrote:

> +1
>
> Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):
>
>> +1
>>
>> Wenchen Fan  于2023年4月11日周二 14:32写道：
>>
>>> +1
>>>
>>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>>
 +1.

 On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang 
 wrote:

> +1 (non-binding)
>
> Also ran the docker image related test (signatures/standalone/k8s)
> with rc7: https://github.com/apache/spark-docker/pull/32
>
> Regards,
> Yikun
>
>
> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
> wrote:
>
>> +1
>>
>> * Built fine with Scala 2.13
>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>> * Ran some demos on Java 17
>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> 
>> "The Internals Of" Online Books 
>> Follow me on https://twitter.com/jaceklaskowski
>>
>> 
>>
>>
>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
>> wrote:
>>
>>> Please vote on releasing the following candidate(RC7) as Apache
>>> Spark version 3.4.0.
>>>
>>> The vote is open until 11:59pm Pacific time *April 12th* and passes
>>> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>>
>>> [ ] +1 Release this package as Apache Spark 3.4.0
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see
>>> http://spark.apache.org/
>>>
>>> The tag to be voted on is v3.4.0-rc7 (commit
>>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>>
>>> The release files, including signatures, digests, etc. can be found
>>> at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>>
>>> Signatures used for Spark RCs can be found in this file:
>>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>>
>>> The staging repository for this release can be found at:
>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>>
>>> The documentation corresponding to this release can be found at:
>>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>>
>>> The list of bug fixes going into 3.4.0 can be found at the following
>>> URL:
>>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>>
>>> This release is using the release script of the tag v3.4.0-rc7.
>>>
>>>
>>> FAQ
>>>
>>> =
>>> How can I help test this release?
>>> =
>>> If you are a Spark user, you can help us test this release by taking
>>> an existing Spark workload and running on this release candidate,
>>> then
>>> reporting any regressions.
>>>
>>> If you're working in PySpark you can set up a virtual env and install
>>> the current RC and see if anything important breaks, in the
>>> Java/Scala
>>> you can add the staging repository to your projects resolvers and
>>> test
>>> with the RC (make sure to clean up the artifact cache before/after so
>>> you don't end up building with an out of date RC going forward).
>>>
>>> ===
>>> What should happen to JIRA tickets still targeting 3.4.0?
>>> ===
>>> The current list of open tickets targeted at 3.4.0 can be found at:
>>> https://issues.apache.org/jira/projects/SPARK and search for
>>> "Target Version/s" = 3.4.0
>>>
>>> Committers should look at those and triage. Extremely important bug
>>> fixes, documentation, and API tweaks that impact compatibility should
>>> be worked on immediately. Everything else please retarget to an
>>> appropriate release.
>>>
>>> ==
>>> But my bug isn't fixed?
>>> ==
>>> In order to make timely releases, we will typically not hold the
>>> release unless the bug in question is a regression from the previous
>>> release. That being said, if there is something which is a regression
>>> that has not been correctly targeted please ping me 

Re: [SparkSQL, SparkUI, RESTAPI] How to extract the WholeStageCodeGen ids from SparkUI

[Chitral Verma]

try explain codegen on your DF and then pardee the string

On Fri, 7 Apr, 2023, 3:53 pm Chenghao Lyu,  wrote:

> Hi,
>
> The detailed stage page shows the involved WholeStageCodegen Ids in its
> DAG visualization from the Spark UI when running a SparkSQL. (e.g., under
> the link
> node:18088/history/application_1663600377480_62091/stages/stage/?id=1=0).
>
> However, I have trouble extracting the WholeStageCodegen ids from the DAG
> visualization via the RESTAPIs. Is there any other way to get the
> WholeStageCodegen Ids information for each stage automatically?
>
> Cheers,
> Chenghao
>

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

[Xinrong Meng]

+1 non-binding

Thank you Doogjoon!

Wenchen Fan 于2023年4月10日 周一下午11:32写道：

> +1
>
> On Tue, Apr 11, 2023 at 10:09 AM Hyukjin Kwon  wrote:
>
>> +1
>>
>> On Tue, 11 Apr 2023 at 11:04, Ruifeng Zheng  wrote:
>>
>>> +1 (non-binding)
>>>
>>> Thank you for driving this release!
>>>
>>> --
>>> Ruifeng  Zheng
>>> ruife...@foxmail.com
>>>
>>> 
>>>
>>>
>>>
>>> -- Original --
>>> *From:* "Yuming Wang" ;
>>> *Date:* Tue, Apr 11, 2023 09:56 AM
>>> *To:* "Mridul Muralidharan";
>>> *Cc:* "huaxin gao";"Chao Sun">> >;"yangjie01";"Dongjoon 
>>> >Hyun";"Sean
>>> Owen";"dev@spark.apache.org";
>>> *Subject:* Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>>
>>> +1.
>>>
>>> On Tue, Apr 11, 2023 at 12:17 AM Mridul Muralidharan 
>>> wrote:
>>>
 +1

 Signatures, digests, etc check out fine.
 Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes

 Regards,
 Mridul


 On Mon, Apr 10, 2023 at 10:34 AM huaxin gao 
 wrote:

> +1
>
> On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:
>
>> +1 (non-binding)
>>
>> On Mon, Apr 10, 2023 at 7:07 AM yangjie01 
>> wrote:
>>
>>> +1 (non-binding)
>>>
>>>
>>>
>>> *发件人**: *Sean Owen 
>>> *日期**: *2023年4月10日 星期一 21:19
>>> *收件人**: *Dongjoon Hyun 
>>> *抄送**: *"dev@spark.apache.org" 
>>> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>>
>>>
>>>
>>> +1 from me
>>>
>>>
>>>
>>> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
>>> wrote:
>>>
>>> I'll start with my +1.
>>>
>>> I verified the checksum, signatures of the artifacts, and
>>> documentations.
>>> Also, ran the tests with YARN and K8s modules.
>>>
>>> Dongjoon.
>>>
>>> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
>>> > Please vote on releasing the following candidate as Apache Spark
>>> version
>>> > 3.2.4.
>>> >
>>> > The vote is open until April 13th 1AM (PST) and passes if a
>>> majority +1 PMC
>>> > votes are cast, with a minimum of 3 +1 votes.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 3.2.4
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> > To learn more about Apache Spark, please see
>>> https://spark.apache.org/
>>> 
>>> >
>>> > The tag to be voted on is v3.2.4-rc1 (commit
>>> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
>>> > https://github.com/apache/spark/tree/v3.2.4-rc1
>>> 
>>> >
>>> > The release files, including signatures, digests, etc. can be
>>> found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
>>> 
>>> >
>>> > Signatures used for Spark RCs can be found in this file:
>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>>> 
>>> >
>>> > The staging repository for this release can be found at:
>>> >
>>> https://repository.apache.org/content/repositories/orgapachespark-1442/
>>> 
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
>>> 
>>> >
>>> > The list of bug fixes going into 3.2.4 can be found at the
>>> following URL:
>>> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
>>> 
>>> >
>>> > This release is using the release script of the tag v3.2.4-rc1.
>>> >
>>> > FAQ
>>> >
>>> > =
>>> > How can I help test this release?
>>> > =
>>> >
>>> > If you are a Spark user, you can help us test this release by
>>> taking
>>> > an existing Spark workload and running on this 

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Peter Toth]

+1

Jia Fan  ezt írta (időpont: 2023. ápr. 11., K, 9:09):

> +1
>
> Wenchen Fan  于2023年4月11日周二 14:32写道：
>
>> +1
>>
>> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>>
>>> +1.
>>>
>>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang  wrote:
>>>
 +1 (non-binding)

 Also ran the docker image related test (signatures/standalone/k8s) with
 rc7: https://github.com/apache/spark-docker/pull/32

 Regards,
 Yikun


 On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski 
 wrote:

> +1
>
> * Built fine with Scala 2.13
> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
> * Ran some demos on Java 17
> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>
> Pozdrawiam,
> Jacek Laskowski
> 
> "The Internals Of" Online Books 
> Follow me on https://twitter.com/jaceklaskowski
>
> 
>
>
> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
> wrote:
>
>> Please vote on releasing the following candidate(RC7) as Apache Spark
>> version 3.4.0.
>>
>> The vote is open until 11:59pm Pacific time *April 12th* and passes
>> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>>
>> [ ] +1 Release this package as Apache Spark 3.4.0
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see http://spark.apache.org/
>>
>> The tag to be voted on is v3.4.0-rc7 (commit
>> 87a5442f7ed96b11051d8a9333476d080054e5a0):
>> https://github.com/apache/spark/tree/v3.4.0-rc7
>>
>> The release files, including signatures, digests, etc. can be found
>> at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>>
>> Signatures used for Spark RCs can be found in this file:
>> https://dist.apache.org/repos/dist/dev/spark/KEYS
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1441
>>
>> The documentation corresponding to this release can be found at:
>> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>>
>> The list of bug fixes going into 3.4.0 can be found at the following
>> URL:
>> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>>
>> This release is using the release script of the tag v3.4.0-rc7.
>>
>>
>> FAQ
>>
>> =
>> How can I help test this release?
>> =
>> If you are a Spark user, you can help us test this release by taking
>> an existing Spark workload and running on this release candidate, then
>> reporting any regressions.
>>
>> If you're working in PySpark you can set up a virtual env and install
>> the current RC and see if anything important breaks, in the Java/Scala
>> you can add the staging repository to your projects resolvers and test
>> with the RC (make sure to clean up the artifact cache before/after so
>> you don't end up building with an out of date RC going forward).
>>
>> ===
>> What should happen to JIRA tickets still targeting 3.4.0?
>> ===
>> The current list of open tickets targeted at 3.4.0 can be found at:
>> https://issues.apache.org/jira/projects/SPARK and search for "Target
>> Version/s" = 3.4.0
>>
>> Committers should look at those and triage. Extremely important bug
>> fixes, documentation, and API tweaks that impact compatibility should
>> be worked on immediately. Everything else please retarget to an
>> appropriate release.
>>
>> ==
>> But my bug isn't fixed?
>> ==
>> In order to make timely releases, we will typically not hold the
>> release unless the bug in question is a regression from the previous
>> release. That being said, if there is something which is a regression
>> that has not been correctly targeted please ping me or a committer to
>> help target the issue.
>>
>> Thanks,
>> Xinrong Meng
>>
>

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Jia Fan]

+1

Wenchen Fan  于2023年4月11日周二 14:32写道：

> +1
>
> On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:
>
>> +1.
>>
>> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang  wrote:
>>
>>> +1 (non-binding)
>>>
>>> Also ran the docker image related test (signatures/standalone/k8s) with
>>> rc7: https://github.com/apache/spark-docker/pull/32
>>>
>>> Regards,
>>> Yikun
>>>
>>>
>>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski  wrote:
>>>
 +1

 * Built fine with Scala 2.13
 and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
 * Ran some demos on Java 17
 * Mac mini / Apple M2 Pro / Ventura 13.3.1

 Pozdrawiam,
 Jacek Laskowski
 
 "The Internals Of" Online Books 
 Follow me on https://twitter.com/jaceklaskowski

 


 On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
 wrote:

> Please vote on releasing the following candidate(RC7) as Apache Spark
> version 3.4.0.
>
> The vote is open until 11:59pm Pacific time *April 12th* and passes
> if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.
>
> [ ] +1 Release this package as Apache Spark 3.4.0
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v3.4.0-rc7 (commit
> 87a5442f7ed96b11051d8a9333476d080054e5a0):
> https://github.com/apache/spark/tree/v3.4.0-rc7
>
> The release files, including signatures, digests, etc. can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/
>
> Signatures used for Spark RCs can be found in this file:
> https://dist.apache.org/repos/dist/dev/spark/KEYS
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1441
>
> The documentation corresponding to this release can be found at:
> https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/
>
> The list of bug fixes going into 3.4.0 can be found at the following
> URL:
> https://issues.apache.org/jira/projects/SPARK/versions/12351465
>
> This release is using the release script of the tag v3.4.0-rc7.
>
>
> FAQ
>
> =
> How can I help test this release?
> =
> If you are a Spark user, you can help us test this release by taking
> an existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> If you're working in PySpark you can set up a virtual env and install
> the current RC and see if anything important breaks, in the Java/Scala
> you can add the staging repository to your projects resolvers and test
> with the RC (make sure to clean up the artifact cache before/after so
> you don't end up building with an out of date RC going forward).
>
> ===
> What should happen to JIRA tickets still targeting 3.4.0?
> ===
> The current list of open tickets targeted at 3.4.0 can be found at:
> https://issues.apache.org/jira/projects/SPARK and search for "Target
> Version/s" = 3.4.0
>
> Committers should look at those and triage. Extremely important bug
> fixes, documentation, and API tweaks that impact compatibility should
> be worked on immediately. Everything else please retarget to an
> appropriate release.
>
> ==
> But my bug isn't fixed?
> ==
> In order to make timely releases, we will typically not hold the
> release unless the bug in question is a regression from the previous
> release. That being said, if there is something which is a regression
> that has not been correctly targeted please ping me or a committer to
> help target the issue.
>
> Thanks,
> Xinrong Meng
>

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

[Wenchen Fan]

+1

On Tue, Apr 11, 2023 at 9:57 AM Yuming Wang  wrote:

> +1.
>
> On Tue, Apr 11, 2023 at 9:14 AM Yikun Jiang  wrote:
>
>> +1 (non-binding)
>>
>> Also ran the docker image related test (signatures/standalone/k8s) with
>> rc7: https://github.com/apache/spark-docker/pull/32
>>
>> Regards,
>> Yikun
>>
>>
>> On Tue, Apr 11, 2023 at 4:44 AM Jacek Laskowski  wrote:
>>
>>> +1
>>>
>>> * Built fine with Scala 2.13
>>> and -Pkubernetes,hadoop-cloud,hive,hive-thriftserver,scala-2.13,volcano
>>> * Ran some demos on Java 17
>>> * Mac mini / Apple M2 Pro / Ventura 13.3.1
>>>
>>> Pozdrawiam,
>>> Jacek Laskowski
>>> 
>>> "The Internals Of" Online Books 
>>> Follow me on https://twitter.com/jaceklaskowski
>>>
>>> 
>>>
>>>
>>> On Sat, Apr 8, 2023 at 1:30 AM Xinrong Meng 
>>> wrote:
>>>
 Please vote on releasing the following candidate(RC7) as Apache Spark
 version 3.4.0.

 The vote is open until 11:59pm Pacific time *April 12th* and passes if
 a majority +1 PMC votes are cast, with a minimum of 3 +1 votes.

 [ ] +1 Release this package as Apache Spark 3.4.0
 [ ] -1 Do not release this package because ...

 To learn more about Apache Spark, please see http://spark.apache.org/

 The tag to be voted on is v3.4.0-rc7 (commit
 87a5442f7ed96b11051d8a9333476d080054e5a0):
 https://github.com/apache/spark/tree/v3.4.0-rc7

 The release files, including signatures, digests, etc. can be found at:
 https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-bin/

 Signatures used for Spark RCs can be found in this file:
 https://dist.apache.org/repos/dist/dev/spark/KEYS

 The staging repository for this release can be found at:
 https://repository.apache.org/content/repositories/orgapachespark-1441

 The documentation corresponding to this release can be found at:
 https://dist.apache.org/repos/dist/dev/spark/v3.4.0-rc7-docs/

 The list of bug fixes going into 3.4.0 can be found at the following
 URL:
 https://issues.apache.org/jira/projects/SPARK/versions/12351465

 This release is using the release script of the tag v3.4.0-rc7.


 FAQ

 =
 How can I help test this release?
 =
 If you are a Spark user, you can help us test this release by taking
 an existing Spark workload and running on this release candidate, then
 reporting any regressions.

 If you're working in PySpark you can set up a virtual env and install
 the current RC and see if anything important breaks, in the Java/Scala
 you can add the staging repository to your projects resolvers and test
 with the RC (make sure to clean up the artifact cache before/after so
 you don't end up building with an out of date RC going forward).

 ===
 What should happen to JIRA tickets still targeting 3.4.0?
 ===
 The current list of open tickets targeted at 3.4.0 can be found at:
 https://issues.apache.org/jira/projects/SPARK and search for "Target
 Version/s" = 3.4.0

 Committers should look at those and triage. Extremely important bug
 fixes, documentation, and API tweaks that impact compatibility should
 be worked on immediately. Everything else please retarget to an
 appropriate release.

 ==
 But my bug isn't fixed?
 ==
 In order to make timely releases, we will typically not hold the
 release unless the bug in question is a regression from the previous
 release. That being said, if there is something which is a regression
 that has not been correctly targeted please ping me or a committer to
 help target the issue.

 Thanks,
 Xinrong Meng

>>>

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

[Wenchen Fan]

+1

On Tue, Apr 11, 2023 at 10:09 AM Hyukjin Kwon  wrote:

> +1
>
> On Tue, 11 Apr 2023 at 11:04, Ruifeng Zheng  wrote:
>
>> +1 (non-binding)
>>
>> Thank you for driving this release!
>>
>> --
>> Ruifeng  Zheng
>> ruife...@foxmail.com
>>
>> 
>>
>>
>>
>> -- Original --
>> *From:* "Yuming Wang" ;
>> *Date:* Tue, Apr 11, 2023 09:56 AM
>> *To:* "Mridul Muralidharan";
>> *Cc:* "huaxin gao";"Chao Sun"> >;"yangjie01";"Dongjoon Hyun";"Sean
>> Owen";"dev@spark.apache.org";
>> *Subject:* Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>
>> +1.
>>
>> On Tue, Apr 11, 2023 at 12:17 AM Mridul Muralidharan 
>> wrote:
>>
>>> +1
>>>
>>> Signatures, digests, etc check out fine.
>>> Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
>>>
>>> Regards,
>>> Mridul
>>>
>>>
>>> On Mon, Apr 10, 2023 at 10:34 AM huaxin gao 
>>> wrote:
>>>
 +1

 On Mon, Apr 10, 2023 at 8:17 AM Chao Sun  wrote:

> +1 (non-binding)
>
> On Mon, Apr 10, 2023 at 7:07 AM yangjie01  wrote:
>
>> +1 (non-binding)
>>
>>
>>
>> *发件人**: *Sean Owen 
>> *日期**: *2023年4月10日 星期一 21:19
>> *收件人**: *Dongjoon Hyun 
>> *抄送**: *"dev@spark.apache.org" 
>> *主题**: *Re: [VOTE] Release Apache Spark 3.2.4 (RC1)
>>
>>
>>
>> +1 from me
>>
>>
>>
>> On Sun, Apr 9, 2023 at 7:19 PM Dongjoon Hyun 
>> wrote:
>>
>> I'll start with my +1.
>>
>> I verified the checksum, signatures of the artifacts, and
>> documentations.
>> Also, ran the tests with YARN and K8s modules.
>>
>> Dongjoon.
>>
>> On 2023/04/09 23:46:10 Dongjoon Hyun wrote:
>> > Please vote on releasing the following candidate as Apache Spark
>> version
>> > 3.2.4.
>> >
>> > The vote is open until April 13th 1AM (PST) and passes if a
>> majority +1 PMC
>> > votes are cast, with a minimum of 3 +1 votes.
>> >
>> > [ ] +1 Release this package as Apache Spark 3.2.4
>> > [ ] -1 Do not release this package because ...
>> >
>> > To learn more about Apache Spark, please see
>> https://spark.apache.org/
>> 
>> >
>> > The tag to be voted on is v3.2.4-rc1 (commit
>> > 0ae10ac18298d1792828f1d59b652ef17462d76e)
>> > https://github.com/apache/spark/tree/v3.2.4-rc1
>> 
>> >
>> > The release files, including signatures, digests, etc. can be found
>> at:
>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-bin/
>> 
>> >
>> > Signatures used for Spark RCs can be found in this file:
>> > https://dist.apache.org/repos/dist/dev/spark/KEYS
>> 
>> >
>> > The staging repository for this release can be found at:
>> >
>> https://repository.apache.org/content/repositories/orgapachespark-1442/
>> 
>> >
>> > The documentation corresponding to this release can be found at:
>> > https://dist.apache.org/repos/dist/dev/spark/v3.2.4-rc1-docs/
>> 
>> >
>> > The list of bug fixes going into 3.2.4 can be found at the
>> following URL:
>> > https://issues.apache.org/jira/projects/SPARK/versions/12352607
>> 
>> >
>> > This release is using the release script of the tag v3.2.4-rc1.
>> >
>> > FAQ
>> >
>> > =
>> > How can I help test this release?
>> > =
>> >
>> > If you are a Spark user, you can help us test this release by taking
>> > an existing Spark workload and running on this release candidate,
>> then
>> > reporting any regressions.
>> >
>> > If you're working in PySpark you can set up a virtual env and
>> install
>> > the current RC and see if anything important breaks, in the