Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-31 Thread Holden Karau
I've already cut a new RC so I'd rather save SPARK-29536 but I'll include mention of that in the vote e-mail. On Sun, May 31, 2020 at 4:09 PM Sean Owen wrote: > Probably, though given the late stage of this release cycle, I'd say that > should go into 2.4.7. > I think we are good to for a

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-31 Thread Sean Owen
Probably, though given the late stage of this release cycle, I'd say that should go into 2.4.7. I think we are good to for a probably fine 2.4.6 RC4 ? the indylambda change was merged a while ago. On Sat, May 30, 2020 at 8:52 AM Ismaël Mejía wrote: > I was wondering if there is any chance that

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-30 Thread Ismaël Mejía
I was wondering if there is any chance that "SPARK-29536 PySpark does not work with Python 3.8.0" could get eventually backported for a future RC. Seems important enough considering that python 3.8 is now the default version for people working on the latest Ubuntu LTS. I understand however that

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
That seems like an important concern. I'm going to go ahead and vote -1 on this RC and I'll roll a new RC once the IndyLambda support is backported into the 2.4 branch. On Mon, May 18, 2020 at 2:58 PM DB Tsai wrote: > I am changing my vote from +1 to +0. > > Since Spark 3.0 is Scala 2.12 only,

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread DB Tsai
I am changing my vote from +1 to +0. Since Spark 3.0 is Scala 2.12 only, having a transitional 2.4.x release with great support of Scala 2.12 is very important. I would like to have [SPARK-31399][CORE] Support indylambda Scala closure in ClosureCleaner backported. Without it, it might break

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
Another two candidates for backporting that have come up since this RC are SPARK-31692 & SPARK-31399. What are folks thoughts, should we roll an RC4? On Mon, May 18, 2020 at 2:13 PM Sean Owen wrote: > Ah OK, I assumed from the timing that this was cut to include that commit. > I should have

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Sean Owen
Ah OK, I assumed from the timing that this was cut to include that commit. I should have looked. Yes, it is not strictly a regression so does not have to block the release and this can pass. We can release 2.4.7 in a few months, too. How important is the fix? If it's pretty important, it may still

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
That is correct. I asked on the PR if that was ok with folks before I moved forward with the RC and was told that it was ok. I believe that particular bug is not a regression and is a long standing issue so we wouldn’t normally block the release on it. On Mon, May 18, 2020 at 7:40 AM Xiao Li

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Xiao Li
This RC does not include the correctness bug fix https://github.com/apache/spark/commit/a4885f3654899bcb852183af70cc0a82e7dd81d0 which is just after RC3 cut. On Mon, May 18, 2020 at 7:21 AM Tom Graves wrote: > +1. > > Tom > > On Monday, May 18, 2020, 08:05:24 AM CDT, Wenchen Fan > wrote: > > >

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Tom Graves
+1. Tom On Monday, May 18, 2020, 08:05:24 AM CDT, Wenchen Fan wrote: +1, no known blockers. On Mon, May 18, 2020 at 12:49 AM DB Tsai wrote: +1 as well. Thanks. On Sun, May 17, 2020 at 7:39 AM Sean Owen wrote: +1 , same response as to the last RC. This looks like it includes the

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Wenchen Fan
+1, no known blockers. On Mon, May 18, 2020 at 12:49 AM DB Tsai wrote: > +1 as well. Thanks. > > On Sun, May 17, 2020 at 7:39 AM Sean Owen wrote: > >> +1 , same response as to the last RC. >> This looks like it includes the fix discussed last time, as well as a >> few more small good fixes. >>

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-17 Thread DB Tsai
+1 as well. Thanks. On Sun, May 17, 2020 at 7:39 AM Sean Owen wrote: > +1 , same response as to the last RC. > This looks like it includes the fix discussed last time, as well as a > few more small good fixes. > > On Sat, May 16, 2020 at 12:08 AM Holden Karau > wrote: > > > > Please vote on

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-17 Thread Sean Owen
+1 , same response as to the last RC. This looks like it includes the fix discussed last time, as well as a few more small good fixes. On Sat, May 16, 2020 at 12:08 AM Holden Karau wrote: > > Please vote on releasing the following candidate as Apache Spark version > 2.4.6. > > The vote is open

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-17 Thread Prashant Sharma
+1, Looks good. Thank you for putting this together. On Sat, May 16, 2020 at 10:38 AM Holden Karau wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.4.6. > > The vote is open until May 22nd at 9AM PST and passes if a majority +1 PMC > votes are cast, with a

[VOTE] Release Spark 2.4.6 (RC3)

2020-05-15 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4 .6. The vote is open until May 22nd at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because