Re: Getting the ball started on a 2.4.6 release

[Sean Owen]

Looks like we have 1 marked for 2.4.6:
https://issues.apache.org/jira/projects/SPARK/versions/12346781

https://issues.apache.org/jira/browse/SPARK-31234 ResetCommand should
not wipe out all configs

Xiao might be able to comment on that one.

On Mon, Apr 20, 2020 at 11:31 AM Holden Karau  wrote:
>
> Hi folks,
>
> I’m going to get started on putting together a 2.4.6 release to come out 
> hopefully around the same time as 3.0. Are there any changes in master folks 
> think we should be considering backporting to a 2.4.6 release?
>
> Cheers,
>
> Holden :)
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau

-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Getting the ball started on a 2.4.6 release

[Holden Karau]

Hi folks,

I’m going to get started on putting together a 2.4.6 release to come out
hopefully around the same time as 3.0. Are there any changes in master
folks think we should be considering backporting to a 2.4.6 release?

Cheers,

Holden :)
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

graceful shutdown for slave host for Spark Standalone Cluster

[aakash aakash]

Hi,

We use ec2 to run batch spark jobs to filter and process our data and
sometimes we need to replace the host or deploy a new fleet.  Since we run
the driver in cluster mode and if the host goes down it will be
detrimental. We also use some native code to make sure our table is
modified by only one customer and that does not allow us to use supervise
mode.

I was wondering whether the Standalone cluster has a way to have graceful
shutdown for slaves whether it allows finishing the current running driver
and executor and does not take any new request from the master. So we can
implement a sidecar and once all running driver and executor finish we can
allow shut down by the host.

Thanks for your help and suggestion!

Regards,
Aakash

Re: Getting the ball started on a 2.4.6 release

[Xiao Li]

Yes. This one got merged yesterday.

Thanks!

Xiao

On Mon, Apr 20, 2020 at 10:51 AM Sean Owen  wrote:

> Looks like we have 1 marked for 2.4.6:
> https://issues.apache.org/jira/projects/SPARK/versions/12346781
>
> https://issues.apache.org/jira/browse/SPARK-31234 ResetCommand should
> not wipe out all configs
>
> Xiao might be able to comment on that one.
>
> On Mon, Apr 20, 2020 at 11:31 AM Holden Karau 
> wrote:
> >
> > Hi folks,
> >
> > I’m going to get started on putting together a 2.4.6 release to come out
> hopefully around the same time as 3.0. Are there any changes in master
> folks think we should be considering backporting to a 2.4.6 release?
> >
> > Cheers,
> >
> > Holden :)
> > --
> > Twitter: https://twitter.com/holdenkarau
> > Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9
> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
> -
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>

--