Github user ArtRand commented on the issue:
https://github.com/apache/spark/pull/13143
Hello @devaraj-kavali. Yes. I've been playing around with this because it's
inconvenient to clean up ZK whenever you uninstall/reinstall the Dispatcher.
The problem is that the only signal of a re-install vs. a failover is when
Mesos gives you a `DRIVER_ABORTED` error (signals a re-install). I think a
solution will involve having different methods to starting `SchedulerDrivers`
for Spark Drivers (applications) and the Dispatcher because they inherently
have different requirements with respect to state.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
