Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
> @squito reading the code here:
https://github.com/apache/spark/pull/21068/files
is there an option to update the info about blacklisted node when there is
a mesos task failure.
It is a bit inconvenient to lose such events and wait for spark tasks to
fail which may never launch since you dont have any executors running anyway.
That change does not cover mesos, to keep the scope a little smaller and
because none of us really know how to test on mesos. But it should be pretty
straightforward to refactor whats there so you could use the same general logic
in mesos. I think it would be easy for you to unify a lot of that, even the
failure validity interval stuff.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
