Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21356
So, to clarify a little more what the previous code did:
`ListenerBus.postToAll()` catches non-fatal exceptions from each individual
listener and ignores them; but `InterruptedException` is not one of those, so
the old code would stop the context like Imran says.
If we just wanted to emulate the old behavior we could do that, although I
agree it's better to try not to do that.
It's weird that HDFS would be throwing that exception in the caller thread,
but at the same time, it's an issue that we have to work around, since even if
they fix HDFS, there are just so many versions out there for that to not matter
much.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
