Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21166
1. We improve the DAGScheduler to always send TaskEnd message. So the issue
I found before may not be valid.
2. We refactored the LiveListenerQueue to make it more robust for internal
listener. We cannot guarantee that event will never be lost, but the chance is
quite small (SPARK-18838).
IMHO you (as a PR submitter) should validate this issue with latest code
and make sure you can reproduce it with latest code.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
