Github user caneGuy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21664#discussion_r200828384
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1049,6 +1049,13 @@ class DAGScheduler(
abortStage(stage, s"Task serialization failed:
$e\n${Utils.exceptionString(e)}", Some(e))
runningStages -= stage
return
+
+ case e: NoClassDefFoundError =>
--- End diff --
Actually,i will cause job hung since the state never update.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
