Zhang, Liye created SPARK-6036:
----------------------------------
Summary: EventLog process logic has race condition with Akka actor
system
Key: SPARK-6036
URL: https://issues.apache.org/jira/browse/SPARK-6036
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Affects Versions: 1.3.0
Reporter: Zhang, Liye
when application finished, akka actor system will trigger disassociated event,
and Master will rebuild SparkUI on web, in which progress will check whether
the eventlog files are still in progress. The current logic in SparkContext is
first stop the actorsystem, and then stop enentLogListener. This will cause
that the enentLogListener has not finished renaming the eventLog dir name (from
app-xxxx.inprogress to app-xxxx) when Spark Master try to access the dir.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
