[ 
https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14338152#comment-14338152
 ] 

Apache Spark commented on SPARK-6036:
-------------------------------------

User 'liyezhang556520' has created a pull request for this issue:
https://github.com/apache/spark/pull/4785

> EventLog process logic has race condition with Akka actor system
> ----------------------------------------------------------------
>
>                 Key: SPARK-6036
>                 URL: https://issues.apache.org/jira/browse/SPARK-6036
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 1.3.0
>            Reporter: Zhang, Liye
>
> when application finished, akka actor system will trigger disassociated 
> event, and Master will rebuild SparkUI on web, in which progress will check 
> whether the eventlog files are still in progress. The current logic in 
> SparkContext is first stop the actorsystem, and then stop enentLogListener. 
> This will cause that the enentLogListener has not finished renaming the 
> eventLog dir name (from app-xxxx.inprogress to app-xxxx)  when Spark Master 
> try to access the dir. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to