[
https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498555#comment-14498555
]
Matt Cheah commented on SPARK-6950:
-----------------------------------
This is no longer an issue on the tip of branch-1.3, as:
(1) Fixing SPARK-6107 would make any .inprogress event logs be parsed, and
(2) I believe somewhere between the released 1.3 and the current 1.3, the event
log stopping was forced to stop before the Spark master UI was notified that
the application completed.
> Spark master UI believes some applications are in progress when they are
> actually completed
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-6950
> URL: https://issues.apache.org/jira/browse/SPARK-6950
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.3.0
> Reporter: Matt Cheah
>
> In Spark 1.2.x, I was able to set my spark event log directory to be a
> different location from the default, and after the job finishes, I can replay
> the UI by clicking on the appropriate link under "Completed Applications".
> Now, on a non-deterministic basis (but seems to happen most of the time),
> when I click on the link under "Completed Applications", I instead get a
> webpage that says:
> Application history not found (app-20150415052927-0014)
> Application myApp is still in progress.
> I am able to view the application's UI using the Spark history server, so
> something regressed in the Spark master code between 1.2 and 1.3, but that
> regression does not apply in the history server use case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
