[
https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498555#comment-14498555
]
Matt Cheah edited comment on SPARK-6950 at 4/16/15 7:31 PM:
------------------------------------------------------------
This is no longer an issue on the tip of branch-1.3, as:
(1) Fixing SPARK-6107 would make any .inprogress event logs be parsed, and
(2) I believe somewhere between the released 1.3 and the current 1.3, the event
log stopping was forced to stop before the Spark master UI was notified that
the application completed.
I'll close this out for now but will re-open it if I continue to see the issue
after 1.3.1 is released and I update to it.
was (Author: mcheah):
This is no longer an issue on the tip of branch-1.3, as:
(1) Fixing SPARK-6107 would make any .inprogress event logs be parsed, and
(2) I believe somewhere between the released 1.3 and the current 1.3, the event
log stopping was forced to stop before the Spark master UI was notified that
the application completed.
> Spark master UI believes some applications are in progress when they are
> actually completed
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-6950
> URL: https://issues.apache.org/jira/browse/SPARK-6950
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.3.0
> Reporter: Matt Cheah
> Fix For: 1.3.1
>
>
> In Spark 1.2.x, I was able to set my spark event log directory to be a
> different location from the default, and after the job finishes, I can replay
> the UI by clicking on the appropriate link under "Completed Applications".
> Now, on a non-deterministic basis (but seems to happen most of the time),
> when I click on the link under "Completed Applications", I instead get a
> webpage that says:
> Application history not found (app-20150415052927-0014)
> Application myApp is still in progress.
> I am able to view the application's UI using the Spark history server, so
> something regressed in the Spark master code between 1.2 and 1.3, but that
> regression does not apply in the history server use case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
