GitHub user carsonwang opened a pull request:
https://github.com/apache/spark/pull/6827
[SPARK-8372] History server shows incorrect information for application not
started
The history server may show an incorrect App ID for an incomplete
application like <App ID>.inprogress. This app info will never disappear even
after the app is completed.
The cause of the issue is that a log path name is used as the app id when
app id cannot be got during replay.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/carsonwang/spark SPARK-8372
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6827.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6827
----
commit d8c9cd0dd5bdfa4aa7f5da98fa6fe5a905becdc3
Author: Carson Wang <[email protected]>
Date: 2015-06-12T08:38:17Z
Replaying events only return information when app is started
commit 90f5ddefb80ea6019e0593471fb5763fcb487970
Author: Carson Wang <[email protected]>
Date: 2015-06-15T02:20:46Z
Add a unit test
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
