GitHub user twinkle-sachdeva opened a pull request:
https://github.com/apache/spark/pull/4845
Pull request for SPARK-4705 from master branch
Hi,
Following is the approach taken:
1. For applications with attempt ID," _<attempt_id>" has been added to file
name, while creating the event log file. For example, with attempt id file name
will be : application_1423546284151_0031_2
2. Added the attempt id inside the SparkListenerApplicationStart event, so
that same can be read while replaying the event log file too.
3. If there is no application with attempt id info (e.g. all played in
client mode ), then old UI will continue to display, as an application with
attempt id has been logged, then following new UI will start appearing
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/twinkle-sachdeva/spark SPARK-4705-Master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4845.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4845
----
commit 12a6cd3b7b5c9475e54060e5c6f5cac976c44b5c
Author: twinkle sachdeva <[email protected]>
Date: 2015-02-02T15:38:35Z
SPARK-4705: Doing cherry-pick of fix into master
commit d11b92057996f108f5acf3fc585b39f86c8adf87
Author: twinkle sachdeva <[email protected]>
Date: 2015-02-25T04:45:43Z
SPARK-4705 Incorporating the review comments regarding formatting, will do
the rest of the changes after this
commit 1f8c85e493cb39256c4073c48bca15d3c0ab6beb
Author: twinkle sachdeva <[email protected]>
Date: 2015-02-25T09:20:33Z
SPARK-4705 Incorporating the review comments regarding formatting, will do
the rest of the changes after this
commit 11e96ae42fb9369a3a8018d3e8d930ef5d780d1b
Author: twinkle.sachdeva <[email protected]>
Date: 2015-03-01T15:02:50Z
SPARK-4705: 1) moved from directory structure to single file, as per the
master branch. 2) Added the attempt id inside the
SparkListenerApplicationStart, to make the info available independent of
directory structure. 3) Changes in History Server to render the UI as per the
snaphot II
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
