GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/10284
[SPARK-12062] [CORE] Change Master to asyc rebuild UI when application
completes
This change builds the event history of completed apps asynchronously so
the RPC thread will not be blocked and allow new workers to register/remove if
the event log history is very large and takes a long time to rebuild.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BryanCutler/spark async-MasterUI-SPARK-12062
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10284.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10284
----
commit fe67dd79e86c635ccecde7aa9ca288d159cf474f
Author: Bryan Cutler <[email protected]>
Date: 2015-12-08T02:36:46Z
[SPARK-12062] Changed Master rebuildSparkUI to run async from the RPC thread
commit b748dc10b6c47ea88794a5d596c44e77266607c3
Author: Bryan Cutler <[email protected]>
Date: 2015-12-08T18:51:27Z
rebuildUI thread was not being shutdown
commit 7d60de1728d46c75c47d7fec77c898e93fcc5e52
Author: Bryan Cutler <[email protected]>
Date: 2015-12-08T20:16:43Z
remove line that was accidentally left in for testing
commit af20e77940c33044dc8f7075e941219e737bb744
Author: Bryan Cutler <[email protected]>
Date: 2015-12-12T00:24:50Z
cleanup of log file opening logic
commit 54089aa1c1dc73b8f09e54973dd7ef77f361547c
Author: Bryan Cutler <[email protected]>
Date: 2015-12-12T00:47:36Z
minor cleanup
commit 80076374068e58fc9d89cf78c3fa90bfeb23ecb6
Author: Bryan Cutler <[email protected]>
Date: 2015-12-13T21:52:06Z
changed catching Exception to NonFatal, which is better
commit 456c806eee6577fcb2721879613f20351e57ff14
Author: Bryan Cutler <[email protected]>
Date: 2015-12-13T23:10:58Z
fixed indentation
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
