GitHub user gerashegalov opened a pull request:
https://github.com/apache/spark/pull/20575
[SPARK-23386][DEPLOY] enable direct application links in SHS before replay
## What changes were proposed in this pull request?
Enable direct job links already in the scan thread before full replay.
Otherwise, direct job links might not be available for hours.
## How was this patch tested?
Test with a deploy on multiple 10k apps. This is currently a prototype for
YARN, but should generalizable.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gerashegalov/spark
gera/logs-events-from-listing
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20575.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20575
----
commit e27880263f36a7b8beee62c902389c293bb2a17e
Author: Gera Shegalov <gera@...>
Date: 2018-02-09T15:05:12Z
List-driven bootstrap replay
(cherry picked from commit 0d4e2a2215bb9e102ce449c52bcf7c3d44fc6d44)
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
