GitHub user caneGuy opened a pull request:
https://github.com/apache/spark/pull/19482
[SPARK-22264][DEPLOY] Add timeout for eventlog replaying to avoid
time-consâ¦
â¦uming replaying which will cause historyserver unavailable
## What changes were proposed in this pull request?
History server will be unavailable if there is an event log file with large
size.Large size here means the replaying time is too long.
We can fix this to add a timeout for event log replaying.
More details attached in
[SPARK-22264](https://issues.apache.org/jira/browse/SPARK-22264)
## How was this patch tested?
Exsisted unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/caneGuy/spark zhoukang/replay-timeout
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19482.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19482
----
commit a2423dda5a90741691926a40d99b085795e81fbb
Author: zhoukang <zhoukang199...@gmail.com>
Date: 2017-10-12T09:47:32Z
[SPARK][DEPLOY] Add timeout for eventlog replaying to avoid time-consuming
replaying which will cause historyserver unavailable
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
