GitHub user deshanxiao opened a pull request:
https://github.com/apache/spark/pull/22109
[SPARK-25120][CORE][HistoryServer]Fix the problem of EventLogListener may
miss driver SparkListenerBlocâ¦
## What changes were proposed in this pull request?
Sometimes in spark history tab "Executors" , it couldn't find driver
information because the information of this page created by EventLog replaying
the event of SparkListenerBlockManagerAdded. In SparkContext, driver registers
blockmanager before adding the EventLogEventListener to LiveListenerBus. In
this case,the EventLogEventListener may miss the driver's
SparkListenerBlockManagerAdded event and the history ui won't show the info of
driver in "Executors" .
## How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/deshanxiao/spark fix-jira25120
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22109.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22109
----
commit 26ca9c2c08c62961183e6461183c2963b6a00474
Author: xiaodeshan <xiaodeshan@...>
Date: 2018-08-15T02:49:25Z
fix the problem of EventLogListener may miss driver
SparkListenerBlockManagerAdded event
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
