GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/19953
[SPARK-22763][Core]SHS: Ignore unknown events and parse through the file
## What changes were proposed in this pull request?
While spark code changes, there are new events in event log: #19649
And we used to maintain a whitelist to avoid exceptions: #15663
Currently Spark history server will stop parsing on unknown events or
unrecognized properties. We may still see part of the UI data.
For better compatibility, we can ignore unknown events and parse through
the log file.
## How was this patch tested?
Unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gengliangwang/spark ReplayListenerBus
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19953.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19953
----
commit d8bd6d83ad2119e63df9bed811258a9c0829d66c
Author: Wang Gengliang <[email protected]>
Date: 2017-12-12T16:51:48Z
Ignore unknown events and parse through the file
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
