GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/19383
[SPARK-20643][core] Add listener implementation to collect app state.
The initial listener code is based on the existing JobProgressListener (and
others),
and tries to mimic their behavior as much as possible. The change also
includes
some minor code movement so that some types and methods from the initial
history
server code code can be reused.
The code introduces a few mutable versions of public API types, used
internally,
to make it easier to update information without ugly copy methods, and also
to
make certain updates cheaper.
Note the code here is not 100% correct. This is meant as a building ground
for
the UI integration in the next milestones. As different parts of the UI are
ported, fixes will be made to the different parts of this code to account
for the needed behavior.
I also added annotations to API types so that Jackson is able to correctly
deserialize options, sequences and maps that store primitive types.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-20643
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19383.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19383
----
commit b08b711662b7853bc4081f85b2fcc265c47de410
Author: Marcelo Vanzin <[email protected]>
Date: 2016-10-27T21:29:41Z
SHS-NG M3: Add initial listener implementation to collect app state.
The initial listener is based on the existing JobProgressListener (and
others),
and tries to mimin their behavior as much as possible. The change also
includes
some minor code movement so that some types and methods from the initial
history
server code code can be reused.
The code introduces a few mutable versions of public API types, used
internally,
to make it easier to update information without ugly copy methods, and also
to
make certain updates cheaper.
Note the code here is not 100% correct. This is meant as a building ground
for
the UI integration in the next milestones. As different parts of the UI are
ported, fixes will be made to the different parts of this code to account
for the needed behavior.
I also added annotations to API types so that Jackson is able to correctly
deserialize options, sequences and maps that store primitive types.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
