GitHub user deshanxiao opened a pull request:
https://github.com/apache/spark/pull/22093
[SPARK-25100][CORE] Fix no registering TaskCommitMessage bug
## What changes were proposed in this pull request?
Fix the bug when invoking saveAsNewAPIHadoopDataset to store data, the job
will fail because the class TaskCommitMessage hasn't be registered if
serializer is KryoSerializer and spark.kryo.registrationRequired is true
## How was this patch tested?
Run all the test in project
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/deshanxiao/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22093.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22093
----
commit ab56a2e657d6820f99cb959bb9afc19578a855f3
Author: deshanxiao <deshanxiao@...>
Date: 2018-08-13T14:21:36Z
Fix no registering TaskCommitMessage bug
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
