GitHub user sameeragarwal opened a pull request:
https://github.com/apache/spark/pull/13466
[SPARK-14752][SQL] Explicitly implement KryoSerialization for
LazilyGenerateOrdering
## What changes were proposed in this pull request?
This patch fixes a number of `com.esotericsoftware.kryo.KryoException:
java.lang.NullPointerException` exceptions reported in [SPARK-15604],
[SPARK-14752] etc. (while executing sparkSQL queries with the kryo serializer)
by explicitly implementing `KryoSerialization` for `LazilyGenerateOrdering`.
## How was this patch tested?
1. Modified `OrderingSuite` so that all tests in the suite also test kryo
serialization (for both interpreted and generated ordering).
2. Manually verified TPC-DS q1.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sameeragarwal/spark kryo
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13466.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13466
----
commit 1d98085b05e5a8e243295a242f94de0adce70778
Author: Sameer Agarwal <[email protected]>
Date: 2016-06-02T08:11:10Z
Explicitly implement KryoSerialization for LazilyGenerateOrdering
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
