GitHub user zhengruifeng opened a pull request:
https://github.com/apache/spark/pull/19950
[SPARK-22450][Core][MLLib][FollowUp] safely register class for mllib -
LabeledPoint/VectorWithNorm/TreePoint
## What changes were proposed in this pull request?
register following classes in Kryo:
`org.apache.spark.mllib.regression.LabeledPoint`
`org.apache.spark.mllib.clustering.VectorWithNorm`
`org.apache.spark.ml.feature.LabeledPoint`
`org.apache.spark.ml.tree.impl.TreePoint`
`org.apache.spark.ml.tree.impl.BaggedPoint` seems also need to be
registered, but I don't know how to do it in this safe way.
@WeichenXu123 @cloud-fan
## How was this patch tested?
added tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhengruifeng/spark labeled_kryo
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19950.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19950
----
commit 5e36d1a4c941220d6277c6f6525ba4f5bddfe428
Author: Zheng RuiFeng <[email protected]>
Date: 2017-12-11T09:23:20Z
create pr
commit 612963633e8c05224e6955a10a0ddd3da0a91581
Author: Zheng RuiFeng <[email protected]>
Date: 2017-12-12T11:07:03Z
update
commit 94362ccb3e983b2be6aad41063847346294146e1
Author: Zheng RuiFeng <[email protected]>
Date: 2017-12-12T11:28:23Z
update
commit 0e825c5256a4ffc50f45dfacd4c8f03e350db7d8
Author: Zheng RuiFeng <[email protected]>
Date: 2017-12-12T11:35:29Z
update 2
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
