[
https://issues.apache.org/jira/browse/SPARK-25868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25868.
-------------------------------
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22893
[https://github.com/apache/spark/pull/22893]
> One part of Spark MLlib Kmean Logic Performance problem
> -------------------------------------------------------
>
> Key: SPARK-25868
> URL: https://issues.apache.org/jira/browse/SPARK-25868
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Affects Versions: 2.3.2
> Reporter: Liang Li
> Assignee: Liang Li
> Priority: Minor
> Fix For: 3.0.0
>
>
> In function fastSquaredDistance, there is a low performance logic:
> the sqDist = Vectors.sqdist(v1, v2) is better than sqDist = sumSquaredNorm -
> 2.0 * dot(v1, v2) in calculation performance
> So get rid of the low performance login in function fastSquaredDistance.
> More test(End-to-End, function) situation can be found in
> https://github.com/apache/spark/pull/22893
> Already update a patch #22893 for merge
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
