[
https://issues.apache.org/jira/browse/SPARK-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-4797:
-----------------------------------
Description:
This PR replaces slow breezeSquaredDistance. A simple calculation involving
40000 squared distances between the vectors of 20000 dims shows:
* breezeSquaredDistance: ~12 secs
* This PR: ~10.5 secs
was:
This PR replaces slow breezeSquaredDistance. A simple calculation involving
40000 vectors of 20000 dims shows:
* breezeSquaredDistance: ~12 secs
* This PR: ~10.5 secs
> Replace breezeSquaredDistance
> -----------------------------
>
> Key: SPARK-4797
> URL: https://issues.apache.org/jira/browse/SPARK-4797
> Project: Spark
> Issue Type: Improvement
> Reporter: Liang-Chi Hsieh
> Priority: Minor
>
> This PR replaces slow breezeSquaredDistance. A simple calculation involving
> 40000 squared distances between the vectors of 20000 dims shows:
> * breezeSquaredDistance: ~12 secs
> * This PR: ~10.5 secs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
