GitHub user beckgael opened a pull request:
https://github.com/apache/spark/pull/23048
transform DenseVector x DenseVector sqdist from imperativ to functionâ¦
â¦al tailrec style which improves performance well on low and medium dim
vectors
## What changes were proposed in this pull request?
Improving speed efficiency Densevector X Densevector sqdist function
(Please fill in changes proposed in this fix)
## How was this patch tested?
Both version, imperativ and functional one have been tested separetely
showing large improvment in speed for dimension 2, 3, 10, 100 when the
performances tend to be the same on very high dim (10000, 100000)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/beckgael/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/23048.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #23048
----
commit 5194a6942425ed9866774e1f5eccc66f5452d745
Author: beckgael <beck.gael@...>
Date: 2018-11-15T14:16:45Z
transform DenseVector x DenseVector sqdist from imperatif to functional
tailrec style which improves performance well on low and medium dim vectors
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]