Github user mpjlu commented on the issue:
https://github.com/apache/spark/pull/19536
100k*100k, sparsity 0.05 | old | old | New
-- | -- | -- | --
rank | f2j | mkl | mkl
20 | 4 | 9 | 4
50 | 13 | 12 | 13
100 | 40 | 60 | 30
200 | 156 | 90 | 66
500 | 900 | 720 | 270
This is the performance data of this PR.
The date size is 100,000*100,000, the data sparsity is 0.05.
The test environment is:
3 workers: 35 cores/worker, 210G memory/worker, 1 executor/worker.
The native BLAS is Intel MKL
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
