Joseph K. Bradley created SPARK-10307:
-----------------------------------------
Summary: Fix regression in block matrix multiply (1.4->1.5
regression)
Key: SPARK-10307
URL: https://issues.apache.org/jira/browse/SPARK-10307
Project: Spark
Issue Type: Improvement
Components: MLlib
Affects Versions: 1.5.0
Reporter: Joseph K. Bradley
Assignee: Joseph K. Bradley
Priority: Critical
Running spark-perf on the block-matrix-mult test (BlockMatrix.multiply), I
found the running time increased from 50 sec to 80 sec. This was on the
default test settings, on 16 r3.2xlarge workers on EC2, and with 15 trials,
dropping the first 2.
The only relevant changes I found are:
*
[https://github.com/apache/spark/commit/520ad44b17f72e6465bf990f64b4e289f8a83447]
*
[https://github.com/apache/spark/commit/99c40cd0d8465525cac34dfa373b81532ef3d719]
I'm testing reverting each of those now.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
