[
https://issues.apache.org/jira/browse/SYSTEMML-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm closed SYSTEMML-2182.
------------------------------------
Resolution: Fixed
Assignee: Matthias Boehm
Fix Version/s: SystemML 1.1
> Univariate stats over 10Kx1K w/ wrong optimizer choice
> ------------------------------------------------------
>
> Key: SYSTEMML-2182
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2182
> Project: SystemML
> Issue Type: Sub-task
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
> Priority: Major
> Fix For: SystemML 1.1
>
>
> The parfor optimizer decided incorrectly on remote parfor for this very small
> input dataset.
> {code}
> Total elapsed time: 38.600 sec.
> Total compilation time: 1.978 sec.
> Total execution time: 36.622 sec.
> Number of compiled Spark inst: 1.
> Number of executed Spark inst: 1.
> Cache hits (Mem, WB, FS, HDFS): 4/0/0/426.
> Cache writes (WB, FS, HDFS): 2/0/2.
> Cache times (ACQr/m, RLS, EXP): 3.799/0.001/0.006/0.341 sec.
> HOP DAGs recompiled (PRED, SB): 0/0.
> HOP DAGs recompile time: 0.000 sec.
> Spark ctx create time (lazy): 21.545 sec.
> Spark trans counts (par,bc,col):0/0/0.
> Spark trans times (par,bc,col): 0.000/0.000/0.000 secs.
> ParFor loops optimized: 1.
> ParFor optimize time: 0.076 sec.
> ParFor initialize time: 0.000 sec.
> ParFor result merge time: 8.191 sec.
> ParFor total update in-place: 0/0/0
> Total JIT compile time: 26.803 sec.
> Total JVM GC count: 8.
> Total JVM GC time: 0.87 sec.
> Heavy hitter instructions:
> # Instruction Time(s) Count
> 1 ParFor-ESP 26.999 1
> 2 uacmax 0.762 1
> 3 > 0.184 1
> 4 write 0.102 1
> 5 rand 0.006 1
> 6 - 0.001 4
> 7 * 0.001 5
> 8 mvvar 0.000 23
> 9 uamax 0.000 1
> 10 rmvar 0.000 6
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
