Sheypex commented on PR #1850:
URL: https://github.com/apache/systemds/pull/1850#issuecomment-1607658006
Just fixed my implenentation of the `-gpu` flag
Perftests are running/working again
Incidentally found out, that there is some error with systemds utilizing my
gpu .. apparently some shared libraries cant be found? So not sure what exactly
is the problem there.
Fixed/added missing licenses
Stats are as follows:
For training simple sgd on smallest data:
> SystemDS Statistics:
Total elapsed time: 0.553 sec.
Total compilation time: 0.236 sec.
Total execution time: 0.317 sec.
Number of compiled Spark inst: 2.
Number of executed Spark inst: 0.
Cache hits (Mem/Li/WB/FS/HDFS): 6082/0/0/0/2.
Cache writes (Li/WB/FS/HDFS): 0/1/0/4.
Cache times (ACQr/m, RLS, EXP): 0.164/0.001/0.003/0.039 sec.
HOP DAGs recompiled (PRED, SB): 0/0.
HOP DAGs recompile time: 0.000 sec.
Spark ctx create time (lazy): 0.000 sec.
Spark trans counts (par,bc,col):0/0/0.
Spark trans times (par,bc,col): 0.000/0.000/0.000 secs.
Spark async. count (pf,bc,op): 0/0/0.
Total JIT compile time: 1.604 sec.
Total JVM GC count: 0.
Total JVM GC time: 0.0 sec.
Heavy hitter instructions:
\# Instruction Time(s) Count
1 sp_csvrblk 0.163 2
2 write 0.039 4
3 ba+* 0.038 800
4 -* 0.010 640
5 + 0.009 645
6 * 0.006 647
7 / 0.006 323
8 r' 0.006 480
9 createvar 0.005 3850
10 rand 0.005 4
For training simple sgd on next larger data:
> SystemDS Statistics:
Total elapsed time: 0.861 sec.
Total compilation time: 0.252 sec.
Total execution time: 0.610 sec.
Number of compiled Spark inst: 2.
Number of executed Spark inst: 0.
Cache hits (Mem/Li/WB/FS/HDFS): 18242/0/0/0/2.
Cache writes (Li/WB/FS/HDFS): 1/962/0/4.
Cache times (ACQr/m, RLS, EXP): 0.232/0.001/0.012/0.045 sec.
HOP DAGs recompiled (PRED, SB): 0/0.
HOP DAGs recompile time: 0.000 sec.
Spark ctx create time (lazy): 0.000 sec.
Spark trans counts (par,bc,col):0/0/0.
Spark trans times (par,bc,col): 0.000/0.000/0.000 secs.
Spark async. count (pf,bc,op): 0/0/0.
Total JIT compile time: 2.509 sec.
Total JVM GC count: 0.
Total JVM GC time: 0.0 sec.
Heavy hitter instructions:
\# Instruction Time(s) Count
1 sp_csvrblk 0.231 2
2 ba+* 0.143 2400
3 -* 0.053 1920
4 write 0.045 4
5 r' 0.018 1440
6 + 0.015 1925
7 rightIndex 0.014 960
8 * 0.012 1927
9 uak+ 0.010 960
10 rmvar 0.010 13450
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
