Baunsgaard commented on PR #1790:
URL: https://github.com/apache/systemds/pull/1790#issuecomment-1472347723
Before:
# EXPLAIN (RUNTIME):
# Memory Budget local/remote = 143360MB/?MB/?MB/?MB
# Degree of Parallelism (vcores) local/remote = 48/?
PROGRAM ( size CP/SP = 6/1 )
--MAIN PROGRAM
----GENERIC (lines 1-2) [recompile=false]
------CP createvar pREADX testFile.dat false MATRIX binary 1000000 10000
1000 10000000000 copy
------CP createvar _mVar0 scratch_space//_p94330_192.168.0.11//_t0/temp0
true MATRIX binary 1000000 10000 1000 10000000000 copy
------SPARK chkpoint pREADX.MATRIX.FP64 _mVar0.MATRIX.FP64 MEMORY_AND_DISK
------CP uak+ _mVar0.MATRIX.FP64 _Var1.SCALAR.STRING 48
------CP rmvar _mVar0
------CP print _Var1.SCALAR.STRING.false _Var2.SCALAR.STRING 48
------CP rmvar _Var1 _Var2
4.966327461583818E9
SystemDS Statistics:
Total elapsed time: 46.332 sec.
Total compilation time: 0.870 sec.
Total execution time: 45.462 sec.
Number of compiled Spark inst: 1.
Number of executed Spark inst: 1.
Cache hits (Mem/Li/WB/FS/HDFS): 0/0/0/0/1.
Cache writes (Li/WB/FS/HDFS): 0/0/0/0.
Cache times (ACQr/m, RLS, EXP): 24.857/0.000/0.000/0.000 sec.
HOP DAGs recompiled (PRED, SB): 0/0.
HOP DAGs recompile time: 0.000 sec.
Spark ctx create time (lazy): 18.414 sec.
Spark trans counts (par,bc,col):0/0/0.
Spark trans times (par,bc,col): 0.000/0.000/0.000 secs.
Spark async. count (pf,bc,op): 0/0/0.
Total JIT compile time: 14.73 sec.
Total JVM GC count: 4.
Total JVM GC time: 0.096 sec.
Heavy hitter instructions:
# Instruction Time(s) Count
1 uak+ 26.331 1
2 sp_chkpoint 19.110 1
3 createvar 0.018 2
4 print 0.000 1
5 rmvar 0.000 2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@systemds.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
