[
https://issues.apache.org/jira/browse/SYSTEMML-1561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003710#comment-16003710
]
Mike Dusenberry commented on SYSTEMML-1561:
-------------------------------------------
Well, I tried logging the rewrites with {{ProgramRewriter.LDEBUG = true}}
enabled and log4j set to DEBUG, but it only displayed the common subexpression
elimination rewrites during the second chance pass. Looking into it further,
rewrites like the constant folding don't seem to ever emit debug logging, so I
don't think the log isn't showing the whole picture. Regardless, here's the
trace (look for the {{ABOUT TO START STATIC REWRITE + IPA SECOND
CHANCE!!!!!!!!}} section).
{code}
17/05/09 15:50:35 DEBUG DMLScript:
DML config:
INFO: localtmpdir: /tmp/systemml
INFO: scratch: scratch_space
INFO: optlevel: 2
INFO: numreducers: 10
INFO: defaultblocksize: 1000
INFO: dml.yarn.appmaster: false
INFO: dml.yarn.appmaster.mem: 2048
INFO: dml.yarn.mapreduce.mem: -1
INFO: cp.parallel.matrixmult: true
INFO: cp.parallel.textio: true
INFO: native.blas: auto
INFO: compressed.linalg: false
INFO: codegen.enabled: false
INFO: codegen.literals: 1
INFO: codegen.plancache: true
INFO: systemml.stats.extraGPU: false
INFO: systemml.stats.extraDNN: false
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/examples/mnist_lenet.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/affine.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/conv2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/cross_entropy_loss.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/dropout.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/l2_reg.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/max_pool2d_builtin.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/relu.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/layers/softmax.dml
17/05/09 15:50:35 DEBUG DMLScript: Looking for the following file in the local
file system: ./nn/optim/sgd_nesterov.dml
17/05/09 15:50:36 DEBUG MRConfigurationNames: Hadoop build version: 2.6.5 from
e8c9fe0b4c252caf2ebf1464220599650f119997 by sjlee source checksum
f05c9fa095a395faa9db9f7ba5d754
17/05/09 15:50:36 DEBUG MRConfigurationNames: Using hadoop 2.x configuration
properties.
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops,
about=, always=false, type=DEFAULT, value=[Rate of successful kerberos logins
and latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops,
about=, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and
latency (milliseconds)], valueName=Time)
17/05/09 15:50:36 DEBUG MutableMetricsFactory: field
org.apache.hadoop.metrics2.lib.MutableRate
org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with
annotation @org.apache.hadoop.metrics2.annotation.Metric(sampleName=Ops,
about=, always=false, type=DEFAULT, value=[GetGroups], valueName=Time)
17/05/09 15:50:36 DEBUG MetricsSystemImpl: UgiMetrics, User and group related
metrics
17/05/09 15:50:36 DEBUG KerberosName: Kerberos krb5 configuration not found,
setting default realm to empty
17/05/09 15:50:36 DEBUG Groups: Creating new Groups object
17/05/09 15:50:36 DEBUG NativeCodeLoader: Trying to load the custom-built
native-hadoop library...
17/05/09 15:50:36 DEBUG NativeCodeLoader: Failed to load native-hadoop with
error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
17/05/09 15:50:36 DEBUG NativeCodeLoader:
java.library.path=/Users/mwdusenb/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
17/05/09 15:50:36 WARN NativeCodeLoader: Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
17/05/09 15:50:36 DEBUG PerformanceAdvisory: Falling back to shell based
17/05/09 15:50:36 DEBUG JniBasedUnixGroupsMappingWithFallback: Group mapping
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
17/05/09 15:50:36 DEBUG Groups: Group mapping
impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback;
cacheTimeout=300000; warningDeltaMs=5000
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login
17/05/09 15:50:36 DEBUG UserGroupInformation: hadoop login commit
17/05/09 15:50:36 DEBUG UserGroupInformation: using local user:UnixPrincipal:
mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: Using user: "UnixPrincipal:
mwdusenb" with name mwdusenb
17/05/09 15:50:36 DEBUG UserGroupInformation: User entry: "mwdusenb"
17/05/09 15:50:36 DEBUG UserGroupInformation: UGI loginUser:mwdusenb
(auth:SIMPLE)
17/05/09 15:50:36 WARN Expression: Metadata file:
nn/examples/data/mnist/mnist_train.csv.mtd not provided
17/05/09 15:50:36 WARN Expression: Metadata file:
nn/examples/data/mnist/mnist_test.csv.mtd not provided
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[-1
-1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_FILTER -1 -1 img_dim=[-1 -1 -1
-1] filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1
-1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG DMLScript: SystemML security check: local.user.name =
mwdusenb, local.user.groups = com.apple.access_ssh, everyone, _appstore,
com.apple.access_ftp, admin, staff, com.apple.sharepoint.group.1, _lpoperator,
_appserverusr, _lpadmin, _developer, com.apple.access_screensharing,
localaccounts, _appserveradm, mapreduce.jobtracker.address = local,
mapreduce.tasktracker.taskcontroller =
org.apache.hadoop.mapred.DefaultTaskController,mapreduce.tasktracker.group =
null, fs.defaultFS = file, dfs.permissions.enabled = true
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 10 operators.
17/05/09 15:50:36 DEBUG Hop: 1710 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 93 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1712 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 95 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 42 operators.
17/05/09 15:50:36 DEBUG Hop: 1715 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 256 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 10 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 12 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 8 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop: 1740 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 430 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1742 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 431 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1744 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 436 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1746 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1748 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 492 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1750 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1752 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop: 1754 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 699 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1] filter_dim=[1 -1
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 9 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 25 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
simplifyBushyBinaryOperation1
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
fuseBinarySubDAGToUnaryOperation-selp3
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 35)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationStatic: Applied
removeUnnecessaryBinaryOperation5 (line 55)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 15 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 11 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop: 1789 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1596 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1791 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1604 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1793 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1612 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1795 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1620 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1797 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1628 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1799 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1636 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1801 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1644 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1803 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1652 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop: 1805 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1700 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG StatementBlockRewriteRule: Applied
splitDagUnknownCSVRead.
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1]
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1]
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1]
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1]
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1]
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1]
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[1 32
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 -1 img_dim=[-1 32 -1 -1] filter_dim=[64
32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 -1 img_dim=[-1 64 -1 -1] filter_dim=[1 64
-1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 -1 img_dim=[-1 64 -1 -1]
filter_dim=[1 64 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 -1 img_dim=[-1 32 -1 -1]
filter_dim=[64 32 -1 -1] output_feature_map=[-1 -1] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 -1 -1]
filter_dim=[1 32 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/max_pool2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/max_pool2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/optim/sgd_nesterov.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/optim/sgd_nesterov.dml::update
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/examples/mnist_lenet.dml::generate_dummy_data
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/examples/mnist_lenet.dml::eval
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/relu.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/relu.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/cross_entropy_loss.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/cross_entropy_loss.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/affine.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/affine.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/affine.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/l2_reg.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/l2_reg.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/softmax.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/softmax.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/conv2d_builtin.dml::init
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/conv2d_builtin.dml::forward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/conv2d_builtin.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: Removed unused function:
./nn/layers/dropout.dml::backward
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
ABOUT TO START STATIC REWRITE + IPA SECOND CHANCE!!!!!!!!
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG Hop: 1860 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 401 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1862 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 402 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1864 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 407 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1866 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1868 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 451 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1870 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 453 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1872 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 454 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1874 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 459 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1876 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 469 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1878 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 7 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 6 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 4 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 9 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop: 1880 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 660 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1882 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 661 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1884 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 662 b(-) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1886 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 663 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1888 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 665 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1890 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1892 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1894 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 700 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1896 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 702 b(-) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1898 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 704 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1900 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 706 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1902 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1904 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1906 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 741 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1908 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 742 b(-) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1910 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 743 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1912 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 745 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1914 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1916 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1918 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 780 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1920 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 782 b(-) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1922 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 784 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1924 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 786 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1926 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1928 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1930 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1932 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG Hop: 1934 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 856 b(*) (0,0) CP
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 13 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 5 operators.
17/05/09 15:50:36 DEBUG Hop: 1936 TWrite __cf_tmp (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 1130 b(+) (0,0) CP
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/examples/mnist_lenet.dml::train, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/examples/mnist_lenet.dml::predict, callCount=2
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate: ./nn/layers/dropout.dml::forward, callCount=1
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate (after pruning): ./nn/examples/mnist_lenet.dml::train
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC statistic
propagation candidate (after pruning): ./nn/layers/dropout.dml::forward
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14]
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14]
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28]
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14]
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14]
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28]
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 6272 img_dim=[-1 32 28 28] filter_dim=[1
32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14]
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING -1 3136 img_dim=[-1 64 14 14] filter_dim=[1
64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14]
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32 14
14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
refreshSizeInformation:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28]
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for
recompile-once: ./nn/examples/mnist_lenet.dml::predict
17/05/09 15:50:36 DEBUG InterProceduralAnalysis: IPA: FUNC flagged for
recompile-once: ./nn/examples/mnist_lenet.dml::train
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
ABOUT TO START DYNAMIC REWRITES!!!!!!!!
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 1 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseSumSquared.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 164)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 165)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNrowComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 166)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 167)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain1. (line 41)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
fuseAxpyBinaryOperationChain3. (line 40)
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 17 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 3 operators.
17/05/09 15:50:36 DEBUG HopRewriteRule: Common Subexpression Elimination -
removed 2 operators.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG RewriteAlgebraicSimplificationDynamic: Applied
simplifyNcolComputation.
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:DIRECT_CONV2D -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[-1 -1 -1 -1] output_feature_map=[-1 -1] stride=[-1 -1] pad=[-1 -1]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING -1 -1 img_dim=[-1 -1 -1 -1]
filter_dim=[1 -1 -1 -1] output_feature_map=[-1 -1] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:DIRECT_CONV2D -1 25088 img_dim=[-1 1 28 28]
filter_dim=[32 1 28 28] output_feature_map=[28 28] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING -1 6272 img_dim=[-1 32 28 28]
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:DIRECT_CONV2D -1 12544 img_dim=[-1 32 14 14]
filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2 2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING -1 3136 img_dim=[-1 64 14 14]
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 12544 img_dim=[-1 64 14 14]
filter_dim=[1 64 14 14] output_feature_map=[7 7] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:DIRECT_CONV2D_BACKWARD_DATA -1 6272 img_dim=[-1 32
14 14] filter_dim=[64 32 14 14] output_feature_map=[14 14] stride=[1 1] pad=[2
2]
17/05/09 15:50:36 DEBUG Hop: Unknown dimensions for ConvolutionOp in
inferOutputCharacteristics:MAX_POOLING_BACKWARD -1 25088 img_dim=[-1 32 28 28]
filter_dim=[1 32 28 28] output_feature_map=[14 14] stride=[2 2] pad=[0 0]
17/05/09 15:50:36 DEBUG Hop: 141 TWrite N (0,0) CP
17/05/09 15:50:36 DEBUG Hop: * 135 TRead X (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: 143 TWrite Hf (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 145 TWrite Wf (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 147 TWrite stride (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 149 TWrite pad (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 151 TWrite F1 (0,0) CP
17/05/09 15:50:36 DEBUG Hop: * 136 TRead W1 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: 153 TWrite F2 (0,0) CP
17/05/09 15:50:36 DEBUG Hop: * 137 TRead W2 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 163 TWrite probs (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 162 dg(rand) (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 139 TRead W4 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: 165 TWrite batch_size (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 169 TWrite iters (0,0) CP
17/05/09 15:50:36 DEBUG Hop: 167 b(/) (0,0) CP
17/05/09 15:50:36 DEBUG Hop: * 1723 TWrite b1 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1722 TRead b1 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1725 TWrite b2 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1724 TRead b2 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1727 TWrite b3 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1726 TRead b3 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1729 TWrite b4 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1728 TRead b4 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1731 TWrite X (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1730 TRead X (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1733 TWrite W1 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1732 TRead W1 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1735 TWrite W2 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1734 TRead W2 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1737 TWrite W3 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1736 TRead W3 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1739 TWrite W4 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1738 TRead W4 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1843 TWrite b1 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1842 TRead b1 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1845 TWrite b2 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1844 TRead b2 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1847 TWrite b3 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1846 TRead b3 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1849 TWrite b4 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1848 TRead b4 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1851 TWrite X (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1850 TRead X (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1853 TWrite W1 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1852 TRead W1 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1855 TWrite W2 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1854 TRead W2 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1857 TWrite W3 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1856 TRead W3 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1859 TWrite W4 (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 1858 TRead W4 (9103,9103) SPARK
17/05/09 15:50:36 DEBUG Hop: * 369 TWrite probs (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 368 lix (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 365 b(/) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 365 b(/) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 363 u(exp) (9103,18205) SPARK
17/05/09 15:50:36 DEBUG Hop: * 362 b(-) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 362 b(-) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 360 b(+) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 360 b(+) (9103,27308) SPARK
17/05/09 15:50:36 DEBUG Hop: * 359 ba(+*) (9103,27308) SPARK
17/05/09 15:50:36 INFO SparkContext: Running Spark version 2.3.0-SNAPSHOT
17/05/09 15:50:36 INFO SparkContext: Submitted application:
org.apache.sysml.api.DMLScript
......
{code}
> Improve constant folding during compilation
> -------------------------------------------
>
> Key: SYSTEMML-1561
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1561
> Project: SystemML
> Issue Type: Improvement
> Reporter: Mike Dusenberry
> Assignee: Mike Dusenberry
> Fix For: SystemML 1.0
>
> Attachments: scenario1_plan.txt, scenario1.py, scenario2_plan.txt,
> scenario2.py
>
>
> In our `nn` library, our convolution and pooling layers have to pass around
> the spatial dimensions (height and width) of the images that are stretched
> out into rows of the input/output matrices. These output dimensions are
> computed within the forward functions of the above layers as small scalar
> equations. From a mathematical standpoint, these sizes can be determined at
> compile time, and it is nice to have these size equations in DML (v.s. hiding
> them inside the engine within built-in functions). However, we do not
> currently evaluate these expressions during compilation, and thus we are left
> with unknown sizes even during recompilation. This naturally leads to max
> memory estimates and thus often leads to unnecessary distributed runtime ops
> rather than simple CP ones.
> I have two related scenarios for which this is a problem. They both involve
> the {{Houtc1}} & {{Woutc1}} values that are returned from a
> `conv2d::forward(...)` function. These represent the spatial dimensions of
> the volume with each of the rows of the output {{outc1}} of the function, and
> the third dimension is {{F1}}. Thus, {{outc1}} has a number of columns equal
> to {{F1*Houtc1*Wouc1}}.
> In the first scenario ({{scenario1.py}}), a random matrix {{doutc1}} is
> created that should have the same dimensions as {{outc1}}. For the columns,
> if I use {{cols=ncol(outc1)}} in this rand statement, the size will be
> propagated and CP ops will be compiled and run. I I instead use
> {{cols=F1*Houtc1*Woutc1}}, the size will forever be unknown, even during
> recompilation, and thus Spark ops will be compiled and run. I have included
> the recompile hops plan ({{scenario1_plan.txt}}).
> In the second scenario ({{scenario2.py}}), a {{max_pool2d::forward(...)}}
> function is inserted after the {{conv2d::forward(...)}} function that
> requires the {{Houtc1}} and {{Woutc1}} variables to be supplied as arguments.
> Since those latter variables are not executed during compilation time, the
> max pooling sizes remain unknown, even during recompilation, and thus Spark
> ops will be compiled and run. I have included the recompile hops plan
> ({{scenario2_plan.txt}}).
> We should either improve or fix our constant folding rewrites so that these
> scenarios are fixed, as they are necessary for performant deep learning
> applications. Note too that this issue will be present in other non-deep
> learning scenarios as well.
> Mailing list thread:
> https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg01657.html
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
