[
https://issues.apache.org/jira/browse/SYSTEMML-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869639#comment-15869639
]
Matthias Boehm commented on SYSTEMML-1257:
------------------------------------------
As it turned out, it was a bug in the special case, where the matrix
intermediate resulting from a relational comparison, i.e., (K>1)*maxs), was not
bound to a target variable. For these cases, we created temporary targets
during HOPs construction, where the value type was mistakenly set to boolean.
Later this resulted in the incorrect data type as certain operations are only
support over scalars. In comparison, ppred is only supported over matrices and
hence worked correctly.
> Univar-Stats scripts failing due to Unexpected ValueType in
> ArithmeticInstruction
> ---------------------------------------------------------------------------------
>
> Key: SYSTEMML-1257
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1257
> Project: SystemML
> Issue Type: Bug
> Reporter: Arvind Surve
> Assignee: Matthias Boehm
>
> Running Release verification process
> (http://apache.github.io/incubator-systemml/release-process.html) where
> Univar-Stats.dml failing to execute.
> Trying to run following example on Single Node Spark environment.
> $ tar -xvzf systemml-0.11.0-incubating.tgz
> $ cd systemml-0.11.0-incubating
> $ export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
> $ $SPARK_HOME/bin/spark-submit SystemML.jar -f
> scripts/datagen/genRandData4Univariate.dml -exec hybrid_spark -args 1000000
> 100 10 1 2 3 4 uni.mtx
> $ echo '1' > uni-types.csv
> $ echo '{"rows": 1, "cols": 1, "format": "csv"}' > uni-types.csv.mtd
> $ $SPARK_HOME/bin/spark-submit SystemML.jar -f
> scripts/algorithms/Univar-Stats.dml -exec hybrid_spark -nvargs X=uni.mtx
> TYPES=uni-types.csv STATS=uni-stats.txt CONSOLE_OUTPUT=TRUE
> Exception get is following:
> Exception in thread "main" org.apache.sysml.api.DMLException:
> org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 -- Problem
> generating simple inst -
> CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
> at org.apache.sysml.api.DMLScript.main(DMLScript.java:221)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Caused by: org.apache.sysml.lops.LopsException: ERROR: line 64, column 21 --
> Problem generating simple inst -
> CP°*°_Var27·SCALAR·DOUBLE·false°_Var25·SCALAR·DOUBLE·false°_Var28·SCALAR·BOOLEAN
> at
> org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1572)
> at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1212)
> at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:267)
> at
> org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:531)
> at
> org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
> at org.apache.sysml.api.DMLScript.execute(DMLScript.java:633)
> at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
> ... 10 more
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: Unexpected ValueType
> in ArithmeticInstruction.
> at
> org.apache.sysml.runtime.instructions.cp.ArithmeticBinaryCPInstruction.parseInstruction(ArithmeticBinaryCPInstruction.java:80)
> at
> org.apache.sysml.runtime.instructions.CPInstructionParser.parseSingleInstruction(CPInstructionParser.java:321)
> at
> org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:45)
> at
> org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1559)
> Following line in Univar-stats dml causing that exception:
> maxDomainSize = max( (K > 1) * maxs );
> Its Boolean x Double, causing problem.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
