Matthias Boehm created SYSTEMML-1901:
----------------------------------------
Summary: Parfor with frame inputs or intermediates failing
Key: SYSTEMML-1901
URL: https://issues.apache.org/jira/browse/SYSTEMML-1901
Project: SystemML
Issue Type: Bug
Reporter: Matthias Boehm
There are multiple issues with using frame inputs and intermediates in a parfor
context.
First, the parfor optimizer fails on investigating partitioned inputs due to an
unawareness of frames:
{code}
Caused by: java.lang.ClassCastException:
org.apache.sysml.runtime.controlprogram.caching.FrameObject cannot be cast to
org.apache.sysml.runtime.controlprogram.caching.MatrixObject
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.getNewRIXMemoryEstimate(OptimizerRuleBased.java:519)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:472)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:430)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:233)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
at
org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
at
org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:593)
at
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:123)
... 32 more
{code}
Second, the parfor runtime fails on creating unbounded frame outputs, again,
due an unawareness of frames.
{code}
Caused by: org.apache.sysml.runtime.DMLRuntimeException: Data type not
supported: FRAME
at
org.apache.sysml.runtime.controlprogram.ParForProgramBlock.createEmptyUnscopedVariables(ParForProgramBlock.java:1289)
at
org.apache.sysml.runtime.controlprogram.ParForProgramBlock.consolidateAndCheckResults(ParForProgramBlock.java:1740)
at
org.apache.sysml.runtime.controlprogram.ParForProgramBlock.executeLocalParFor(ParForProgramBlock.java:814)
at
org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:639)
... 33 more
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
