[
https://issues.apache.org/jira/browse/SYSTEMML-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm closed SYSTEMML-1901.
------------------------------------
Resolution: Fixed
Assignee: Matthias Boehm
Fix Version/s: SystemML 1.0
> Parfor with frame inputs or intermediates failing
> -------------------------------------------------
>
> Key: SYSTEMML-1901
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1901
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
> Fix For: SystemML 1.0
>
>
> There are multiple issues with using frame inputs and intermediates in a
> parfor context.
> First, the parfor optimizer fails on investigating partitioned inputs due to
> an unawareness of frames:
> {code}
> Caused by: java.lang.ClassCastException:
> org.apache.sysml.runtime.controlprogram.caching.FrameObject cannot be cast to
> org.apache.sysml.runtime.controlprogram.caching.MatrixObject
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.getNewRIXMemoryEstimate(OptimizerRuleBased.java:519)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:472)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:430)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:233)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
> at
> org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
> at
> org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:593)
> at
> org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:123)
> ... 32 more
> {code}
> Second, the parfor runtime fails on creating unbounded frame outputs, again,
> due an unawareness of frames.
> {code}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: Data type not
> supported: FRAME
> at
> org.apache.sysml.runtime.controlprogram.ParForProgramBlock.createEmptyUnscopedVariables(ParForProgramBlock.java:1289)
> at
> org.apache.sysml.runtime.controlprogram.ParForProgramBlock.consolidateAndCheckResults(ParForProgramBlock.java:1740)
> at
> org.apache.sysml.runtime.controlprogram.ParForProgramBlock.executeLocalParFor(ParForProgramBlock.java:814)
> at
> org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:639)
> ... 33 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
