[
https://issues.apache.org/jira/browse/SYSTEMML-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-864:
------------------------------------
Description:
In execution modes singlenode, hadoop, hybrid no reblocks are injected for
frames of format "csv". Accordingly, any nrow/ncol after a frame csv read with
unknown size fail with the following exception.
{code}
Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid meta data
returned by 'nrow': -1
at
org.apache.sysml.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:122)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)
{code}
We already have a special case for matrices in execution mode singlenode, which
reads the matrix and updates the meta data on the fly. This functionality
should be extended for frames too.
> Meta data operations after csv frame read w/ unknown size
> ---------------------------------------------------------
>
> Key: SYSTEMML-864
> URL: https://issues.apache.org/jira/browse/SYSTEMML-864
> Project: SystemML
> Issue Type: Bug
> Components: Runtime
> Affects Versions: SystemML 0.11
> Reporter: Matthias Boehm
>
> In execution modes singlenode, hadoop, hybrid no reblocks are injected for
> frames of format "csv". Accordingly, any nrow/ncol after a frame csv read
> with unknown size fail with the following exception.
> {code}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid meta data
> returned by 'nrow': -1
> at
> org.apache.sysml.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:122)
> at
> org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)
> {code}
> We already have a special case for matrices in execution mode singlenode,
> which reads the matrix and updates the meta data on the fly. This
> functionality should be extended for frames too.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
