[
https://issues.apache.org/jira/browse/SYSTEMML-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15539283#comment-15539283
]
Mike Dusenberry edited comment on SYSTEMML-995 at 10/1/16 10:51 PM:
--------------------------------------------------------------------
Alright I fixed that issue, but now I'm still running into the reblock issue:
Script:
{code}
n = nrow(trainf)
d = ncol(trainf)
{code}
Error:
{code}
Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error
in program block generated from statement block between lines 1 and 7 -- Error
evaluating instruction:
SPARK°rblk°trainf·FRAME·DOUBLE·false°_fVar5·FRAME·DOUBLE°1000°1000°true
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:335)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:224)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:168)
at
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:145)
... 15 more
Caused by: org.apache.sysml.runtime.DMLRuntimeException: The given InputInfo is
not implemented for ReblockSPInstruction: binaryblock
at
org.apache.sysml.runtime.instructions.spark.ReblockSPInstruction.processFrameReblockInstruction(ReblockSPInstruction.java:251)
at
org.apache.sysml.runtime.instructions.spark.ReblockSPInstruction.processInstruction(ReblockSPInstruction.java:115)
{code}
was (Author: [email protected]):
Alright I fixed that issue, but now I'm still running into reblock issue:
Script:
{code}
n = nrow(trainf)
d = ncol(trainf)
{code}
Error:
{code}
Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error
in program block generated from statement block between lines 1 and 7 -- Error
evaluating instruction:
SPARK°rblk°trainf·FRAME·DOUBLE·false°_fVar5·FRAME·DOUBLE°1000°1000°true
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:335)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:224)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:168)
at
org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:145)
... 15 more
Caused by: org.apache.sysml.runtime.DMLRuntimeException: The given InputInfo is
not implemented for ReblockSPInstruction: binaryblock
at
org.apache.sysml.runtime.instructions.spark.ReblockSPInstruction.processFrameReblockInstruction(ReblockSPInstruction.java:251)
at
org.apache.sysml.runtime.instructions.spark.ReblockSPInstruction.processInstruction(ReblockSPInstruction.java:115)
{code}
> MLContext dataframe-frame conversion with index column & vector column
> ----------------------------------------------------------------------
>
> Key: SYSTEMML-995
> URL: https://issues.apache.org/jira/browse/SYSTEMML-995
> Project: SystemML
> Issue Type: Bug
> Components: APIs
> Affects Versions: SystemML 0.11
> Reporter: Matthias Boehm
> Priority: Blocker
>
> MLContext currently always assumes data frame to frame conversion without
> existing index column. Since the user cannot communicate the existence of
> this column, the data conversion leads to incorrect results as an additional
> column is included in the output frame. We need make the MLContext handling
> of frames consistent with the handling of matrices.
> Additionally, the conversion code in
> {{MLContextConversionUtil.dataFrameToFrameObject()}} does not yet take into
> account frames with vectors, although the recent addition adds this support
> in the underlying {{FrameRDDConverterUtils.java}} class. Therefore, the
> number of columns set when {{mc == null}} is incorrect.
> Thanks [[email protected]] for catching this issue. cc [~acs_s] [~deron]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
