[
https://issues.apache.org/jira/browse/SYSTEMML-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-2023:
-------------------------------------
Description:
Any RDD collect of a compressed matrix with more than one block currently fails
as follows
{code}
Caused by: java.lang.NullPointerException
at
org.apache.sysml.runtime.matrix.data.MatrixBlock.copySparseToDense(MatrixBlock.java:1576)
at
org.apache.sysml.runtime.matrix.data.MatrixBlock.copy(MatrixBlock.java:1485)
at
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:850)
at
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:776)
at
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:499)
at
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:1)
at
org.apache.sysml.runtime.controlprogram.caching.CacheableData.acquireRead(CacheableData.java:426)
at
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.getBroadcastForVariable(SparkExecutionContext.java:544)
at
org.apache.sysml.runtime.instructions.spark.SpoofSPInstruction.processInstruction(SpoofSPInstruction.java:125)
at
org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:264)
{code}
> RDD collect of compressed matrix fails w/ NPE
> ---------------------------------------------
>
> Key: SYSTEMML-2023
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2023
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
>
> Any RDD collect of a compressed matrix with more than one block currently
> fails as follows
> {code}
> Caused by: java.lang.NullPointerException
> at
> org.apache.sysml.runtime.matrix.data.MatrixBlock.copySparseToDense(MatrixBlock.java:1576)
> at
> org.apache.sysml.runtime.matrix.data.MatrixBlock.copy(MatrixBlock.java:1485)
> at
> org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:850)
> at
> org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.toMatrixBlock(SparkExecutionContext.java:776)
> at
> org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:499)
> at
> org.apache.sysml.runtime.controlprogram.caching.MatrixObject.readBlobFromRDD(MatrixObject.java:1)
> at
> org.apache.sysml.runtime.controlprogram.caching.CacheableData.acquireRead(CacheableData.java:426)
> at
> org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext.getBroadcastForVariable(SparkExecutionContext.java:544)
> at
> org.apache.sysml.runtime.instructions.spark.SpoofSPInstruction.processInstruction(SpoofSPInstruction.java:125)
> at
> org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:264)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
