[
https://issues.apache.org/jira/browse/SPARK-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-15211:
-------------------------------
Affects Version/s: 2.0.0
Target Version/s: 2.0.0
Description:
It will cause failure when trying to load data with LibSVMRelation and select
features column:
{code}
val df2 = spark.read.format("libsvm").load("data/mllib/sample_libsvm_data.txt")
df: org.apache.spark.sql.DataFrame = [label: double, features: vector]
scala> df2.select("features").show
java.lang.RuntimeException: Error while decoding: scala.MatchError: 19 (of
class java.lang.Byte)
createexternalrow(if (isnull(input[0, vector])) null else newInstance(class
org.apache.spark.mllib.linalg.VectorUDT).deserialize,
StructField(features,org.apache.spark.mllib.linalg.VectorUDT@f71b0bce,true))
...
{code}
was:
It will cause failure when trying to load data with LibSVMRelation and select
features column:
{code}
val df2 = spark.read.format("libsvm").load("data/mllib/sample_libsvm_data.txt")
df: org.apache.spark.sql.DataFrame = [label: double, features: vector]
scala> df2.select("features").show
java.lang.RuntimeException: Error while decoding: scala.MatchError: 19 (of
class java.lang.Byte)
createexternalrow(if (isnull(input[0, vector])) null else newInstance(class
org.apache.spark.mllib.linalg.VectorUDT).deserialize,
StructField(features,org.apache.spark.mllib.linalg.VectorUDT@f71b0bce,true))
...
{code}
> Select features column from LibSVMRelation causes failure
> ---------------------------------------------------------
>
> Key: SPARK-15211
> URL: https://issues.apache.org/jira/browse/SPARK-15211
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Liang-Chi Hsieh
> Assignee: Liang-Chi Hsieh
> Fix For: 2.0.0
>
>
> It will cause failure when trying to load data with LibSVMRelation and select
> features column:
> {code}
> val df2 =
> spark.read.format("libsvm").load("data/mllib/sample_libsvm_data.txt")
> df: org.apache.spark.sql.DataFrame = [label: double, features: vector]
> scala> df2.select("features").show
> java.lang.RuntimeException: Error while decoding: scala.MatchError: 19 (of
> class java.lang.Byte)
> createexternalrow(if (isnull(input[0, vector])) null else newInstance(class
> org.apache.spark.mllib.linalg.VectorUDT).deserialize,
> StructField(features,org.apache.spark.mllib.linalg.VectorUDT@f71b0bce,true))
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
