[
https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fred de Gier updated LIVY-569:
------------------------------
Description:
When using the BinaryClassificationMetrics there is an error, possible related
to conversion of data types. This only occurs when using Sparkmagic and Livy.
*Input:*
{code:java}
from pyspark import SparkContext
from pyspark.sql import SparkSession
import pyspark
from pyspark.mllib.evaluation import BinaryClassificationMetrics
a = sc.parallelize([
(0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
(0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
(0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
(0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
(0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
])
metrics = BinaryClassificationMetrics(a)
{code}
*Output:*
{code:java}
'StructField' object has no attribute '_get_object_id' {code}
was:
When using the BinaryClassificationMetrics there is an error, possible related
to conversion of data types. This only occurs when using Sparkmagic and Livy.
*Input:*
```from pyspark import SparkContext
from pyspark.sql import SparkSession
import pyspark
from pyspark.mllib.evaluation import BinaryClassificationMetrics
a = sc.parallelize([
(0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
(0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
(0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
(0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
(0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
])
metrics = BinaryClassificationMetrics(a)
```
*Output:*
```
'StructField' object has no attribute '_get_object_id'
```
> BinaryClassificationMetrics give AttributError
> ----------------------------------------------
>
> Key: LIVY-569
> URL: https://issues.apache.org/jira/browse/LIVY-569
> Project: Livy
> Issue Type: Bug
> Reporter: Fred de Gier
> Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible
> related to conversion of data types. This only occurs when using Sparkmagic
> and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext
> from pyspark.sql import SparkSession
> import pyspark
> from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
> (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
> (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
> (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
> (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
> (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
> ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
