[jira] [Comment Edited] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-11-08 Thread Venkatesh Avula (Jira) 


[ 
https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970542#comment-16970542
 ] 

Venkatesh Avula edited comment on LIVY-569 at 11/8/19 7:41 PM:
---

I agree with [~fdegier], I too use Hortonworks Livy and face the same error. I 
do not think this is specific to AWS EMR.



> BinaryClassificationMetrics give AttributeError
> ---
>
> Key: LIVY-569
> URL: https://issues.apache.org/jira/browse/LIVY-569
> Project: Livy
>  Issue Type: Bug
>Reporter: Fred de Gier
>Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible 
> related to conversion of data types. This only occurs when using Sparkmagic 
> and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext 
>  from pyspark.sql import SparkSession 
>  import pyspark
>  from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
>  ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>  
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Comment Edited] (LIVY-569) BinaryClassificationMetrics give AttributeError

2019-10-30 Thread Yiheng Wang (Jira) 


[ 
https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962882#comment-16962882
 ] 

Yiheng Wang edited comment on LIVY-569 at 10/30/19 10:05 AM:
-

Hi, which version of spark/livy are you using. I cannot reproduce this error.


was (Author: yihengw):
Hi, which version of spark/livy are you using. I cannot reproduce this error. 
Please check the attachment.

 !屏幕快照 2019-10-30 下午6.03.04.png! 

> BinaryClassificationMetrics give AttributeError
> ---
>
> Key: LIVY-569
> URL: https://issues.apache.org/jira/browse/LIVY-569
> Project: Livy
>  Issue Type: Bug
>Reporter: Fred de Gier
>Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible 
> related to conversion of data types. This only occurs when using Sparkmagic 
> and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext 
>  from pyspark.sql import SparkSession 
>  import pyspark
>  from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
>  ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>  
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)