[jira] [Commented] (LIVY-569) BinaryClassificationMetrics give AttributeError

[Yiheng Wang (Jira)]

[ 
https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964538#comment-16964538
 ] 

Yiheng Wang commented on LIVY-569:
--


>From the comments of the stack overflow question, it looks like it's related 
>with AWS EMR Livy. Are you also using the AWS EMR livy?

> BinaryClassificationMetrics give AttributeError
> ---
>
> Key: LIVY-569
> URL: https://issues.apache.org/jira/browse/LIVY-569
> Project: Livy
>  Issue Type: Bug
>Reporter: Fred de Gier
>Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible 
> related to conversion of data types. This only occurs when using Sparkmagic 
> and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext 
>  from pyspark.sql import SparkSession 
>  import pyspark
>  from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
>  ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>  
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (LIVY-703) Show SparkUI link on Livy UI when running on Kubernetes

[Aliaksandr Sasnouskikh (Jira)]

 [ 
https://issues.apache.org/jira/browse/LIVY-703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aliaksandr Sasnouskikh updated LIVY-703:

Summary: Show SparkUI link on Livy UI when running on Kubernetes  (was: 
Show SparkUI link on Livy UI while session is running)

> Show SparkUI link on Livy UI when running on Kubernetes
> ---
>
> Key: LIVY-703
> URL: https://issues.apache.org/jira/browse/LIVY-703
> Project: Livy
>  Issue Type: New Feature
> Environment: Kubernetes
>Reporter: Aliaksandr Sasnouskikh
>Priority: Minor
> Fix For: 0.7.0
>
>
> We want to show the link to Spark UI on the Livy UI while session is in 
> Running state.
> The format of the link url should be configurable.
> Examples:
>  * https://my-cluster.example.com/spark-ui/%s
>  * [http://%s.my-cluster.example.com/|http://%25s.my-cluster.example.com/]
> where %s is Spark appId.
> Since Livy UI already displays Spark appId and adds link to it when it is 
> provided through AppInfo, using it for routing purposes looks right decision.
>  
> This change should unlock the integrations with Kubernetes Ingress resources.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)