Oleksiy Sayankin commented on SPARK-14358:

Hive-2.X.X uses JavaSparkListener

package org.apache.hadoop.hive.ql.exec.spark.status.impl;

import ...

public class JobMetricsListener extends JavaSparkListener {

Configuring Hive-2.X.X on Spark-2.0.0 will give an exception:


2016-09-16T11:20:57,474 INFO  [stderr-redir-1]: client.SparkClientImpl 
(SparkClientImpl.java:run(593)) - java.lang.NoClassDefFoundError: 

Please add JavaSparkListener into Spark-2.0.0

> Change SparkListener from a trait to an abstract class, and remove 
> JavaSparkListener
> ------------------------------------------------------------------------------------
>                 Key: SPARK-14358
>                 URL: https://issues.apache.org/jira/browse/SPARK-14358
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Scheduler, Spark Core
>            Reporter: Reynold Xin
>            Assignee: Reynold Xin
>             Fix For: 2.0.0
> Scala traits are difficult to maintain binary compatibility on, and as a 
> result we had to introduce JavaSparkListener. In Spark 2.0 we can change 
> SparkListener from a trait to an abstract class and then remove 
> JavaSparkListener.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to