Vaishali Papneja created SPARK-32650:
----------------------------------------
Summary: MLeap 0.16.1 version is not compatible with spark: 3.0.0
and scala: 2.12 version
Key: SPARK-32650
URL: https://issues.apache.org/jira/browse/SPARK-32650
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 3.0.0
Reporter: Vaishali Papneja
Hi,
I am using Databricks cluster with configuration as Spark: 3.0.0 and Scala:
2.12 and want to create Machine Learning pipelines using MLeap - latest
version: 0.16.1.
In my pipeline, I have created ensemble model. I am to serialize the model to a
bundle.
But the issue comes while deserializing it. Below is the error I am facing:
_java.lang.NoSuchMethodError:
org.apache.spark.mllib.tree.impurity.ImpurityCalculator$.getCalculator(Ljava/lang/String;[D)Lorg/apache/spark/mllib/tree/impurity/ImpurityCalculator;_
I tried using another cluster with the configuration as - spark: 2.4.5, scala:
2.11 and MLeap: 0.16.0. There it is working fine.
Please suggest.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
