[
https://issues.apache.org/jira/browse/SPARK-21511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21511.
-------------------------------
Resolution: Invalid
This should start as a question on the mailing list. It looks like an error in
your imports in your code.
> Unable to load Pipeline or PipelineModel
> ----------------------------------------
>
> Key: SPARK-21511
> URL: https://issues.apache.org/jira/browse/SPARK-21511
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 2.1.0
> Reporter: Saif Addin
>
> {code:java}
> ...
> model.transform(self.data).show()
> pipe_path = "./tmp_pipeline"
> pipeline.write().overwrite().save(pipe_path)
> loaded_pipeline = Pipeline.read().load(pipe_path)
> {code}
> throws
> {code:java}
> ======================================================================
> ERROR: runTest (test.code.PipelineTestSpec)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "code.py", line 207, in runTest
> loaded_pipeline = Pipeline.read().load(pipe_path)
> File "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/util.py",
> line 198, in load
> return self._clazz._from_java(java_obj)
> File
> "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py",
> line 155, in _from_java
> py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
> File
> "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/pipeline.py",
> line 155, in <listcomp>
> py_stages = [JavaParams._from_java(s) for s in java_stage.getStages()]
> File
> "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py",
> line 173, in _from_java
> py_type = __get_class(stage_name)
> File
> "spark-2.1.1-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/ml/wrapper.py",
> line 167, in __get_class
> m = __import__(module)
> ModuleNotFoundError: No module named 'com'
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]