Hyukjin Kwon created SPARK-61735:
------------------------------------
Summary: Construct the native ML models of no arguments, as
PySpark's JavaModel(java_model=None)
Key: SPARK-61735
URL: https://issues.apache.org/jira/browse/SPARK-61735
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
Every model class of pyspark.ml constructs with no arguments, as
JavaModel(java_model=None): a model of a new uid of its class and of its
params, none set, of no server-side object. Its Params API, copy and write()
work; its members of the server, __repr__, a transform and a save raise a bare
AssertionError, and so does the params walk of a model of
functools.cached_property members (trees of a tree ensemble), and so its
explainParams and copy. Over Spark Connect, another java_model is an
AssertionError (assert isinstance(java_model, RemoteModelRef)).
No native model class of Spark Connect Rust constructs: KMeansModel(),
LinearSVCModel(), LDAModel() and the others raise "TypeError: cannot create ...
instances".
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]