Ruifeng Zheng created SPARK-58906:
-------------------------------------
Summary: Make PySpark vector and matrix UDTs singletons
Key: SPARK-58906
URL: https://issues.apache.org/jira/browse/SPARK-58906
Project: Spark
Issue Type: Sub-task
Components: ML
Affects Versions: 5.0.0
Reporter: Ruifeng Zheng
PySpark VectorUDT and MatrixUDT are stateless. Make the pyspark.ml.linalg and
pyspark.mllib.linalg implementations use the existing DataTypeSingleton
metaclass so repeated construction and schema JSON round-trips reuse the same
Python UDT instances, matching the singleton direction in PR #57757.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
