zhengruifeng created SPARK-29914:
------------------------------------
Summary: ML models append metadata in `transform`/`transformSchema`
Key: SPARK-29914
URL: https://issues.apache.org/jira/browse/SPARK-29914
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 3.0.0
Reporter: zhengruifeng
There are many impls (like
`Binarizer`/`Bucketizer`/`VectorAssembler`/`OneHotEncoder`/`FeatureHasher`/`HashingTF`/`VectorSlicer`/...)
in `.ml` that append appropriate metadata in `transform`/`transformSchema`
method.
However there are also many impls return no metadata in transformation, even
some metadata like `vector.size`/`numAttrs`/`attrs` can be ealily inferred.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
