[ https://issues.apache.org/jira/browse/SPARK-28159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhengruifeng updated SPARK-28159: --------------------------------- Description: It is a long time since ML was released. However, there are still many TODOs (like in [ChiSqSelector.scala|https://github.com/apache/spark/pull/24963/files#diff-9b0bc8a01b34c38958ce45c14f9c5da5] {// TODO: Make the transformer natively in ml framework to avoid extra conversion.}) on making transform natively in ml framework. I try to make ml algs no longer need to convert ml-vector to mllib-vector in transforms. Including: LDA/ChiSqSelector/ElementwiseProduct/HashingTF/IDF/Normalizer/PCA/StandardScaler. was: It is a long time since ML was released. However, there are still many TODOs on making transform natively in ml framework. > Make the transform natively in ml framework to avoid extra conversion > --------------------------------------------------------------------- > > Key: SPARK-28159 > URL: https://issues.apache.org/jira/browse/SPARK-28159 > Project: Spark > Issue Type: Improvement > Components: ML > Affects Versions: 3.0.0 > Reporter: zhengruifeng > Priority: Major > > It is a long time since ML was released. > However, there are still many TODOs (like in > [ChiSqSelector.scala|https://github.com/apache/spark/pull/24963/files#diff-9b0bc8a01b34c38958ce45c14f9c5da5] > {// TODO: Make the transformer natively in ml framework to avoid extra > conversion.}) on making transform natively in ml framework. > > I try to make ml algs no longer need to convert ml-vector to mllib-vector in > transforms. > Including: > LDA/ChiSqSelector/ElementwiseProduct/HashingTF/IDF/Normalizer/PCA/StandardScaler. > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org