[jira] [Commented] (SPARK-24283) Make standard scaler work without legacy MLlib

2018-08-01 Thread Apache Spark (JIRA) 


[ 
https://issues.apache.org/jira/browse/SPARK-24283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565020#comment-16565020
 ] 

Apache Spark commented on SPARK-24283:
--

User 'sujithjay' has created a pull request for this issue:
https://github.com/apache/spark/pull/21942

> Make standard scaler work without legacy MLlib
> --
>
> Key: SPARK-24283
> URL: https://issues.apache.org/jira/browse/SPARK-24283
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.4.0
>Reporter: holdenk
>Priority: Trivial
>  Labels: starter
>
> Currently StandardScaler converts Spark ML vectors to MLlib vectors during 
> prediction, we should skip that step.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-24283) Make standard scaler work without legacy MLlib

2018-05-21 Thread zhengruifeng (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-24283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482277#comment-16482277
 ] 

zhengruifeng commented on SPARK-24283:
--

[~holdenk] do you mean that we should impl the prediction in ML.features (not 
to call the MLlib.features.StandardScalerModel.transform) ?

> Make standard scaler work without legacy MLlib
> --
>
> Key: SPARK-24283
> URL: https://issues.apache.org/jira/browse/SPARK-24283
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.4.0
>Reporter: holdenk
>Priority: Trivial
>  Labels: starter
>
> Currently StandardScaler converts Spark ML vectors to MLlib vectors during 
> prediction, we should skip that step.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-24283) Make standard scaler work without legacy MLlib

2018-05-17 Thread Huaxin Gao (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-24283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479405#comment-16479405
 ] 

Huaxin Gao commented on SPARK-24283:


[~holdenk] Hi Holden, all I need to do is to change 
{code:java}
val transformer: Vector => Vector = v => 
scaler.transform(OldVectors.fromML(v)).asML{code}
 to
{code:java}
val transformer: Vector => Vector = v => scaler.transform(v).asML{code}
so it will use the implicit converting, right?

> Make standard scaler work without legacy MLlib
> --
>
> Key: SPARK-24283
> URL: https://issues.apache.org/jira/browse/SPARK-24283
> Project: Spark
>  Issue Type: Improvement
>  Components: ML
>Affects Versions: 2.4.0
>Reporter: holdenk
>Priority: Trivial
>  Labels: starter
>
> Currently StandardScaler converts Spark ML vectors to MLlib vectors during 
> prediction, we should skip that step.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org