[ 
https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15509053#comment-15509053
 ] 

DB Tsai commented on SPARK-17134:
---------------------------------

I'm benchmarking MLOR with 22533 of classes, and dense feature of 100. The 
number of instances are 200M. On a cluster with 1k executors, it takes 2.5 
hours for one iteration. Will be great that we can do some performance 
investigation to see if we can push the performance further. Thanks.

> Use level 2 BLAS operations in LogisticAggregator
> -------------------------------------------------
>
>                 Key: SPARK-17134
>                 URL: https://issues.apache.org/jira/browse/SPARK-17134
>             Project: Spark
>          Issue Type: Sub-task
>          Components: ML
>            Reporter: Seth Hendrickson
>
> Multinomial logistic regression uses LogisticAggregator class for gradient 
> updates. We should look into refactoring MLOR to use level 2 BLAS operations 
> for the updates. Performance testing should be done to show improvements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to