[
https://issues.apache.org/jira/browse/SPARK-17136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819062#comment-15819062
]
Seth Hendrickson commented on SPARK-17136:
------------------------------------------
I'm interested in working on this task including both driving the discussion
and submitting an initial PR when it is time. I have the beginnings of a design
document constructed
[here|https://docs.google.com/document/d/1ynyTwlNw4b6DovG6m8okd3fD2PVZKCEq5rFfsg5Ba1k/edit?usp=sharing],
and I'd like to open it up for community feedback and input.
We do see requests from time to time for users to use their own optimizers in
Spark ML algorithms and we have not supported it in Spark ML. With fairly
minimal added code, we can make Spark ML optimizers pluggable which provides a
tangible benefit to users. Potentially, we can design an API that has benefits
beyond just that, and I'm interested to hear some of the other needs/wants
people have.
cc [~dbtsai] [~yanboliang] [~WeichenXu123] [~josephkb] [~srowen]
> Design optimizer interface for ML algorithms
> --------------------------------------------
>
> Key: SPARK-17136
> URL: https://issues.apache.org/jira/browse/SPARK-17136
> Project: Spark
> Issue Type: Sub-task
> Components: ML
> Reporter: Seth Hendrickson
>
> We should consider designing an interface that allows users to use their own
> optimizers in some of the ML algorithms, similar to MLlib.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
