[
https://issues.apache.org/jira/browse/IGNITE-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yury Babak updated IGNITE-6783:
-------------------------------
Component/s: ml
> Create common mechanism for group training.
> -------------------------------------------
>
> Key: IGNITE-6783
> URL: https://issues.apache.org/jira/browse/IGNITE-6783
> Project: Ignite
> Issue Type: Task
> Security Level: Public(Viewable by anyone)
> Components: ml
> Reporter: Artem Malykh
> Assignee: Artem Malykh
>
> In distributed ML it is a common task to train several models in parallel
> with ability to communicate with each other during training. Simple example
> of this case is training of neural network with SGD on different chunks of
> data located on several nodes. In such training we do the following in a
> loop: on each node we do one or several SGD steps then send gradient on
> central node which averages gradients from each of worker nodes and send back
> the averaged gradient. There is a pattern in this procedure which can be
> applied to other ML algos and it could be useful to extract this pattern.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
