[jira] [Commented] (IGNITE-9034) [ML] Add Estimator API support to TensorFlow cluster on top of Apache Ignite
[ https://issues.apache.org/jira/browse/IGNITE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563708#comment-16563708 ] ASF GitHub Bot commented on IGNITE-9034: Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/4402 > [ML] Add Estimator API support to TensorFlow cluster on top of Apache Ignite > > > Key: IGNITE-9034 > URL: https://issues.apache.org/jira/browse/IGNITE-9034 > Project: Ignite > Issue Type: Improvement > Components: ml >Reporter: Yury Babak >Assignee: Anton Dmitriev >Priority: Major > Fix For: 2.7 > > Attachments: TFI.pdf > > > TensorFlow distributed training historically has been based on workers, > parameter servers and manual assignments, but new TensorFlow API (Estimator > API) allows to run distributed training with minimal changes compare to > single device execution. Take a look [this > presentation|https://www.youtube.com/watch?v=bRMGoPqsn20] for more > information. > Estimator API requires the following configuration: > * TF_CONFIG environment variable that contains json with cluster description > (see [this > tutorial|https://cloud.google.com/ml-engine/docs/tensorflow/distributed-training-details]), > * tf.contrib.distribute.MirroredStrategy(workers) that defines distribution > strategy. > The goal of this task is to allow: > * to start and maintain TensorFlow cluster on top of Apache Ignite that > contains workers and chief job, > * submit job into such cluster using command line interface. > Current architecture is in attachment (see [^TFI.pdf]) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-9034) [ML] Add Estimator API support to TensorFlow cluster on top of Apache Ignite
[ https://issues.apache.org/jira/browse/IGNITE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552486#comment-16552486 ] ASF GitHub Bot commented on IGNITE-9034: GitHub user dmitrievanthony opened a pull request: https://github.com/apache/ignite/pull/4402 IGNITE-9034 Add Estimator API support to TensorFlow cluster on top of Apache Ignite You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-9034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/4402.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #4402 commit a0e7a08acb1bb6b535cdb14047dd0bdf3bbb6868 Author: Anton Dmitriev Date: 2018-07-19T16:15:14Z IGNITE-9034 First version of TensorFlow job submitter, chief and user script runners. commit 387bcf44fea6eb7c1807d51e435e7f030906ed50 Author: Anton Dmitriev Date: 2018-07-19T16:15:46Z Merge branch 'master' of https://github.com/apache/ignite into ignite-9034 commit 3f302197d10940d84a296b6b33aa07f670eff2e0 Author: Anton Dmitriev Date: 2018-07-20T16:37:17Z IGNITE-9034 Update TensorFlow cluster manager. > [ML] Add Estimator API support to TensorFlow cluster on top of Apache Ignite > > > Key: IGNITE-9034 > URL: https://issues.apache.org/jira/browse/IGNITE-9034 > Project: Ignite > Issue Type: Improvement > Components: ml >Reporter: Yury Babak >Assignee: Anton Dmitriev >Priority: Major > Fix For: 2.7 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
