[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676270#comment-16676270 ]
Zhankun Tang commented on YARN-8714: ------------------------------------ Attached a WIP patch. Please review. [~sunilg] , [~leftnoteasy] The usage of the localization is like this: {code:java} yarn jar ... job run \ --localization hdfs:///user/yarn/script1.py->algorithm1.py /opt/script2.py->script2.py \ --... {code} The "File->LocalFileName" pairs indicates Submarine to localize the "File" into worker's working directory. The "File" can be a local one or HDFS. And archieve type including "jar, tgz" .etc. is also supported. > [Submarine] Support files/tarballs to be localized for a training job. > ---------------------------------------------------------------------- > > Key: YARN-8714 > URL: https://issues.apache.org/jira/browse/YARN-8714 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Wangda Tan > Assignee: Zhankun Tang > Priority: Major > Attachments: YARN-8714-WIP1-trunk-001.patch > > > See > https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7, > {{job run --localizations ...}} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org