[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719391#comment-16719391 ] Hudson commented on YARN-8714: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15600 (See

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718234#comment-16718234 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun], sounds like a plan, but let's try to solve the issue

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713648#comment-16713648 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713614#comment-16713614 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712587#comment-16712587 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712508#comment-16712508 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712411#comment-16712411 ] Hadoop QA commented on YARN-8714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711711#comment-16711711 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710928#comment-16710928 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16710226#comment-16710226 ] Hadoop QA commented on YARN-8714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709547#comment-16709547 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], [~liuxun323] . Per my testing, the YARN localizer

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709178#comment-16709178 ] Wangda Tan commented on YARN-8714: -- Thanks [~tangzhankun], what I remember is YARN doesn't support

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708874#comment-16708874 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], [~liuxun323] , While refining the patch, I found

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707602#comment-16707602 ] Wangda Tan commented on YARN-8714: -- [~liuxun323], fair enough.  [~tangzhankun], I think we can add a

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704342#comment-16704342 ] Xun Liu commented on YARN-8714: --- hi [~leftnoteasy]，[~tangzhankun] Need to support the functionality of the

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704227#comment-16704227 ] Zhankun Tang commented on YARN-8714: {quote}1) Why hardcoded to handle {{hdfs://}}, it could be s3,

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702424#comment-16702424 ] Wangda Tan commented on YARN-8714: -- Thanks [~tangzhankun] for working on the patch, several comments:

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695737#comment-16695737 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695586#comment-16695586 ] Hadoop QA commented on YARN-8714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695501#comment-16695501 ] Xun Liu commented on YARN-8714: --- Now when submarine uses an external algorithm file, Only need to have read

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694779#comment-16694779 ] Zhankun Tang commented on YARN-8714: [~liuxun323] , One question from me. Do you need to support

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692813#comment-16692813 ] Xun Liu commented on YARN-8714: --- [~tangzhankun] , I think there is no problem. > [Submarine] Support

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692696#comment-16692696 ] Zhankun Tang commented on YARN-8714: [~liuxun323], [~leftnoteasy], [~yuan_zac]. Updated a new version.

***UNCHECKED*** [jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684794#comment-16684794 ] Xun Liu commented on YARN-8714: --- # Support files and folders # HDFS type and local file type supporting

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684664#comment-16684664 ] Zac Zhou commented on YARN-8714: Looks great, it would be convenient for notebook app, like Zeppline, to

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680892#comment-16680892 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], {quote}Does it mean the /opt/script.2 on the NM

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680615#comment-16680615 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , I'm still not quite sure about: {code:java}

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy] , The "->" means we want the File in the left to

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677029#comment-16677029 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , could u please explain a little bit about what does

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677030#comment-16677030 ] Wangda Tan commented on YARN-8714: -- + [~liuxun323] / [~yuan_zac] to take a look at this as well. >

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676270#comment-16676270 ] Zhankun Tang commented on YARN-8714: Attached a WIP patch. Please review. [~sunilg] , [~leftnoteasy]

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669392#comment-16669392 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , sure, please go ahead. > [Submarine] Support

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668059#comment-16668059 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy] , I'd like to work on this if you're ok. >