[
https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704342#comment-16704342
]
Xun Liu commented on YARN-8714:
-------------------------------
hi [~leftnoteasy]，[~tangzhankun]
Need to support the functionality of the directory because:
1. The user will only write or upload files in the directory, and the user will
only see the directories and files.
2. If the user operates the directory and files, zeppelin privately becomes a
TAR package, and yarn decompresses the tar package into a directory. The two
processes of packaging and unpacking are implemented in half in each of the two
systems, and the logic is very strange.
In submarine, you can check that the directory size of the user-specified
directory cannot exceed the limit. For example: the default value is 1G, the
file size fails, and the error log is output to YARN.
> [Submarine] Support files/tarballs to be localized for a training job.
> ----------------------------------------------------------------------
>
> Key: YARN-8714
> URL: https://issues.apache.org/jira/browse/YARN-8714
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: Zhankun Tang
> Priority: Major
> Attachments: YARN-8714-WIP1-trunk-001.patch,
> YARN-8714-WIP1-trunk-002.patch, YARN-8714-trunk.001.patch,
> YARN-8714-trunk.002.patch
>
>
> See
> [https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7],
> {{job run --localization ...}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
