Jason Lowe created YARN-2185:

             Summary: Use pipes when localizing archives
                 Key: YARN-2185
                 URL: https://issues.apache.org/jira/browse/YARN-2185
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.4.0
            Reporter: Jason Lowe

Currently the nodemanager downloads an archive to a local file, unpacks it, and 
then removes it.  It would be more efficient to stream the data as it's being 
unpacked to avoid both the extra disk space requirements and the additional 
disk activity from storing the archive.

This message was sent by Atlassian JIRA

Reply via email to