[
https://issues.apache.org/jira/browse/MAPREDUCE-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated MAPREDUCE-6113:
-------------------------------
Resolution: Duplicate
Status: Resolved (was: Patch Available)
I believe YARN-1492 aims to solve just this in a wider way, and supersedes the
fix here. Please feel free to correct me and reopen if am wrong.
Closing as duplicate of MAPREDUCE-5951, which aims to implement the MR2 side of
YARN-1492.
> An ability to override LocalResourceVisibility for public resources
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-6113
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6113
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: client, distributed-cache
> Reporter: Andrey Stepachev
> Assignee: Andrey Stepachev
> Priority: Minor
> Attachments: MAPREDUCE-6113.patch
>
>
> Currently it is impossible to specify APPLICATION level for files in
> distributed cache in YARN. For applications with big common data it is very
> crucial to have ability to share data only for application and do not spam
> public cache. Moreover, public localiser is limited for parallel downloads,
> so applications with big caches affect application startup of other
> applications.
> Current logic is complicated and based on file permissions. Making proposed
> changes, user can override public level to any level (PUBLIC/APP/PRIVATE)
> without breaking anything, and ever not need to bother with permission, if
> private cache is needed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
