[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-23 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Attachment: YARN-5767-trunk-v1.patch Attached is a v1 patch for trunk. In this initial patch I

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Attachment: YARN-5767-trunk-v3.patch V3 attached. Fixed whitespace. > Fix the order that resources

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Attachment: YARN-5767-trunk-v2.patch Attaching a v2 patch for trunk. This new version simply fixes

[jira] [Created] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-5767: -- Summary: Fix the order that resources are cleaned up from the local Public/Private caches Key: YARN-5767 URL: https://issues.apache.org/jira/browse/YARN-5767 Project:

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Affects Version/s: (was: 2.6.5) (was: 2.7.3)

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Description: If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see that

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596593#comment-15596593 ] Chris Trezzo commented on YARN-5767: I see two initial high-level approaches to this problem: # Add all

[jira] [Comment Edited] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-10-31 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624305#comment-15624305 ] Chris Trezzo edited comment on YARN-5797 at 11/1/16 4:27 AM: - Attaching v1

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-10-31 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk-v1.patch Attaching v1 patch to get a qa run. Summary: # Added metrics

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-28 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615974#comment-15615974 ] Chris Trezzo commented on YARN-5767: Thanks [~jlowe]! I will add release notes to the issue as well. >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-11-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630595#comment-15630595 ] Chris Trezzo commented on YARN-5797: Note that the patch exposes the following metrics about the cache

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609674#comment-15609674 ] Chris Trezzo commented on YARN-5767: Thanks for the reviews [~miklos.szeg...@cloudera.com] and

[jira] [Updated] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2016-10-12 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5727: --- Description: When running LinuxContainerExecutor in a secure mode

[jira] [Updated] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2016-10-12 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5727: --- Attachment: YARN-5727-Design-v1.pdf V1 of a design doc posted. Please let me know your thoughts.

[jira] [Created] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2016-10-12 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-5727: -- Summary: Improve YARN shared cache support for LinuxContainerExecutor Key: YARN-5727 URL: https://issues.apache.org/jira/browse/YARN-5727 Project: Hadoop YARN

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk.002.patch Attaching v2 to fix checkstyle issues. Once I get a +1 for the

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749064#comment-15749064 ] Chris Trezzo commented on YARN-5797: Jira filed: YARN-6004 > Add metrics to the node manager for

[jira] [Created] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2016-12-14 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-6004: -- Summary: Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines Key: YARN-6004 URL:

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749056#comment-15749056 ] Chris Trezzo commented on YARN-5797: The checkstyle warning is because the

[jira] [Created] (YARN-6097) Add support for directories in the Shared Cache

2017-01-13 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-6097: -- Summary: Add support for directories in the Shared Cache Key: YARN-6097 URL: https://issues.apache.org/jira/browse/YARN-6097 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-11 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Attachment: YARN-3637-trunk.001.patch Attached is a v01 patch for handling symlink names and fragments

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-29 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-trunk.002.patch Attached is v2 for trunk to address checkstyle issues. >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-03-29 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948062#comment-15948062 ] Chris Trezzo commented on YARN-5797: Patch is now available for YARN-6004 as well. Thanks! > Add

[jira] [Assigned] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-6004: -- Assignee: Chris Trezzo (was: luhuichun) > Refactor

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-trunk.001.patch Attached is a v1 patch for trunk. This patch breaks the

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1597#comment-1597 ] Chris Trezzo commented on YARN-2960: Circling back and taking a look at this now. > Add documentation

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955930#comment-15955930 ] Chris Trezzo commented on YARN-1492: Hi [~jhung], thanks for the question! bq. will this feature save

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-branch-2.001.patch Thanks [~mingma]! Attached is a branch-2 v1 patch. Note that

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956049#comment-15956049 ] Chris Trezzo commented on YARN-5797: As soon as the patch for YARN-6004 is in, I will rebase for trunk

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956103#comment-15956103 ] Chris Trezzo commented on YARN-6004: These unit tests fail locally on branch-2 without the patch. As

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957380#comment-15957380 ] Chris Trezzo commented on YARN-6004: Thanks [~mingma]! > Refactor

[jira] [Assigned] (YARN-2960) Add documentation for the YARN shared cache

2017-03-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-2960: -- Assignee: Chris Trezzo > Add documentation for the YARN shared cache >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957929#comment-15957929 ] Chris Trezzo commented on YARN-5797: Branch-2 test failures are unrelated. From my perspective the

[jira] [Comment Edited] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957794#comment-15957794 ] Chris Trezzo edited comment on YARN-5797 at 4/5/17 9:43 PM: Also attached is a

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk.003.patch Attached is a v3 patch that is rebased on trunk. > Add metrics

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-branch-2.001.patch Also attached is a v1 branch-2 patch. The only conflict was

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961163#comment-15961163 ] Chris Trezzo commented on YARN-5797: Thanks everyone for the reviews and [~mingma] for the commit! >

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-07-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081151#comment-16081151 ] Chris Trezzo commented on YARN-1492: bq. Could you explain how the shared cache leverage the node

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192221#comment-16192221 ] Chris Trezzo commented on YARN-2960: Thanks [~mingma]! I will commit to trunk, branch-3.0 and branch-2.

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188808#comment-16188808 ] Chris Trezzo commented on YARN-1492: Please let me know if you have any concerns about this. Thanks! >

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Release Note: The YARN Shared Cache provides the facility to upload and manage shared application

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Target Version/s: 2.9.0 (was: 3.1.0) > truly shared cache for jars (jobjar/libjar) >

[jira] [Comment Edited] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801 ] Chris Trezzo edited comment on YARN-1492 at 10/2/17 8:50 PM: - [~asuresh]

[jira] [Updated] (YARN-2663) Race condintion in shared cache CleanerTask during deletion of resource

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2663: --- Parent Issue: YARN-7282 (was: YARN-1492) > Race condintion in shared cache CleanerTask during

[jira] [Updated] (YARN-2774) shared cache service should authorize calls properly

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2774: --- Parent Issue: YARN-7282 (was: YARN-1492) > shared cache service should authorize calls properly >

[jira] [Resolved] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved YARN-1016. Resolution: Duplicate Resolving this as a duplicate of YARN-1492. Please let me know if you think

[jira] [Updated] (YARN-6097) Add support for directories in the Shared Cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6097: --- Issue Type: Sub-task (was: Bug) Parent: YARN-7282 > Add support for directories in the Shared

[jira] [Updated] (YARN-2781) support more flexible policy for uploading in shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2781: --- Issue Type: Sub-task (was: New Feature) Parent: YARN-7282 > support more flexible policy for

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189050#comment-16189050 ] Chris Trezzo commented on YARN-2960: Patch should be good to go, please let me know if you see any

[jira] [Created] (YARN-7282) Shared Cache Phase 2

2017-10-02 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7282: -- Summary: Shared Cache Phase 2 Key: YARN-7282 URL: https://issues.apache.org/jira/browse/YARN-7282 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-001.patch Trunk v1 attached. > Add documentation for the YARN shared

[jira] [Assigned] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-5727: -- Assignee: (was: Chris Trezzo) > Improve YARN shared cache support for

[jira] [Updated] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5727: --- Issue Type: Sub-task (was: Bug) Parent: YARN-7282 > Improve YARN shared cache support for

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801 ] Chris Trezzo commented on YARN-1492: [~asuresh] [~subru] I have set the target version for this jira

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-03 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-002.patch Thanks for the review [~mingma]! Attached is a trunk v2 patch to

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193397#comment-16193397 ] Chris Trezzo commented on YARN-2960: Committed to trunk, branch-3.0, branch-2. Thanks! > Add

[jira] [Resolved] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved YARN-1492. Resolution: Fixed Fix Version/s: 3.0.0 2.9.0 I am resolving this issue as

[jira] [Comment Edited] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371 ] Chris Trezzo edited comment on YARN-2960 at 10/5/17 6:19 PM: - I unfortunately

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371 ] Chris Trezzo commented on YARN-2960: I unfortunately made a small mistake while cherry-picking the

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179819#comment-16179819 ] Chris Trezzo commented on YARN-7250: The TestNMClient failure is happening on trunk as well, and is

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181276#comment-16181276 ] Chris Trezzo commented on YARN-7253: Thanks [~vrushalic]! I will commit later today to trunk and

[jira] [Created] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7253: -- Summary: Shared Cache Manager daemon command listed as admin subcmd in yarn script Key: YARN-7253 URL: https://issues.apache.org/jira/browse/YARN-7253 Project: Hadoop

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Priority: Trivial (was: Minor) > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Description: Currently the command to start the shared cache manager daemon is listed as an admin

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-alpha4 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-beta1 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-10-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187583#comment-16187583 ] Chris Trezzo commented on YARN-7001: Looking at this patch, I am not entirely sure if this fixes the

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-10-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187584#comment-16187584 ] Chris Trezzo commented on YARN-7001: Also thanks [~Sen Zhao] for the patch! > If shared cache upload

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183443#comment-16183443 ] Chris Trezzo commented on YARN-7250: Also to clarify, this is a client side only change. The

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183463#comment-16183463 ] Chris Trezzo commented on YARN-7250: Thank you [~vrushalic] for the review! I will wait until tomorrow

[jira] [Created] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7250: -- Summary: Update Shared cache client api to use URLs Key: YARN-7250 URL: https://issues.apache.org/jira/browse/YARN-7250 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Attachment: YARN-7250-trunk-001.patch Attached v1 patch. > Update Shared cache client api to use URLs

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Attachment: YARN-7253-trunk-001.patch Trunk v1 patch attached. > Shared Cache Manager daemon command

[jira] [Assigned] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-7253: -- Assignee: Chris Trezzo > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Description: We should make the SharedCacheClient use api more consistent with other YARN api

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-003.patch Thanks [~mingma]! Attached is a v3 patch. I put all of the

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-004.patch Attached v4 to add italics around parameters in the setup

[jira] [Created] (YARN-7694) Optionally run shared cache manager as part of the resource manager

2018-01-02 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7694: -- Summary: Optionally run shared cache manager as part of the resource manager Key: YARN-7694 URL: https://issues.apache.org/jira/browse/YARN-7694 Project: Hadoop YARN

[jira] [Commented] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578701#comment-16578701 ] Chris Trezzo commented on YARN-5727: As stated above, I no longer think that the v1 design attached is

[jira] [Assigned] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-5727: -- Assignee: zhenzhao wang > Improve YARN shared cache support for LinuxContainerExecutor >

[jira] [Commented] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578769#comment-16578769 ] Chris Trezzo commented on YARN-5727: Assigning to [~wzzdreamer]. He will start working on a new draft

<    1   2   3