[jira] [Commented] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578769#comment-16578769 ] Chris Trezzo commented on YARN-5727: Assigning to [~wzzdreamer]. He will start working on a new draft

[jira] [Assigned] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-5727: -- Assignee: zhenzhao wang > Improve YARN shared cache support for LinuxContainerExecutor >

[jira] [Commented] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2018-08-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578701#comment-16578701 ] Chris Trezzo commented on YARN-5727: As stated above, I no longer think that the v1 design attached is

[jira] [Created] (YARN-7694) Optionally run shared cache manager as part of the resource manager

2018-01-02 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7694: -- Summary: Optionally run shared cache manager as part of the resource manager Key: YARN-7694 URL: https://issues.apache.org/jira/browse/YARN-7694 Project: Hadoop YARN

[jira] [Resolved] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved YARN-1492. Resolution: Fixed Fix Version/s: 3.0.0 2.9.0 I am resolving this issue as

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193397#comment-16193397 ] Chris Trezzo commented on YARN-2960: Committed to trunk, branch-3.0, branch-2. Thanks! > Add

[jira] [Comment Edited] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371 ] Chris Trezzo edited comment on YARN-2960 at 10/5/17 6:19 PM: - I unfortunately

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371 ] Chris Trezzo commented on YARN-2960: I unfortunately made a small mistake while cherry-picking the

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192221#comment-16192221 ] Chris Trezzo commented on YARN-2960: Thanks [~mingma]! I will commit to trunk, branch-3.0 and branch-2.

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-004.patch Attached v4 to add italics around parameters in the setup

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-003.patch Thanks [~mingma]! Attached is a v3 patch. I put all of the

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-03 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-002.patch Thanks for the review [~mingma]! Attached is a trunk v2 patch to

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189050#comment-16189050 ] Chris Trezzo commented on YARN-2960: Patch should be good to go, please let me know if you see any

[jira] [Resolved] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo resolved YARN-1016. Resolution: Duplicate Resolving this as a duplicate of YARN-1492. Please let me know if you think

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Release Note: The YARN Shared Cache provides the facility to upload and manage shared application

[jira] [Updated] (YARN-2960) Add documentation for the YARN shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2960: --- Attachment: YARN-2960-trunk-001.patch Trunk v1 attached. > Add documentation for the YARN shared

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188808#comment-16188808 ] Chris Trezzo commented on YARN-1492: Please let me know if you have any concerns about this. Thanks! >

[jira] [Comment Edited] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801 ] Chris Trezzo edited comment on YARN-1492 at 10/2/17 8:50 PM: - [~asuresh]

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801 ] Chris Trezzo commented on YARN-1492: [~asuresh] [~subru] I have set the target version for this jira

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Target Version/s: 2.9.0 (was: 3.1.0) > truly shared cache for jars (jobjar/libjar) >

[jira] [Assigned] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-5727: -- Assignee: (was: Chris Trezzo) > Improve YARN shared cache support for

[jira] [Updated] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5727: --- Issue Type: Sub-task (was: Bug) Parent: YARN-7282 > Improve YARN shared cache support for

[jira] [Updated] (YARN-2781) support more flexible policy for uploading in shared cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2781: --- Issue Type: Sub-task (was: New Feature) Parent: YARN-7282 > support more flexible policy for

[jira] [Updated] (YARN-6097) Add support for directories in the Shared Cache

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6097: --- Issue Type: Sub-task (was: Bug) Parent: YARN-7282 > Add support for directories in the Shared

[jira] [Updated] (YARN-2663) Race condintion in shared cache CleanerTask during deletion of resource

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2663: --- Parent Issue: YARN-7282 (was: YARN-1492) > Race condintion in shared cache CleanerTask during

[jira] [Updated] (YARN-2774) shared cache service should authorize calls properly

2017-10-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2774: --- Parent Issue: YARN-7282 (was: YARN-1492) > shared cache service should authorize calls properly >

[jira] [Created] (YARN-7282) Shared Cache Phase 2

2017-10-02 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7282: -- Summary: Shared Cache Phase 2 Key: YARN-7282 URL: https://issues.apache.org/jira/browse/YARN-7282 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-10-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187584#comment-16187584 ] Chris Trezzo commented on YARN-7001: Also thanks [~Sen Zhao] for the patch! > If shared cache upload

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-10-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187583#comment-16187583 ] Chris Trezzo commented on YARN-7001: Looking at this patch, I am not entirely sure if this fixes the

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183463#comment-16183463 ] Chris Trezzo commented on YARN-7250: Thank you [~vrushalic] for the review! I will wait until tomorrow

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183443#comment-16183443 ] Chris Trezzo commented on YARN-7250: Also to clarify, this is a client side only change. The

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181276#comment-16181276 ] Chris Trezzo commented on YARN-7253: Thanks [~vrushalic]! I will commit later today to trunk and

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-alpha4 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-beta1 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Assigned] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-7253: -- Assignee: Chris Trezzo > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Attachment: YARN-7253-trunk-001.patch Trunk v1 patch attached. > Shared Cache Manager daemon command

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Description: Currently the command to start the shared cache manager daemon is listed as an admin

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Priority: Trivial (was: Minor) > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Created] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7253: -- Summary: Shared Cache Manager daemon command listed as admin subcmd in yarn script Key: YARN-7253 URL: https://issues.apache.org/jira/browse/YARN-7253 Project: Hadoop

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179819#comment-16179819 ] Chris Trezzo commented on YARN-7250: The TestNMClient failure is happening on trunk as well, and is

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Description: We should make the SharedCacheClient use api more consistent with other YARN api

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Attachment: YARN-7250-trunk-001.patch Attached v1 patch. > Update Shared cache client api to use URLs

[jira] [Created] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7250: -- Summary: Update Shared cache client api to use URLs Key: YARN-7250 URL: https://issues.apache.org/jira/browse/YARN-7250 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-07-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081151#comment-16081151 ] Chris Trezzo commented on YARN-1492: bq. Could you explain how the shared cache leverage the node

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961163#comment-15961163 ] Chris Trezzo commented on YARN-5797: Thanks everyone for the reviews and [~mingma] for the commit! >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957929#comment-15957929 ] Chris Trezzo commented on YARN-5797: Branch-2 test failures are unrelated. From my perspective the

[jira] [Comment Edited] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957794#comment-15957794 ] Chris Trezzo edited comment on YARN-5797 at 4/5/17 9:43 PM: Also attached is a

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-branch-2.001.patch Also attached is a v1 branch-2 patch. The only conflict was

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk.003.patch Attached is a v3 patch that is rebased on trunk. > Add metrics

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-05 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957380#comment-15957380 ] Chris Trezzo commented on YARN-6004: Thanks [~mingma]! > Refactor

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956103#comment-15956103 ] Chris Trezzo commented on YARN-6004: These unit tests fail locally on branch-2 without the patch. As

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956049#comment-15956049 ] Chris Trezzo commented on YARN-5797: As soon as the patch for YARN-6004 is in, I will rebase for trunk

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-branch-2.001.patch Thanks [~mingma]! Attached is a branch-2 v1 patch. Note that

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955930#comment-15955930 ] Chris Trezzo commented on YARN-1492: Hi [~jhung], thanks for the question! bq. will this feature save

[jira] [Commented] (YARN-2960) Add documentation for the YARN shared cache

2017-04-04 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1597#comment-1597 ] Chris Trezzo commented on YARN-2960: Circling back and taking a look at this now. > Add documentation

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-03-29 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948062#comment-15948062 ] Chris Trezzo commented on YARN-5797: Patch is now available for YARN-6004 as well. Thanks! > Add

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-29 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-trunk.002.patch Attached is v2 for trunk to address checkstyle issues. >

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-trunk.001.patch Attached is a v1 patch for trunk. This patch breaks the

[jira] [Assigned] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2017-03-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-6004: -- Assignee: Chris Trezzo (was: luhuichun) > Refactor

[jira] [Assigned] (YARN-2960) Add documentation for the YARN shared cache

2017-03-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-2960: -- Assignee: Chris Trezzo > Add documentation for the YARN shared cache >

[jira] [Commented] (YARN-6117) SharedCacheManager does not start up

2017-01-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838853#comment-15838853 ] Chris Trezzo commented on YARN-6117: Thanks [~sjlee0] for the review and commit! > SharedCacheManager

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838851#comment-15838851 ] Chris Trezzo commented on YARN-3637: Thanks [~sjlee0] for the commit/review and thanks [~templedf] for

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838708#comment-15838708 ] Chris Trezzo commented on YARN-3637: I would say trunk and branch-2 are sufficient. Thanks [~sjlee0]!

[jira] [Commented] (YARN-6117) SharedCacheManager does not start up

2017-01-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836777#comment-15836777 ] Chris Trezzo commented on YARN-6117: branch-2.7 might make sense as well, since this is in the 2.7.x

[jira] [Commented] (YARN-6117) SharedCacheManager does not start up

2017-01-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836482#comment-15836482 ] Chris Trezzo commented on YARN-6117: Thanks [~sjlee0]! I think it would be good to backport to branch-2

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Attachment: YARN-3637-trunk.003.patch Thanks [~sjlee0]! Attached is a v3 patch that updates use so

[jira] [Comment Edited] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832580#comment-15832580 ] Chris Trezzo edited comment on YARN-3637 at 1/21/17 12:08 AM: -- -It might be

[jira] [Comment Edited] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832580#comment-15832580 ] Chris Trezzo edited comment on YARN-3637 at 1/21/17 12:07 AM: -- -It might be

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832580#comment-15832580 ] Chris Trezzo commented on YARN-3637: bq. It might be better to overload the use() method instead of

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2017-01-19 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830957#comment-15830957 ] Chris Trezzo commented on YARN-5797: Bump for a review/commit. Thanks! > Add metrics to the node

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-18 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Attachment: YARN-3637-trunk.002.patch Thanks [~templedf] for the review! Attached is a v2 patch

[jira] [Created] (YARN-6097) Add support for directories in the Shared Cache

2017-01-13 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-6097: -- Summary: Add support for directories in the Shared Cache Key: YARN-6097 URL: https://issues.apache.org/jira/browse/YARN-6097 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-11 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Attachment: YARN-3637-trunk.001.patch Attached is a v01 patch for handling symlink names and fragments

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749064#comment-15749064 ] Chris Trezzo commented on YARN-5797: Jira filed: YARN-6004 > Add metrics to the node manager for

[jira] [Created] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2016-12-14 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-6004: -- Summary: Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines Key: YARN-6004 URL:

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749056#comment-15749056 ] Chris Trezzo commented on YARN-5797: The checkstyle warning is because the

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk.002.patch Attaching v2 to fix checkstyle issues. Once I get a +1 for the

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-11-02 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630595#comment-15630595 ] Chris Trezzo commented on YARN-5797: Note that the patch exposes the following metrics about the cache

[jira] [Comment Edited] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-10-31 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624305#comment-15624305 ] Chris Trezzo edited comment on YARN-5797 at 11/1/16 4:27 AM: - Attaching v1

[jira] [Updated] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-10-31 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5797: --- Attachment: YARN-5797-trunk-v1.patch Attaching v1 patch to get a qa run. Summary: # Added metrics

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-28 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Release Note: This issue fixes a bug in how resources are evicted from the PUBLIC and PRIVATE yarn

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-28 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615991#comment-15615991 ] Chris Trezzo commented on YARN-5767: I have filed a followup jira for the metrics: YARN-5797 > Fix the

[jira] [Created] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-10-28 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-5797: -- Summary: Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches Key: YARN-5797 URL: https://issues.apache.org/jira/browse/YARN-5797 Project: Hadoop

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-28 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Release Note: This issue fixes a bug in how resources were evicted from the PUBLIC and PRIVATE yarn

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-28 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615974#comment-15615974 ] Chris Trezzo commented on YARN-5767: Thanks [~jlowe]! I will add release notes to the issue as well. >

[jira] [Updated] (YARN-4950) configure parallel-tests for yarn-client and yarn-server-resourcemanager

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4950: --- Labels: oct16-hard (was: oct16-easy) > configure parallel-tests for yarn-client and

[jira] [Commented] (YARN-5027) NM should clean up app log dirs after NM restart

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613303#comment-15613303 ] Chris Trezzo commented on YARN-5027: bq. The exists check is on the root log dir, not the app log dirs.

[jira] [Comment Edited] (YARN-5027) NM should clean up app log dirs after NM restart

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613251#comment-15613251 ] Chris Trezzo edited comment on YARN-5027 at 10/27/16 9:28 PM: -- Does the

[jira] [Comment Edited] (YARN-5027) NM should clean up app log dirs after NM restart

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613251#comment-15613251 ] Chris Trezzo edited comment on YARN-5027 at 10/27/16 9:20 PM: -- Does the

[jira] [Commented] (YARN-5027) NM should clean up app log dirs after NM restart

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613251#comment-15613251 ] Chris Trezzo commented on YARN-5027: Does the current patch have the potential to leak

[jira] [Updated] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5258: --- Labels: oct-16-easy (was: ) > Document Use of Docker with LinuxContainerExecutor >

[jira] [Updated] (YARN-4950) configure parallel-tests for yarn-client and yarn-server-resourcemanager

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4950: --- Labels: oct-16-easy (was: ) > configure parallel-tests for yarn-client and

[jira] [Updated] (YARN-4948) Support node labels store in zookeeper

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4948: --- Labels: oct16-hard (was: ) > Support node labels store in zookeeper >

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4907: --- Component/s: resourcemanager > Make all MockRM#waitForState consistent. >

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4907: --- Labels: oct16-medium (was: ) > Make all MockRM#waitForState consistent. >

[jira] [Updated] (YARN-4900) SLS MRAMSimulator should include scheduledMappers/Reducers when re-request failed tasks

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4900: --- Labels: oct16-medium (was: ) > SLS MRAMSimulator should include scheduledMappers/Reducers when

[jira] [Updated] (YARN-4900) SLS MRAMSimulator should include scheduledMappers/Reducers when re-request failed tasks

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4900: --- Component/s: scheduler-load-simulator > SLS MRAMSimulator should include scheduledMappers/Reducers

[jira] [Updated] (YARN-4899) Queue metrics of SLS capacity scheduler only activated after app submit to the queue

2016-10-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-4899: --- Labels: oct16-medium (was: ) Component/s: capacity scheduler > Queue metrics of SLS capacity

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610147#comment-15610147 ] Chris Trezzo commented on YARN-5767: Two notes: # Instead of removing

[jira] [Updated] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-5767: --- Attachment: YARN-5767-trunk-v4.patch Attached is a v4 patch for trunk addressing all comments from the

  1   2   3   >