[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Attachment: YARN-5767-trunk-v1.patch
Attached is a v1 patch for trunk.
In this initial patch I
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Attachment: YARN-5767-trunk-v3.patch
V3 attached. Fixed whitespace.
> Fix the order that resources
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Attachment: YARN-5767-trunk-v2.patch
Attaching a v2 patch for trunk. This new version simply fixes
Chris Trezzo created YARN-5767:
--
Summary: Fix the order that resources are cleaned up from the
local Public/Private caches
Key: YARN-5767
URL: https://issues.apache.org/jira/browse/YARN-5767
Project:
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Description:
If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see
that
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Description:
If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see
that
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Affects Version/s: (was: 2.6.5)
(was: 2.7.3)
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5767:
---
Description:
If you look at {{ResourceLocalizationService#handleCacheCleanup}}, you can see
that
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596593#comment-15596593
]
Chris Trezzo commented on YARN-5767:
I see two initial high-level approaches to this problem:
# Add all
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624305#comment-15624305
]
Chris Trezzo edited comment on YARN-5797 at 11/1/16 4:27 AM:
-
Attaching v1
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5797:
---
Attachment: YARN-5797-trunk-v1.patch
Attaching v1 patch to get a qa run. Summary:
# Added metrics
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615974#comment-15615974
]
Chris Trezzo commented on YARN-5767:
Thanks [~jlowe]! I will add release notes to the issue as well.
>
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630595#comment-15630595
]
Chris Trezzo commented on YARN-5797:
Note that the patch exposes the following metrics about the cache
[
https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609674#comment-15609674
]
Chris Trezzo commented on YARN-5767:
Thanks for the reviews [~miklos.szeg...@cloudera.com] and
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5727:
---
Description:
When running LinuxContainerExecutor in a secure mode
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5727:
---
Attachment: YARN-5727-Design-v1.pdf
V1 of a design doc posted. Please let me know your thoughts.
Chris Trezzo created YARN-5727:
--
Summary: Improve YARN shared cache support for
LinuxContainerExecutor
Key: YARN-5727
URL: https://issues.apache.org/jira/browse/YARN-5727
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5797:
---
Attachment: YARN-5797-trunk.002.patch
Attaching v2 to fix checkstyle issues. Once I get a +1 for the
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749064#comment-15749064
]
Chris Trezzo commented on YARN-5797:
Jira filed: YARN-6004
> Add metrics to the node manager for
Chris Trezzo created YARN-6004:
--
Summary: Refactor
TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it
is less than 150 lines
Key: YARN-6004
URL:
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749056#comment-15749056
]
Chris Trezzo commented on YARN-5797:
The checkstyle warning is because the
Chris Trezzo created YARN-6097:
--
Summary: Add support for directories in the Shared Cache
Key: YARN-6097
URL: https://issues.apache.org/jira/browse/YARN-6097
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-3637:
---
Attachment: YARN-3637-trunk.001.patch
Attached is a v01 patch for handling symlink names and fragments
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-6004:
---
Attachment: YARN-6004-trunk.002.patch
Attached is v2 for trunk to address checkstyle issues.
>
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948062#comment-15948062
]
Chris Trezzo commented on YARN-5797:
Patch is now available for YARN-6004 as well. Thanks!
> Add
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo reassigned YARN-6004:
--
Assignee: Chris Trezzo (was: luhuichun)
> Refactor
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-6004:
---
Attachment: YARN-6004-trunk.001.patch
Attached is a v1 patch for trunk. This patch breaks the
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1597#comment-1597
]
Chris Trezzo commented on YARN-2960:
Circling back and taking a look at this now.
> Add documentation
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955930#comment-15955930
]
Chris Trezzo commented on YARN-1492:
Hi [~jhung], thanks for the question!
bq. will this feature save
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-6004:
---
Attachment: YARN-6004-branch-2.001.patch
Thanks [~mingma]! Attached is a branch-2 v1 patch.
Note that
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956049#comment-15956049
]
Chris Trezzo commented on YARN-5797:
As soon as the patch for YARN-6004 is in, I will rebase for trunk
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956103#comment-15956103
]
Chris Trezzo commented on YARN-6004:
These unit tests fail locally on branch-2 without the patch. As
[
https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957380#comment-15957380
]
Chris Trezzo commented on YARN-6004:
Thanks [~mingma]!
> Refactor
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo reassigned YARN-2960:
--
Assignee: Chris Trezzo
> Add documentation for the YARN shared cache
>
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957929#comment-15957929
]
Chris Trezzo commented on YARN-5797:
Branch-2 test failures are unrelated. From my perspective the
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957794#comment-15957794
]
Chris Trezzo edited comment on YARN-5797 at 4/5/17 9:43 PM:
Also attached is a
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5797:
---
Attachment: YARN-5797-trunk.003.patch
Attached is a v3 patch that is rebased on trunk.
> Add metrics
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5797:
---
Attachment: YARN-5797-branch-2.001.patch
Also attached is a v1 branch-2 patch. The only conflict was
[
https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961163#comment-15961163
]
Chris Trezzo commented on YARN-5797:
Thanks everyone for the reviews and [~mingma] for the commit!
>
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081151#comment-16081151
]
Chris Trezzo commented on YARN-1492:
bq. Could you explain how the shared cache leverage the node
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192221#comment-16192221
]
Chris Trezzo commented on YARN-2960:
Thanks [~mingma]! I will commit to trunk, branch-3.0 and branch-2.
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188808#comment-16188808
]
Chris Trezzo commented on YARN-1492:
Please let me know if you have any concerns about this. Thanks!
>
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-1492:
---
Release Note: The YARN Shared Cache provides the facility to upload and
manage shared application
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-1492:
---
Target Version/s: 2.9.0 (was: 3.1.0)
> truly shared cache for jars (jobjar/libjar)
>
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801
]
Chris Trezzo edited comment on YARN-1492 at 10/2/17 8:50 PM:
-
[~asuresh]
[
https://issues.apache.org/jira/browse/YARN-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2663:
---
Parent Issue: YARN-7282 (was: YARN-1492)
> Race condintion in shared cache CleanerTask during
[
https://issues.apache.org/jira/browse/YARN-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2774:
---
Parent Issue: YARN-7282 (was: YARN-1492)
> shared cache service should authorize calls properly
>
[
https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo resolved YARN-1016.
Resolution: Duplicate
Resolving this as a duplicate of YARN-1492. Please let me know if you think
[
https://issues.apache.org/jira/browse/YARN-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-6097:
---
Issue Type: Sub-task (was: Bug)
Parent: YARN-7282
> Add support for directories in the Shared
[
https://issues.apache.org/jira/browse/YARN-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2781:
---
Issue Type: Sub-task (was: New Feature)
Parent: YARN-7282
> support more flexible policy for
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189050#comment-16189050
]
Chris Trezzo commented on YARN-2960:
Patch should be good to go, please let me know if you see any
Chris Trezzo created YARN-7282:
--
Summary: Shared Cache Phase 2
Key: YARN-7282
URL: https://issues.apache.org/jira/browse/YARN-7282
Project: Hadoop YARN
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2960:
---
Attachment: YARN-2960-trunk-001.patch
Trunk v1 attached.
> Add documentation for the YARN shared
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo reassigned YARN-5727:
--
Assignee: (was: Chris Trezzo)
> Improve YARN shared cache support for
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-5727:
---
Issue Type: Sub-task (was: Bug)
Parent: YARN-7282
> Improve YARN shared cache support for
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188801#comment-16188801
]
Chris Trezzo commented on YARN-1492:
[~asuresh] [~subru] I have set the target version for this jira
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2960:
---
Attachment: YARN-2960-trunk-002.patch
Thanks for the review [~mingma]! Attached is a trunk v2 patch to
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193397#comment-16193397
]
Chris Trezzo commented on YARN-2960:
Committed to trunk, branch-3.0, branch-2. Thanks!
> Add
[
https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo resolved YARN-1492.
Resolution: Fixed
Fix Version/s: 3.0.0
2.9.0
I am resolving this issue as
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371
]
Chris Trezzo edited comment on YARN-2960 at 10/5/17 6:19 PM:
-
I unfortunately
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193371#comment-16193371
]
Chris Trezzo commented on YARN-2960:
I unfortunately made a small mistake while cherry-picking the
[
https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179819#comment-16179819
]
Chris Trezzo commented on YARN-7250:
The TestNMClient failure is happening on trunk as well, and is
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181276#comment-16181276
]
Chris Trezzo commented on YARN-7253:
Thanks [~vrushalic]! I will commit later today to trunk and
Chris Trezzo created YARN-7253:
--
Summary: Shared Cache Manager daemon command listed as admin
subcmd in yarn script
Key: YARN-7253
URL: https://issues.apache.org/jira/browse/YARN-7253
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7253:
---
Priority: Trivial (was: Minor)
> Shared Cache Manager daemon command listed as admin subcmd in yarn
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7253:
---
Description:
Currently the command to start the shared cache manager daemon is listed as an
admin
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7253:
---
Affects Version/s: 3.0.0-alpha4
> Shared Cache Manager daemon command listed as admin subcmd in yarn
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7253:
---
Affects Version/s: 3.0.0-beta1
> Shared Cache Manager daemon command listed as admin subcmd in yarn
[
https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187583#comment-16187583
]
Chris Trezzo commented on YARN-7001:
Looking at this patch, I am not entirely sure if this fixes the
[
https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187584#comment-16187584
]
Chris Trezzo commented on YARN-7001:
Also thanks [~Sen Zhao] for the patch!
> If shared cache upload
[
https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183443#comment-16183443
]
Chris Trezzo commented on YARN-7250:
Also to clarify, this is a client side only change. The
[
https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183463#comment-16183463
]
Chris Trezzo commented on YARN-7250:
Thank you [~vrushalic] for the review! I will wait until tomorrow
Chris Trezzo created YARN-7250:
--
Summary: Update Shared cache client api to use URLs
Key: YARN-7250
URL: https://issues.apache.org/jira/browse/YARN-7250
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7250:
---
Attachment: YARN-7250-trunk-001.patch
Attached v1 patch.
> Update Shared cache client api to use URLs
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7253:
---
Attachment: YARN-7253-trunk-001.patch
Trunk v1 patch attached.
> Shared Cache Manager daemon command
[
https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo reassigned YARN-7253:
--
Assignee: Chris Trezzo
> Shared Cache Manager daemon command listed as admin subcmd in yarn
[
https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-7250:
---
Description:
We should make the SharedCacheClient use api more consistent with other YARN
api
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2960:
---
Attachment: YARN-2960-trunk-003.patch
Thanks [~mingma]! Attached is a v3 patch. I put all of the
[
https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo updated YARN-2960:
---
Attachment: YARN-2960-trunk-004.patch
Attached v4 to add italics around parameters in the setup
Chris Trezzo created YARN-7694:
--
Summary: Optionally run shared cache manager as part of the
resource manager
Key: YARN-7694
URL: https://issues.apache.org/jira/browse/YARN-7694
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578701#comment-16578701
]
Chris Trezzo commented on YARN-5727:
As stated above, I no longer think that the v1 design attached is
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Trezzo reassigned YARN-5727:
--
Assignee: zhenzhao wang
> Improve YARN shared cache support for LinuxContainerExecutor
>
[
https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578769#comment-16578769
]
Chris Trezzo commented on YARN-5727:
Assigning to [~wzzdreamer]. He will start working on a new draft
201 - 283 of 283 matches
Mail list logo