[
https://issues.apache.org/jira/browse/YARN-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7131:
-
Description:
Currently, there are naive string checks to determine if a resource is of a
particular type (
[
https://issues.apache.org/jira/browse/YARN-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7131:
-
Description:
Currently, there are naive string checks to determine if a resource of a
particular type (jar
[
https://issues.apache.org/jira/browse/YARN-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7131:
-
Component/s: nodemanager
> FSDownload.unpack should read determine the type of resource by reading the
> h
Brook Zhou created YARN-7131:
Summary: FSDownload.unpack should read determine the type of
resource by reading the header bytes
Key: YARN-7131
URL: https://issues.apache.org/jira/browse/YARN-7131
Project:
[
https://issues.apache.org/jira/browse/YARN-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7098:
-
Attachment: YARN-7098.patch
> LocalizerRunner should immediately send heartbeat response
> LocalizerStatus
[
https://issues.apache.org/jira/browse/YARN-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7098:
-
Description:
Currently, the following can happen:
1. ContainerLocalizer heartbeats to ResourceLocalization
[
https://issues.apache.org/jira/browse/YARN-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7098:
-
Description:
Currently, the following can happen:
1. ContainerLocalizer heartbeats to ResourceLocalization
[
https://issues.apache.org/jira/browse/YARN-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-7098:
-
Description:
Currently, the following can happen:
1. ContainerLocalizer heartbeats to ResourceLocalization
Brook Zhou created YARN-7098:
Summary: LocalizerRunner should immediately send heartbeat
response LocalizerStatus.DIE when the Container transitions from LOCALIZING to
KILLING
Key: YARN-7098
URL: https://issues.apach
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105798#comment-16105798
]
Brook Zhou commented on YARN-6870:
--
Findbugs warnings are from existing code not in this p
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-6870:
-
Attachment: YARN-6870-v3.patch
> ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization a
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-6870:
-
Attachment: YARN-6870-v2.patch
Thanks, made the change.
> ResourceUtilization/ContainersMonitorImpl is cal
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-6870:
-
Attachment: YARN-6870-v1.patch
> ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization a
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-6870:
-
Attachment: YARN-6870-v0.patch
Attached patch against trunk.
> ResourceUtilization/ContainersMonitorImpl i
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102135#comment-16102135
]
Brook Zhou edited comment on YARN-6870 at 7/26/17 10:07 PM:
[~a
[
https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102135#comment-16102135
]
Brook Zhou commented on YARN-6870:
--
[~asuresh] Sure. For the scope of this patch, I want t
Brook Zhou created YARN-6870:
Summary: ResourceUtilization/ContainersMonitorImpl is calculating
CPU utilization as a float, which is imprecise
Key: YARN-6870
URL: https://issues.apache.org/jira/browse/YARN-6870
[
https://issues.apache.org/jira/browse/YARN-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412694#comment-15412694
]
Brook Zhou commented on YARN-5472:
--
Yes, this is something I have verified on our NM's run
[
https://issues.apache.org/jira/browse/YARN-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-5472:
-
Attachment: YARN-5472-v0.patch
> WIN_MAX_PATH logic is off by one
>
>
>
[
https://issues.apache.org/jira/browse/YARN-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-5472:
-
Description:
The following check is incorrect in DefaultContainerExecutor:
if (Shell.WINDOWS && sb.get
[
https://issues.apache.org/jira/browse/YARN-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-5472:
-
Affects Version/s: 2.6.0
> WIN_MAX_PATH logic is off by one
>
>
>
[
https://issues.apache.org/jira/browse/YARN-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-5472:
-
Description:
The following check is incorrect in DefaultContainerExecutor:
if (Shell.WINDOWS && sb.get
Brook Zhou created YARN-5472:
Summary: WIN_MAX_PATH logic is off by one
Key: YARN-5472
URL: https://issues.apache.org/jira/browse/YARN-5472
Project: Hadoop YARN
Issue Type: Bug
Componen
[
https://issues.apache.org/jira/browse/YARN-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405060#comment-15405060
]
Brook Zhou commented on YARN-5451:
--
Is this because the ContainerLocalizer is launched in
Brook Zhou created YARN-4840:
Summary: Add option to upload files recursively from container
directory
Key: YARN-4840
URL: https://issues.apache.org/jira/browse/YARN-4840
Project: Hadoop YARN
Is
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196359#comment-15196359
]
Brook Zhou commented on YARN-4818:
--
You're right, it was some issue with our FileSystem im
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou resolved YARN-4818.
--
Resolution: Invalid
> AggregatedLogFormat.LogValue.write() incorrectly truncates files
>
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4818:
-
Component/s: nodemanager
> AggregatedLogFormat.LogValue.write() incorrectly truncates files
> -
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4818:
-
Labels: log-aggregation (was: )
> AggregatedLogFormat.LogValue.write() incorrectly truncates files
> -
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4818:
-
Attachment: YARN-4818-v0.patch
> AggregatedLogFormat.LogValue.write() incorrectly truncates files
> ---
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4818:
-
Summary: AggregatedLogFormat.LogValue.write() incorrectly truncates files
(was: AggregatedLogFormat.LogVal
[
https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4818:
-
Description: AggregatedLogFormat.LogValue.write() currently has a bug where
it only writes in blocks of the
Brook Zhou created YARN-4818:
Summary: AggregatedLogFormat.LogValue writes only in blocks of
buffer size
Key: YARN-4818
URL: https://issues.apache.org/jira/browse/YARN-4818
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4677:
-
Issue Type: Sub-task (was: Improvement)
Parent: YARN-914
> RMNodeResourceUpdateEvent update from s
[
https://issues.apache.org/jira/browse/YARN-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157240#comment-15157240
]
Brook Zhou commented on YARN-4677:
--
Hi [~djp], I currently have no plan, would appreciate
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157237#comment-15157237
]
Brook Zhou commented on YARN-3223:
--
Thanks [~djp] for the kind reviews and followups.
> R
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15142170#comment-15142170
]
Brook Zhou commented on YARN-3223:
--
Hi [~djp], can you please review?
> Resource update d
Brook Zhou created YARN-4677:
Summary: RMNodeResourceUpdateEvent update from scheduler can lead
to race condition
Key: YARN-4677
URL: https://issues.apache.org/jira/browse/YARN-4677
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v5.patch
Fixed the checkstyle errors.
> Resource update during NM graceful decommiss
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v4.patch)
> Resource update during NM graceful decommission
> -
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v4.patch
> Resource update during NM graceful decommission
>
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v4.patch
> Resource update during NM graceful decommission
>
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v4.patch)
> Resource update during NM graceful decommission
> -
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v4.patch
> Resource update during NM graceful decommission
>
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v4.patch)
> Resource update during NM graceful decommission
> -
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v4.patch
Latest patch with the same scheduler code applied to Fifo/Fair Schedulers an
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113307#comment-15113307
]
Brook Zhou commented on YARN-3223:
--
Spoke offline with Junping, we will move forward with
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088097#comment-15088097
]
Brook Zhou commented on YARN-3223:
--
Thanks [~djp] for the feedback.
Those scenarios ment
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061124#comment-15061124
]
Brook Zhou commented on YARN-3223:
--
Test breaks unrelated.
> Resource update during NM gr
[
https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038392#comment-15038392
]
Brook Zhou commented on YARN-4002:
--
If this is currently not being worked on, I will assig
[
https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-4002:
-
Attachment: YARN-4002-v0.patch
Added a patch for this.
> make ResourceTrackerService.nodeHeartbeat more co
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v3.patch
> Resource update during NM graceful decommission
>
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: 0001-YARN-3223-resource-update.patch)
> Resource update during NM graceful decommissi
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: 0001-YARN-3223-resource-update.patch
Since completedContainer is often called multiple times li
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15018487#comment-15018487
]
Brook Zhou commented on YARN-3223:
--
Makes sense.
One thing that I'm not sure about - RMN
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992234#comment-14992234
]
Brook Zhou commented on YARN-3223:
--
Unit tests that failed were not affected by patch. May
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v2.patch
Updated patch based on feedback. Checkstyle errors about CapacityScheduler.j
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14978999#comment-14978999
]
Brook Zhou commented on YARN-3223:
--
Thanks [~leftnoteasy], [~djp] for review.
bq. Sugges
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v1.patch
Fixed the whitespace/checkstyle issues.
The only remaining checkstyle issue
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949223#comment-14949223
]
Brook Zhou commented on YARN-3223:
--
Ah okay, sorry about that, will do.
It seems to be p
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v0.patch
I changed the implementation to add a flag to NodeUpdateSchedulerEvent
indi
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v1.patch)
> Resource update during NM graceful decommission
> -
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741678#comment-14741678
]
Brook Zhou commented on YARN-3223:
--
Applied YARN-3212-v5.1.patch first.
With the YARN-322
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v1.patch
> Resource update during NM graceful decommission
>
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v0.1.patch)
> Resource update during NM graceful decommission
> ---
[
https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou reassigned YARN-666:
---
Assignee: Brook Zhou
> [Umbrella] Support rolling upgrades in YARN
> --
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v0.patch)
> Resource update during NM graceful decommission
> -
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v0.1.patch
> Resource update during NM graceful decommission
> --
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: (was: YARN-3223-v0.1.patch)
> Resource update during NM graceful decommission
> ---
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v0.1.patch
Contains tests, formatting changes
> Resource update during NM graceful d
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brook Zhou updated YARN-3223:
-
Attachment: YARN-3223-v0.patch
Just a patch for review.
> Resource update during NM graceful decommission
[
https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640845#comment-14640845
]
Brook Zhou commented on YARN-3223:
--
Hi, I'm interested in whether this is still active. If
72 matches
Mail list logo
