Wangda Tan created YARN-1447:
Summary: Common PB types define for container resource change
Key: YARN-1447
URL: https://issues.apache.org/jira/browse/YARN-1447
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-1449:
Summary: Protocol changes in NM side to support change container
resource
Key: YARN-1449
URL: https://issues.apache.org/jira/browse/YARN-1449
Project: Hadoop YARN
Wangda Tan created YARN-1502:
Summary: Protocol changes and implementations in RM side to
support change container resource
Key: YARN-1502
URL: https://issues.apache.org/jira/browse/YARN-1502
Project:
Wangda Tan created YARN-1509:
Summary: Make AMRMClient support send increase container request
and get increased/decreased containers
Key: YARN-1509
URL: https://issues.apache.org/jira/browse/YARN-1509
Wangda Tan created YARN-1510:
Summary: Make NMClient support change container resources
Key: YARN-1510
URL: https://issues.apache.org/jira/browse/YARN-1510
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-1609:
Summary: Add Service Container type to NodeManager in YARN
Key: YARN-1609
URL: https://issues.apache.org/jira/browse/YARN-1609
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-1644:
Summary: [YARN-1197] Add newly decreased container to NodeStatus
in NM side
Key: YARN-1644
URL: https://issues.apache.org/jira/browse/YARN-1644
Project: Hadoop YARN
Wangda Tan created YARN-1643:
Summary: [YARN-1197] Make ContainersMonitor can support change
monitoring size of an allocated container in NM side
Key: YARN-1643
URL: https://issues.apache.org/jira/browse/YARN-1643
Wangda Tan created YARN-1648:
Summary: [YARN-1197] Modify ApplicationMasterService to support
changing container resource
Key: YARN-1648
URL: https://issues.apache.org/jira/browse/YARN-1648
Project:
Wangda Tan created YARN-1651:
Summary: [YARN-1197] Add methods in FiCaSchedulerApp to support
add/reserve/unreserve/allocate/pull change container requests/results
Key: YARN-1651
URL:
Wangda Tan created YARN-1650:
Summary: [YARN-1197] Add pullDecreasedContainer API to RMNode
which can be used by scheduler to get newly decreased Containers
Key: YARN-1650
URL:
Wangda Tan created YARN-1646:
Summary: [YARN-1197] Add increase container request to
YarnScheduler allocate API
Key: YARN-1646
URL: https://issues.apache.org/jira/browse/YARN-1646
Project: Hadoop YARN
Wangda Tan created YARN-1649:
Summary: [YARN-1197] Modify ResourceTrackerService to support
passing decreased containers to RMNode
Key: YARN-1649
URL: https://issues.apache.org/jira/browse/YARN-1649
Wangda Tan created YARN-1647:
Summary: [YARN-1197] Add increased/decreased container to
Allocation
Key: YARN-1647
URL: https://issues.apache.org/jira/browse/YARN-1647
Project: Hadoop YARN
Issue
Wangda Tan created YARN-1654:
Summary: [YARN-1197] Add implementations to CapacityScheduler to
support increase/decrease container resource
Key: YARN-1654
URL: https://issues.apache.org/jira/browse/YARN-1654
Wangda Tan created YARN-1652:
Summary: [YARN-1197] Add methods in FiCaSchedulerNode to support
increase/decrease/reserve/unreserve change container requests/results
Key: YARN-1652
URL:
Wangda Tan created YARN-1655:
Summary: [YARN-1197] Add implementations to FairScheduler to
support increase/decrease container resource
Key: YARN-1655
URL: https://issues.apache.org/jira/browse/YARN-1655
Wangda Tan created YARN-1653:
Summary: [YARN-1197] Add APIs in CSQueue to support decrease
container resource and unreserve increase request
Key: YARN-1653
URL: https://issues.apache.org/jira/browse/YARN-1653
Wangda Tan created YARN-1871:
Summary: We should eliminate writing *PBImpl code in YARN
Key: YARN-1871
URL: https://issues.apache.org/jira/browse/YARN-1871
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-1917:
Summary: Add waitForCompletion interface to YarnClient
Key: YARN-1917
URL: https://issues.apache.org/jira/browse/YARN-1917
Project: Hadoop YARN
Issue Type: New
Wangda Tan created YARN-1927:
Summary: Preemption message shouldn’t be created multiple times
for same container-id in ProportionalCapacityPreemptionPolicy
Key: YARN-1927
URL:
Wangda Tan created YARN-2104:
Summary: Scheduler queue filter failed to work because index of
queue column changed
Key: YARN-2104
URL: https://issues.apache.org/jira/browse/YARN-2104
Project: Hadoop YARN
Wangda Tan created YARN-2124:
Summary: ProportionalCapacityPreemptionPolicy cannot work because
it's initialized before scheduler initialized
Key: YARN-2124
URL: https://issues.apache.org/jira/browse/YARN-2124
Wangda Tan created YARN-2125:
Summary: ProportionalCapacityPreemptionPolicy should only log CSV
when debug enabled
Key: YARN-2125
URL: https://issues.apache.org/jira/browse/YARN-2125
Project: Hadoop YARN
Wangda Tan created YARN-2143:
Summary: Merge common killContainer logic of Fair/Capacity
scheduler into AbstractYarnScheduler
Key: YARN-2143
URL: https://issues.apache.org/jira/browse/YARN-2143
Project:
Wangda Tan created YARN-2148:
Summary: TestNMClient failed due more exit code values added and
passed to AM
Key: YARN-2148
URL: https://issues.apache.org/jira/browse/YARN-2148
Project: Hadoop YARN
Wangda Tan created YARN-2149:
Summary: Test failed in TestRMAdminCLI
Key: YARN-2149
URL: https://issues.apache.org/jira/browse/YARN-2149
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-2149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-2149.
--
Resolution: Duplicate
Assignee: Wangda Tan
Test failed in TestRMAdminCLI
Wangda Tan created YARN-2181:
Summary: Add preemption info to RM Web UI
Key: YARN-2181
URL: https://issues.apache.org/jira/browse/YARN-2181
Project: Hadoop YARN
Issue Type: Bug
Wangda Tan created YARN-2191:
Summary: Add a test to make sure NM will do application cleanup
even if RM restarting happens before application completed
Key: YARN-2191
URL:
Wangda Tan created YARN-2271:
Summary: Add application attempt metrics to RM Web UI/service when
AppAttempt page available
Key: YARN-2271
URL: https://issues.apache.org/jira/browse/YARN-2271
Project:
[
https://issues.apache.org/jira/browse/YARN-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-2258.
--
Resolution: Duplicate
Assignee: Wangda Tan
Aggregation of MR job logs failing when
Wangda Tan created YARN-2308:
Summary: NPE happened when RM restart after CapacityScheduler
queue configuration changed
Key: YARN-2308
URL: https://issues.apache.org/jira/browse/YARN-2308
Project:
Wangda Tan created YARN-2492:
Summary: [Umbrella] Allow for (admin) labels on nodes and
resource-requests
Key: YARN-2492
URL: https://issues.apache.org/jira/browse/YARN-2492
Project: Hadoop YARN
Wangda Tan created YARN-2493:
Summary: [YARN-796] API changes for users
Key: YARN-2493
URL: https://issues.apache.org/jira/browse/YARN-2493
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-2494:
Summary: [YARN-796] Node label manager API and storage
implementations
Key: YARN-2494
URL: https://issues.apache.org/jira/browse/YARN-2494
Project: Hadoop YARN
Wangda Tan created YARN-2497:
Summary: [YARN-796] Changes for fair scheduler to support allocate
resource respect labels
Key: YARN-2497
URL: https://issues.apache.org/jira/browse/YARN-2497
Project:
Wangda Tan created YARN-2500:
Summary: [YARN-796] Miscellaneous changes in ResourceManager to
support labels
Key: YARN-2500
URL: https://issues.apache.org/jira/browse/YARN-2500
Project: Hadoop YARN
Wangda Tan created YARN-2499:
Summary: [YARN-796] Respect labels in preemption policy of fair
scheduler
Key: YARN-2499
URL: https://issues.apache.org/jira/browse/YARN-2499
Project: Hadoop YARN
Wangda Tan created YARN-2503:
Summary: [YARN-796] Changes in RM Web UI to better show labels to
end users
Key: YARN-2503
URL: https://issues.apache.org/jira/browse/YARN-2503
Project: Hadoop YARN
Wangda Tan created YARN-2504:
Summary: [YARN-796] Support get/add/remove/change labels in RM
admin CLI
Key: YARN-2504
URL: https://issues.apache.org/jira/browse/YARN-2504
Project: Hadoop YARN
Wangda Tan created YARN-2505:
Summary: [YARN-796] Support get/add/remove/change labels in RM
REST API
Key: YARN-2505
URL: https://issues.apache.org/jira/browse/YARN-2505
Project: Hadoop YARN
Wangda Tan created YARN-2544:
Summary: [YARN-796] Common server side PB changes (not include
user API PB changes)
Key: YARN-2544
URL: https://issues.apache.org/jira/browse/YARN-2544
Project: Hadoop YARN
Wangda Tan created YARN-2637:
Summary: maximum-am-resource-percent will be violated when
resource of AM is minimumAllocation
Key: YARN-2637
URL: https://issues.apache.org/jira/browse/YARN-2637
Project:
Wangda Tan created YARN-2647:
Summary: [YARN-796] Add yarn queue CLI to get queue info including
labels of such queue
Key: YARN-2647
URL: https://issues.apache.org/jira/browse/YARN-2647
Project: Hadoop
Wangda Tan created YARN-2665:
Summary: Audit warning of registry project
Key: YARN-2665
URL: https://issues.apache.org/jira/browse/YARN-2665
Project: Hadoop YARN
Issue Type: Bug
Wangda Tan created YARN-2685:
Summary: Resource on each label not correct when multiple NMs in a
same host and some has label some not
Key: YARN-2685
URL: https://issues.apache.org/jira/browse/YARN-2685
Wangda Tan created YARN-2694:
Summary: Ensure only single node labels specified in resource
request, and node label expression only specified when resourceName=ANY
Key: YARN-2694
URL:
Wangda Tan created YARN-2695:
Summary: Support continuously looking reserved container with node
labels
Key: YARN-2695
URL: https://issues.apache.org/jira/browse/YARN-2695
Project: Hadoop YARN
Wangda Tan created YARN-2698:
Summary: Move getClusterNodeLabels and getNodeToLabels to YARN CLI
instead of RMAdminCLI
Key: YARN-2698
URL: https://issues.apache.org/jira/browse/YARN-2698
Project: Hadoop
Wangda Tan created YARN-2699:
Summary: Fix test timeout in
TestResourceTrackerOnHA#testResourceTrackerOnHA
Key: YARN-2699
URL: https://issues.apache.org/jira/browse/YARN-2699
Project: Hadoop YARN
Wangda Tan created YARN-2705:
Summary: Changes of RM node label manager configuration
Key: YARN-2705
URL: https://issues.apache.org/jira/browse/YARN-2705
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-2710:
Summary: RM HA tests failed intermittently on trunk
Key: YARN-2710
URL: https://issues.apache.org/jira/browse/YARN-2710
Project: Hadoop YARN
Issue Type: Bug
Wangda Tan created YARN-2740:
Summary: RM AdminService should prevent admin change labels on
nodes when distributed node label configuration enabled
Key: YARN-2740
URL: https://issues.apache.org/jira/browse/YARN-2740
Wangda Tan created YARN-2778:
Summary: YARN node CLI should display labels on returned node
reports
Key: YARN-2778
URL: https://issues.apache.org/jira/browse/YARN-2778
Project: Hadoop YARN
Wangda Tan created YARN-2786:
Summary: Create yarn node-labels CLI to enable list node labels
collection and node labels mapping
Key: YARN-2786
URL: https://issues.apache.org/jira/browse/YARN-2786
Wangda Tan created YARN-2800:
Summary: Should print WARN log in both RM/RMAdminCLI side when
MemoryRMNodeLabelsManager is enabled
Key: YARN-2800
URL: https://issues.apache.org/jira/browse/YARN-2800
Wangda Tan created YARN-2807:
Summary: Option --forceactive not works as described in usage of
yarn rmadmin -transitionToActive
Key: YARN-2807
URL: https://issues.apache.org/jira/browse/YARN-2807
Wangda Tan created YARN-2824:
Summary: Capacity of labels should be zero by default
Key: YARN-2824
URL: https://issues.apache.org/jira/browse/YARN-2824
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-2827:
Summary: Fix bugs of yarn queue CLI
Key: YARN-2827
URL: https://issues.apache.org/jira/browse/YARN-2827
Project: Hadoop YARN
Issue Type: Bug
Components:
Wangda Tan created YARN-2866:
Summary: Capacity scheduler preemption policy should respect
yarn.scheduler.minimum-allocation-mb when computing resource of queues
Key: YARN-2866
URL:
Wangda Tan created YARN-2869:
Summary: CapacityScheduler should trim sub queue names when parse
configuration
Key: YARN-2869
URL: https://issues.apache.org/jira/browse/YARN-2869
Project: Hadoop YARN
Wangda Tan created YARN-2880:
Summary: Add a test in TestRMRestart to make sure node labels will
be recovered if it is enabled
Key: YARN-2880
URL: https://issues.apache.org/jira/browse/YARN-2880
Project:
Wangda Tan created YARN-2895:
Summary: Integrate distributed scheduling with capacity scheduler
Key: YARN-2895
URL: https://issues.apache.org/jira/browse/YARN-2895
Project: Hadoop YARN
Issue
Wangda Tan created YARN-2920:
Summary: CapacityScheduler should be notified when labels on nodes
changed
Key: YARN-2920
URL: https://issues.apache.org/jira/browse/YARN-2920
Project: Hadoop YARN
Wangda Tan created YARN-2925:
Summary: Internal fields in LeafQueue access should be protected
when accessed from FiCaSchedulerApp to calculate Headroom
Key: YARN-2925
URL:
Wangda Tan created YARN-2933:
Summary: Capacity Scheduler preemption policy should only consider
capacity without labels temporarily
Key: YARN-2933
URL: https://issues.apache.org/jira/browse/YARN-2933
Wangda Tan created YARN-2943:
Summary: Add a node-labels page in RM web UI
Key: YARN-2943
URL: https://issues.apache.org/jira/browse/YARN-2943
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-3098:
Summary: Create common QueueCapacities class in Capacity Scheduler
to track capacities-by-labels of queues
Key: YARN-3098
URL: https://issues.apache.org/jira/browse/YARN-3098
Wangda Tan created YARN-3099:
Summary: Capacity Scheduler LeafQueue/ParentQueue should use
ResourceUsage to track resources-by-label.
Key: YARN-3099
URL: https://issues.apache.org/jira/browse/YARN-3099
Wangda Tan created YARN-3142:
Summary: Improve locks in AppSchedulingInfo
Key: YARN-3142
URL: https://issues.apache.org/jira/browse/YARN-3142
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-3139:
Summary: Improve locks in
AbstractYarnScheduler/CapacityScheduler/FairScheduler
Key: YARN-3139
URL: https://issues.apache.org/jira/browse/YARN-3139
Project: Hadoop YARN
Wangda Tan created YARN-3124:
Summary: Capacity Scheduler LeafQueue/ParentQueue should use
QueueCapacities to track capacities-by-label
Key: YARN-3124
URL: https://issues.apache.org/jira/browse/YARN-3124
[
https://issues.apache.org/jira/browse/YARN-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-281.
-
Resolution: Won't Fix
Release Note:
I think this may not need since we already have tests in
Wangda Tan created YARN-3153:
Summary: Capacity Scheduler max AM resource percentage is mis-used
as ratio
Key: YARN-3153
URL: https://issues.apache.org/jira/browse/YARN-3153
Project: Hadoop YARN
Wangda Tan created YARN-3132:
Summary: RMNodeLabelsManager should remove node from node-to-label
mapping when node becomes deactivated
Key: YARN-3132
URL: https://issues.apache.org/jira/browse/YARN-3132
Wangda Tan created YARN-3213:
Summary: Respect labels in Capacity Scheduler when computing
user-limit
Key: YARN-3213
URL: https://issues.apache.org/jira/browse/YARN-3213
Project: Hadoop YARN
Wangda Tan created YARN-3233:
Summary: Implement scheduler common configuration parser and
create abstraction layer in CapacityScheduler to support plain/hierarchy
configuration.
Key: YARN-3233
URL:
Wangda Tan created YARN-3214:
Summary: Adding non-exclusive node labels
Key: YARN-3214
URL: https://issues.apache.org/jira/browse/YARN-3214
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-3216:
Summary: Max-AM-Resource-Percentage should respect node labels
Key: YARN-3216
URL: https://issues.apache.org/jira/browse/YARN-3216
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-3026:
Summary: Move application-specific container allocation logic from
LeafQueue to FiCaSchedulerApp
Key: YARN-3026
URL: https://issues.apache.org/jira/browse/YARN-3026
Project:
Wangda Tan created YARN-3016:
Summary: (Refactoring) Merge internalAdd/Remove/ReplaceLabels to
one method in CommonNodeLabelsManager
Key: YARN-3016
URL: https://issues.apache.org/jira/browse/YARN-3016
Wangda Tan created YARN-3014:
Summary: Changing labels on a host should update all NM's labels
on that host
Key: YARN-3014
URL: https://issues.apache.org/jira/browse/YARN-3014
Project: Hadoop YARN
Wangda Tan created YARN-3234:
Summary: Add changes in CapacityScheduler to use the abstracted
configuration layer
Key: YARN-3234
URL: https://issues.apache.org/jira/browse/YARN-3234
Project: Hadoop YARN
Wangda Tan created YARN-3235:
Summary: Support uniformed scheduler configuration in FairScheduler
Key: YARN-3235
URL: https://issues.apache.org/jira/browse/YARN-3235
Project: Hadoop YARN
Issue
Wangda Tan created YARN-3354:
Summary: Container should contains node-labels asked by original
ResourceRequests
Key: YARN-3354
URL: https://issues.apache.org/jira/browse/YARN-3354
Project: Hadoop YARN
Wangda Tan created YARN-3356:
Summary: Capacity Scheduler LeafQueue.User/FiCaSchedulerApp should
use ResourceUsage to track used-resources-by-label.
Key: YARN-3356
URL: https://issues.apache.org/jira/browse/YARN-3356
Wangda Tan created YARN-3361:
Summary: CapacityScheduler side changes to support non-exclusive
node labels
Key: YARN-3361
URL: https://issues.apache.org/jira/browse/YARN-3361
Project: Hadoop YARN
Wangda Tan created YARN-3362:
Summary: Add node label usage in RM CapacityScheduler web UI
Key: YARN-3362
URL: https://issues.apache.org/jira/browse/YARN-3362
Project: Hadoop YARN
Issue Type:
Wangda Tan created YARN-3383:
Summary: AdminService should use warn instead of info to log
exception when operation fails
Key: YARN-3383
URL: https://issues.apache.org/jira/browse/YARN-3383
Project:
Wangda Tan created YARN-3298:
Summary: User-limit should be enforced in CapacityScheduler
Key: YARN-3298
URL: https://issues.apache.org/jira/browse/YARN-3298
Project: Hadoop YARN
Issue Type: Bug
Wangda Tan created YARN-3340:
Summary: Mark setters to be @Public for
ApplicationId/ApplicationAttemptId/ContainerId.
Key: YARN-3340
URL: https://issues.apache.org/jira/browse/YARN-3340
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-3346.
--
Resolution: Implemented
Fix Version/s: 2.6.1
2.7.0
This issue is already
Wangda Tan created YARN-3345:
Summary: Add non-exclusive node label RMAdmin CLI/API
Key: YARN-3345
URL: https://issues.apache.org/jira/browse/YARN-3345
Project: Hadoop YARN
Issue Type: Sub-task
Wangda Tan created YARN-3279:
Summary: AvailableResource of QueueMetrics should consider queue's
current-max-limit
Key: YARN-3279
URL: https://issues.apache.org/jira/browse/YARN-3279
Project: Hadoop YARN
Wangda Tan created YARN-3277:
Summary: Queue's current-max-limit should be updated before
allocate reserved container.
Key: YARN-3277
URL: https://issues.apache.org/jira/browse/YARN-3277
Project: Hadoop
Wangda Tan created YARN-3243:
Summary: CapacityScheduler should pass headroom from parent to
children to make sure ParentQueue obey its capacity limits.
Key: YARN-3243
URL:
[
https://issues.apache.org/jira/browse/YARN-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-3003.
--
Resolution: Duplicate
[~varun_saxena],
Thanks for reminding, I just reopen and then resolved as
Wangda Tan created YARN-3265:
Summary: CapacityScheduler deadlock when computing absolute max
avail capacity (fix for trunk/branch-2)
Key: YARN-3265
URL: https://issues.apache.org/jira/browse/YARN-3265
[
https://issues.apache.org/jira/browse/YARN-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan resolved YARN-3251.
--
Resolution: Fixed
Fix Version/s: 2.6.1
Hadoop Flags: Reviewed
Just compiled and ran all
1 - 100 of 381 matches
Mail list logo
