[
https://issues.apache.org/jira/browse/YARN-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-2814.
Resolution: Not A Problem
I believe most of the items I called out had been fixed over
Karthik Kambatla created YARN-7057:
--
Summary: FSAppAttempt#getResourceUsage doesn't need to considered
resources queued for preemption
Key: YARN-7057
URL: https://issues.apache.org/jira/browse/YARN-7057
Karthik Kambatla created YARN-7049:
--
Summary: FSAppAttempt fields tracking containers/resources queued
for preemption can use better names
Key: YARN-7049
URL: https://issues.apache.org/jira/browse/YARN-7049
[
https://issues.apache.org/jira/browse/YARN-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-6590.
Resolution: Invalid
[~wuchang1989], in the future, please reach out on our user mailing list
Karthik Kambatla created YARN-6582:
--
Summary: FSAppAttempt demand can be updated atomically in
updateDemand()
Key: YARN-6582
URL: https://issues.apache.org/jira/browse/YARN-6582
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-6448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-6448.
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
Just committed
Karthik Kambatla created YARN-6246:
--
Summary: Move app starvation identification out of the update
thread
Key: YARN-6246
URL: https://issues.apache.org/jira/browse/YARN-6246
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-6230.
Resolution: Duplicate
YARN-6231 duplicates this issue, but we have made more progress there.
Karthik Kambatla created YARN-6210:
--
Summary: FS: Node reservations can interfere with preemption
Key: YARN-6210
URL: https://issues.apache.org/jira/browse/YARN-6210
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-6038.
Resolution: Duplicate
This is a duplicate of YARN-5832.
> Check other resource requests if
Karthik Kambatla created YARN-6194:
--
Summary: Cluster capacity in SchedulingPolicy is updated only on
allocation file reload
Key: YARN-6194
URL: https://issues.apache.org/jira/browse/YARN-6194
Karthik Kambatla created YARN-6193:
--
Summary: DominantResourceFairnessPolicy#checkIfUsageOverFairShare
considers all resources instead of just dominant resource
Key: YARN-6193
URL:
[
https://issues.apache.org/jira/browse/YARN-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4067.
Resolution: Duplicate
YARN-3933 is addressing the same issue.
> available resource could
[
https://issues.apache.org/jira/browse/YARN-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4045.
Resolution: Duplicate
Looks like this is a duplicate of YARN-3933.
> Negative avaialbleMB
Karthik Kambatla created YARN-6163:
--
Summary: FS Preemption is a trickle for severely starved
applications
Key: YARN-6163
URL: https://issues.apache.org/jira/browse/YARN-6163
Project: Hadoop YARN
Karthik Kambatla created YARN-6076:
--
Summary: Backport YARN-4752 (FS preemption changes) to branch-2
Key: YARN-6076
URL: https://issues.apache.org/jira/browse/YARN-6076
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-6021.
Resolution: Not A Problem
I am closing this as "Not a Problem". Please reopen it if this is
Karthik Kambatla created YARN-5990:
--
Summary: [Umbrella] Follow-up (phase-2) FairScheduler preemption
improvements
Key: YARN-5990
URL: https://issues.apache.org/jira/browse/YARN-5990
Project: Hadoop
Karthik Kambatla created YARN-5893:
--
Summary: Experiment with using PriorityQueue for storing starved
applications
Key: YARN-5893
URL: https://issues.apache.org/jira/browse/YARN-5893
Project: Hadoop
Components: fairscheduler
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
JIRA to track changes necessary for branch merge. These include:
# Remove names from TODOs (e.g. KK) and add JIRA numbers for follow-up work.
# Fix tests that have been commented out
Karthik Kambatla created YARN-5863:
--
Summary: Record that an application is starved for resources when
it is
Key: YARN-5863
URL: https://issues.apache.org/jira/browse/YARN-5863
Project: Hadoop YARN
Karthik Kambatla created YARN-5832:
--
Summary: Preemption should consider multiple resource-requests of
a starved app as needed
Key: YARN-5832
URL: https://issues.apache.org/jira/browse/YARN-5832
Karthik Kambatla created YARN-5831:
--
Summary: Propagate allowPreemptionFrom flag all the way down to
the app
Key: YARN-5831
URL: https://issues.apache.org/jira/browse/YARN-5831
Project: Hadoop YARN
Karthik Kambatla created YARN-5830:
--
Summary: Avoid preempting AM containers
Key: YARN-5830
URL: https://issues.apache.org/jira/browse/YARN-5830
Project: Hadoop YARN
Issue Type: Sub-task
Karthik Kambatla created YARN-5829:
--
Summary: FS preemption should reserve a node before considering
containers on it for preemption
Key: YARN-5829
URL: https://issues.apache.org/jira/browse/YARN-5829
Karthik Kambatla created YARN-5824:
--
Summary: Verify app starvation under custom preemption thresholds
and timeouts
Key: YARN-5824
URL: https://issues.apache.org/jira/browse/YARN-5824
Project:
Karthik Kambatla created YARN-5821:
--
Summary: Drop left-over preemption-related code and clean up
method visibilities in the Schedulable hierarchy
Key: YARN-5821
URL:
YARN
Issue Type: Sub-task
Components: fairscheduler
Affects Versions: 2.9.0
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
JIRA to track the unit test(s) for tracking preemption between applications in
the same queue. Note that this can only
Karthik Kambatla created YARN-5798:
--
Summary: Handle FSPreemptionThread crashing due to a
RuntimeException
Key: YARN-5798
URL: https://issues.apache.org/jira/browse/YARN-5798
Project: Hadoop YARN
Issue Type: Sub-task
Components: fairscheduler
Affects Versions: 2.8.0
Reporter: Karthik Kambatla
Assignee: Karthik Kambatla
JIRA to track unit tests to verify the identification of starved applications.
An application should be marked starved only
Karthik Kambatla created YARN-5709:
--
Summary: Cleanup Curator-based leader election code
Key: YARN-5709
URL: https://issues.apache.org/jira/browse/YARN-5709
Project: Hadoop YARN
Issue Type:
Karthik Kambatla created YARN-5625:
--
Summary: FairScheduler should use FSContext more aggressively to
avoid constructors with many parameters
Key: YARN-5625
URL: https://issues.apache.org/jira/browse/YARN-5625
Karthik Kambatla created YARN-5607:
--
Summary: Document
TestContainerResourceUsage#waitForContainerCompletion
Key: YARN-5607
URL: https://issues.apache.org/jira/browse/YARN-5607
Project: Hadoop YARN
Karthik Kambatla created YARN-5605:
--
Summary: Preempt containers (all on one node) to meet the
requirement of starved applications
Key: YARN-5605
URL: https://issues.apache.org/jira/browse/YARN-5605
[
https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-3997.
Resolution: Duplicate
> An Application requesting multiple core containers can't preempt
[
https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-2457.
Resolution: Duplicate
> FairScheduler: Handle preemption to help starved parent queues
>
Karthik Kambatla created YARN-5380:
--
Summary: NMTimelinePublisher should use getMemorySize instead of
getMemory
Key: YARN-5380
URL: https://issues.apache.org/jira/browse/YARN-5380
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-5371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-5371.
Resolution: Duplicate
> FairScheduer ContinuousScheduling thread throws Exception
>
Karthik Kambatla created YARN-5308:
--
Summary: FairScheduler: Move continuous scheduling related threads
to TestContinuousScheduling
Key: YARN-5308
URL: https://issues.apache.org/jira/browse/YARN-5308
Karthik Kambatla created YARN-5184:
--
Summary: Fix up incompatible changes introduced in YARN-2882
Key: YARN-5184
URL: https://issues.apache.org/jira/browse/YARN-5184
Project: Hadoop YARN
Karthik Kambatla created YARN-5182:
--
Summary: MockNodes.newNodes creates one more node per rack than
requested
Key: YARN-5182
URL: https://issues.apache.org/jira/browse/YARN-5182
Project: Hadoop
Karthik Kambatla created YARN-5181:
--
Summary: ClusterNodeTracker: add method to get list of nodes
matching a specific resourceName
Key: YARN-5181
URL: https://issues.apache.org/jira/browse/YARN-5181
Karthik Kambatla created YARN-5106:
--
Summary: Provide a builder interface for FairScheduler allocations
for use in tests
Key: YARN-5106
URL: https://issues.apache.org/jira/browse/YARN-5106
Project:
Karthik Kambatla created YARN-5035:
--
Summary: FairScheduler: Adjust maxAssign dynamically when
assignMultiple is turned on
Key: YARN-5035
URL: https://issues.apache.org/jira/browse/YARN-5035
Karthik Kambatla created YARN-5030:
--
Summary: Revisit o.a.h.y.s.rm.scheduler.ResourceUsage
Key: YARN-5030
URL: https://issues.apache.org/jira/browse/YARN-5030
Project: Hadoop YARN
Issue
Karthik Kambatla created YARN-5028:
--
Summary: RMStateStore should trim down app state for completed
applications
Key: YARN-5028
URL: https://issues.apache.org/jira/browse/YARN-5028
Project: Hadoop
Karthik Kambatla created YARN-4927:
--
Summary: TestRMHA#testTransitionedToActiveRefreshFail fails when
FairScheduler is the default
Key: YARN-4927
URL: https://issues.apache.org/jira/browse/YARN-4927
Karthik Kambatla created YARN-4885:
--
Summary: Aggregate container utilization can be negative
Key: YARN-4885
URL: https://issues.apache.org/jira/browse/YARN-4885
Project: Hadoop YARN
Issue
Karthik Kambatla created YARN-4866:
--
Summary: FairScheduler: AMs can consume all vcores leading to a
livelock when using FAIR policy
Key: YARN-4866
URL: https://issues.apache.org/jira/browse/YARN-4866
[
https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-2048.
Resolution: Duplicate
> List all of the containers of an application from the yarn web
>
Karthik Kambatla created YARN-4812:
--
Summary: TestFairScheduler#testContinuousScheduling fails
intermittently
Key: YARN-4812
URL: https://issues.apache.org/jira/browse/YARN-4812
Project: Hadoop YARN
Karthik Kambatla created YARN-4809:
--
Summary: De-duplicate container completion across schedulers
Key: YARN-4809
URL: https://issues.apache.org/jira/browse/YARN-4809
Project: Hadoop YARN
Karthik Kambatla created YARN-4808:
--
Summary: SchedulerNode can use a few more cosmetic changes
Key: YARN-4808
URL: https://issues.apache.org/jira/browse/YARN-4808
Project: Hadoop YARN
Karthik Kambatla created YARN-4807:
--
Summary: MockAM#waitForState sleep duration is too long
Key: YARN-4807
URL: https://issues.apache.org/jira/browse/YARN-4807
Project: Hadoop YARN
Issue
Karthik Kambatla created YARN-4806:
--
Summary: Don't run TestZKRMStateStorePerf as part of the regular
unittests
Key: YARN-4806
URL: https://issues.apache.org/jira/browse/YARN-4806
Project: Hadoop
Karthik Kambatla created YARN-4805:
--
Summary: Don't through all schedulers in ParameterizedTestBase
Key: YARN-4805
URL: https://issues.apache.org/jira/browse/YARN-4805
Project: Hadoop YARN
Karthik Kambatla created YARN-4804:
--
Summary: [Umbrella] Improve test run duration
Key: YARN-4804
URL: https://issues.apache.org/jira/browse/YARN-4804
Project: Hadoop YARN
Issue Type:
[
https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-1961.
Resolution: Won't Fix
Closing this as "Won't Fix". Please reopen if there is a good reason
[
https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-3414.
Resolution: Duplicate
> FairScheduler's preemption may cause livelock
>
[
https://issues.apache.org/jira/browse/YARN-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-1772.
Resolution: Not A Problem
> Fair Scheduler documentation should indicate that admin ACLs
[
https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4134.
Resolution: Duplicate
[~xinxianyin] - thanks for reporting and working on this. As you say,
Karthik Kambatla created YARN-4752:
--
Summary: [Umbrella] FairScheduler: Improve preemption
Key: YARN-4752
URL: https://issues.apache.org/jira/browse/YARN-4752
Project: Hadoop YARN
Issue
[
https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4718.
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
Thanks for picking
Karthik Kambatla created YARN-4732:
--
Summary: *ProcessTree classes have too many whitespace issues
Key: YARN-4732
URL: https://issues.apache.org/jira/browse/YARN-4732
Project: Hadoop YARN
Karthik Kambatla created YARN-4729:
--
Summary: SchedulerApplicationAttempt#getTotalRequiredResources can
throw an NPE
Key: YARN-4729
URL: https://issues.apache.org/jira/browse/YARN-4729
Project:
Karthik Kambatla created YARN-4719:
--
Summary: Add a helper library to maintain node state and allows
common queries
Key: YARN-4719
URL: https://issues.apache.org/jira/browse/YARN-4719
Project:
Karthik Kambatla created YARN-4718:
--
Summary: Rename variables in SchedulerNode to reduce ambiguity
post YARN-1011
Key: YARN-4718
URL: https://issues.apache.org/jira/browse/YARN-4718
Project: Hadoop
Karthik Kambatla created YARN-4702:
--
Summary: FairScheduler: Allow setting maxResources for ad hoc
queues
Key: YARN-4702
URL: https://issues.apache.org/jira/browse/YARN-4702
Project: Hadoop YARN
Karthik Kambatla created YARN-4689:
--
Summary: FairScheduler: Cleanup preemptContainer to be more
readable
Key: YARN-4689
URL: https://issues.apache.org/jira/browse/YARN-4689
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4679.
Resolution: Duplicate
Closing this as a duplicate of YARN-2567.
> When work-preserving
Karthik Kambatla created YARN-4647:
--
Summary: RegisterNodeManagerRequestPBImpl needs more
synchronization
Key: YARN-4647
URL: https://issues.apache.org/jira/browse/YARN-4647
Project: Hadoop YARN
Karthik Kambatla created YARN-4648:
--
Summary: Move preemption related tests from TestFairScheduler to
TestFairSchedulerPreemption
Key: YARN-4648
URL: https://issues.apache.org/jira/browse/YARN-4648
Karthik Kambatla created YARN-4599:
--
Summary: Set OOM control for memory cgroups
Key: YARN-4599
URL: https://issues.apache.org/jira/browse/YARN-4599
Project: Hadoop YARN
Issue Type: Bug
[
https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4032.
Resolution: Duplicate
YARN-4347 should fix this issue. Closing this as a duplicate.
>
Karthik Kambatla created YARN-4551:
--
Summary: Address the duplication between StatusUpdateWhenHealthy
and StatusUpdateWhenUnhealthy transitions
Key: YARN-4551
URL: https://issues.apache.org/jira/browse/YARN-4551
Karthik Kambatla created YARN-4526:
--
Summary: Make SystemClock singleton so AppSchedulingInfo could use
it
Key: YARN-4526
URL: https://issues.apache.org/jira/browse/YARN-4526
Project: Hadoop YARN
Karthik Kambatla created YARN-4524:
--
Summary: Cleanup AppSchedulingInfo
Key: YARN-4524
URL: https://issues.apache.org/jira/browse/YARN-4524
Project: Hadoop YARN
Issue Type: Bug
Karthik Kambatla created YARN-4512:
--
Summary: Provide a knob to turn on over-subscription
Key: YARN-4512
URL: https://issues.apache.org/jira/browse/YARN-4512
Project: Hadoop YARN
Issue
Karthik Kambatla created YARN-4509:
--
Summary: Promote containers from OPPORTUNISTIC to GUARANTEED
Key: YARN-4509
URL: https://issues.apache.org/jira/browse/YARN-4509
Project: Hadoop YARN
Karthik Kambatla created YARN-4486:
--
Summary: Add requestTime to ResourceRequest
Key: YARN-4486
URL: https://issues.apache.org/jira/browse/YARN-4486
Project: Hadoop YARN
Issue Type:
Karthik Kambatla created YARN-4487:
--
Summary: FairScheduler: Compute per-container allocation latency
and roll up to get per-application and per-queue
Key: YARN-4487
URL:
Karthik Kambatla created YARN-4485:
--
Summary: Capture per-application and per-queue container
allocation latency
Key: YARN-4485
URL: https://issues.apache.org/jira/browse/YARN-4485
Project: Hadoop
Karthik Kambatla created YARN-4488:
--
Summary: CapacityScheduler: Compute per-container allocation
latency and roll up to get per-application and per-queue
Key: YARN-4488
URL:
[
https://issues.apache.org/jira/browse/YARN-4407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-4407.
Resolution: Duplicate
> Support Resource oversubscription in YARN scheduler
>
[
https://issues.apache.org/jira/browse/YARN-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-3501.
Resolution: Incomplete
Closing this JIRA for lack of information.
> problem in running
[
https://issues.apache.org/jira/browse/YARN-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-2062.
Resolution: Invalid
> Too many InvalidStateTransitionExceptions from NodeState.NEW on RM
Karthik Kambatla created YARN-4125:
--
Summary: In addition to aggregate availability for an app,
headroom should provide information on largest container that can be allcoated
Key: YARN-4125
URL:
Karthik Kambatla created YARN-3991:
--
Summary: Investigate if we need an atomic way to set both memory
and CPU on Resource
Key: YARN-3991
URL: https://issues.apache.org/jira/browse/YARN-3991
Project:
[
https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-2768.
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.8.0
Just committed to
Karthik Kambatla created YARN-3839:
--
Summary: Quit throwing NMNotYetReadyException
Key: YARN-3839
URL: https://issues.apache.org/jira/browse/YARN-3839
Project: Hadoop YARN
Issue Type: Bug
Karthik Kambatla created YARN-3811:
--
Summary: NM restarts could lead to app failures
Key: YARN-3811
URL: https://issues.apache.org/jira/browse/YARN-3811
Project: Hadoop YARN
Issue Type: Bug
Karthik Kambatla created YARN-3793:
--
Summary: Several NPEs when deleting local files on NM recovery
Key: YARN-3793
URL: https://issues.apache.org/jira/browse/YARN-3793
Project: Hadoop YARN
Karthik Kambatla created YARN-3774:
--
Summary: ZKRMStateStore should use Curator 3.0 and avail CuratorOp
Key: YARN-3774
URL: https://issues.apache.org/jira/browse/YARN-3774
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-38.
--
Resolution: Won't Fix
Now that we have work-preserving RM/NM restarts, rolling restarts/upgrades
Karthik Kambatla created YARN-3762:
--
Summary: FairScheduler: CME on FSParentQueue#getQueueUserAclInfo
Key: YARN-3762
URL: https://issues.apache.org/jira/browse/YARN-3762
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-3613.
Resolution: Fixed
Fix Version/s: 2.8.0
Hadoop Flags: Reviewed
Thanks for working
Karthik Kambatla created YARN-3613:
--
Summary: TestContainerManagerSecurity should init and start Yarn
cluster in setup instead of individual methods
Key: YARN-3613
URL:
Karthik Kambatla created YARN-3607:
--
Summary: Allow users to choose between failing the daemons vs
failing the apps/containers
Key: YARN-3607
URL: https://issues.apache.org/jira/browse/YARN-3607
Karthik Kambatla created YARN-3610:
--
Summary: FairScheduler: Add steady-fair-shares to the REST API
documentation
Key: YARN-3610
URL: https://issues.apache.org/jira/browse/YARN-3610
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla resolved YARN-3485.
Resolution: Fixed
Fix Version/s: 2.7.1
Hadoop Flags: Reviewed
Committed to
1 - 100 of 246 matches
Mail list logo
