[
https://issues.apache.org/jira/browse/TEZ-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517583#comment-16517583
]
Nishant Dash commented on TEZ-3956:
-----------------------------------
3rd run
> testTaskSchedulerPreemption test fails intermittently
> -----------------------------------------------------
>
> Key: TEZ-3956
> URL: https://issues.apache.org/jira/browse/TEZ-3956
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Nishant Dash
> Priority: Major
>
> {code:java}
> Error Message
> Wanted but not invoked:
> tezAMRMClientAsync.releaseAssignedContainer(
> <any>
> );
> -> at
> org.apache.tez.dag.app.rm.TestTaskScheduler.testTaskSchedulerPreemption(TestTaskScheduler.java:1197)
> However, there were other interactions with this mock:
> tezAMRMClientAsync.init(Configuration: );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.initialize(YarnTaskSchedulerService.java:281)
> tezAMRMClientAsync.setHeartbeatInterval(
> 1000
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.initialize(YarnTaskSchedulerService.java:285)
> tezAMRMClientAsync.start();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.start(YarnTaskSchedulerService.java:365)
> tezAMRMClientAsync.registerApplicationMaster(
> "host",
> 0,
> "url"
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.start(YarnTaskSchedulerService.java:366)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getAvailableResources(YarnTaskSchedulerService.java:257)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[2]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[2]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[8]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> Stacktrace
> org.mockito.exceptions.verification.WantedButNotInvoked:
> Wanted but not invoked:
> tezAMRMClientAsync.releaseAssignedContainer(
> <any>
> );
> -> at
> org.apache.tez.dag.app.rm.TestTaskScheduler.testTaskSchedulerPreemption(TestTaskScheduler.java:1197)
> However, there were other interactions with this mock:
> tezAMRMClientAsync.init(Configuration: );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.initialize(YarnTaskSchedulerService.java:281)
> tezAMRMClientAsync.setHeartbeatInterval(
> 1000
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.initialize(YarnTaskSchedulerService.java:285)
> tezAMRMClientAsync.start();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.start(YarnTaskSchedulerService.java:365)
> tezAMRMClientAsync.registerApplicationMaster(
> "host",
> 0,
> "url"
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.start(YarnTaskSchedulerService.java:366)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getAvailableResources(YarnTaskSchedulerService.java:257)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[2]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "host1",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "/default-rack",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[2]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 6,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getMatchingRequests(
> 2,
> "*",
> <memory:1024, vCores:1>
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.getMatchingRequestWithPriority(YarnTaskSchedulerService.java:1453)
> tezAMRMClientAsync.removeContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.removeTaskRequest(YarnTaskSchedulerService.java:1641)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.addContainerRequest(
> Capability[<memory:1024,
> vCores:1>]Priority[8]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}]
> );
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.addTaskRequest(YarnTaskSchedulerService.java:1653)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> tezAMRMClientAsync.getAvailableResources();
> -> at
> org.apache.tez.dag.app.rm.YarnTaskSchedulerService.preemptIfNeeded(YarnTaskSchedulerService.java:1171)
> at
> org.apache.tez.dag.app.rm.TestTaskScheduler.testTaskSchedulerPreemption(TestTaskScheduler.java:1197)
> Standard Output
> 2018-06-19 18:52:30,283 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:initialize(346)) - YarnTaskScheduler
> initialized with configuration: maxRMHeartbeatInterval: 1000,
> containerReuseEnabled: false, reuseRackLocal: true, reuseNonLocal: false,
> localitySchedulingDelay: 250, preemptionPercentage: 10,
> preemptionMaxWaitTime: 60000, numHeartbeatsBetweenPreemptions: 3,
> idleContainerMinTimeout: 5000, idleContainerMaxTimeout: 10000,
> sessionMinHeldContainers: 0
> 2018-06-19 18:52:30,290 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:getProgress(908)) - App total resource memory:
> 4000 cpu: 4 taskAllocations: 0
> 2018-06-19 18:52:30,291 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:preemptIfNeeded(1176)) - Allocated: <memory:0,
> vCores:0> Free: <memory:4000, vCores:4> pendingRequests: 0 delayedContainers:
> 0 heartbeats: 1 lastPreemptionHeartbeat: 0
> 2018-06-19 18:52:30,299 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: task1 with request: Capability[<memory:1024,
> vCores:1>]Priority[2]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,299 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: task3 with request: Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,300 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: task3KillA with request: Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,303 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: task3KillB with request: Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,319 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:doBookKeepingForAssignedContainer(1835)) -
> Assigning container to task: containerId=container_1_0001_01_000001,
> task=task1, containerHost=host1:1, containerPriority= 2,
> containerResources=<memory:1024, vCores:1>, localityMatchType=NonLocal,
> matchedLocation=*, honorLocalityFlags=false, reusedContainer=false,
> delayedContainers=0
> 2018-06-19 18:52:30,320 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:doBookKeepingForAssignedContainer(1835)) -
> Assigning container to task: containerId=container_1_0001_01_000002,
> task=task3, containerHost=host1:1, containerPriority= 6,
> containerResources=<memory:1024, vCores:1>, localityMatchType=NonLocal,
> matchedLocation=*, honorLocalityFlags=false, reusedContainer=false,
> delayedContainers=0
> 2018-06-19 18:52:30,320 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:doBookKeepingForAssignedContainer(1835)) -
> Assigning container to task: containerId=container_1_0001_01_000003,
> task=task3KillA, containerHost=host1:1, containerPriority= 6,
> containerResources=<memory:1024, vCores:1>, localityMatchType=NonLocal,
> matchedLocation=*, honorLocalityFlags=false, reusedContainer=false,
> delayedContainers=0
> 2018-06-19 18:52:30,321 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:doBookKeepingForAssignedContainer(1835)) -
> Assigning container to task: containerId=container_1_0001_01_000004,
> task=task3KillB, containerHost=host1:1, containerPriority= 2,
> containerResources=<memory:1024, vCores:1>, localityMatchType=NonLocal,
> matchedLocation=*, honorLocalityFlags=false, reusedContainer=false,
> delayedContainers=0
> 2018-06-19 18:52:30,327 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: task3Wait with request: Capability[<memory:1024,
> vCores:1>]Priority[6]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,327 INFO [Thread-3] rm.YarnTaskSchedulerService
> (YarnTaskSchedulerService.java:addRequestAndTrigger(1014)) - Allocation
> request for task: taskPri8 with request: Capability[<memory:1024,
> vCores:1>]Priority[8]AllocationRequestId[0]ExecutionTypeRequest[{Execution
> Type: GUARANTEED, Enforce Execution Type: false}] host: null rack: null
> 2018-06-19 18:52:30,331 INFO [DelayedContainerManager]
> rm.YarnTaskSchedulerService (YarnTaskSchedulerService.java:doAssignAll(2097))
> - AssignAll - Skipping delayed container as container is no longer running,
> containerId=container_1_0001_01_000005
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
