This is an automated email from the ASF dual-hosted git repository. lhaiesp pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git
commit 4ad502f67470c74c98be0c8f9a884a05ade28483 Merge: f2b10e0 a58125b Author: Hai Lu <[email protected]> AuthorDate: Sat Nov 21 17:02:50 2020 -0800 SAMZA-2601: avoid infinite loop when resource not allocated with host affinity disabled (#1441) Problem: If YARN does not immediately allocate resources for a container and host affinity is disabled for the job, then the container allocator will spam the logs with messages about the request, even if the request is considered expired. This is because the allocator loops over the pending requests to check if they have been allocated, but there is no delay between loop iterations, so it might just keep checking the same pending request over and over as fast as possible. A metric is [...] Changes: Avoid infinite loop by breaking the loop if host affinity is disabled Tests: new unit test API changes: N/A Usage instructions: N/A Upgrade instructions: None .../samza/clustermanager/ContainerAllocator.java | 9 +++- .../MockContainerAllocatorWithoutHostAffinity.java | 41 +++++++++++++++++ .../TestContainerAllocatorWithoutHostAffinity.java | 53 ++++++++++++++++++++++ 3 files changed, 102 insertions(+), 1 deletion(-)
