Matthew Ho created GOBBLIN-1728:
-----------------------------------
Summary: Yarn Service requests too many containers due to improper
calculation
Key: GOBBLIN-1728
URL: https://issues.apache.org/jira/browse/GOBBLIN-1728
Project: Apache Gobblin
Issue Type: New Feature
Reporter: Matthew Ho
Yarn Service is responsible for calculating the number of instances based on
the helix tasks. Yarn service tracks the number of instances by asking Yarn for
the number of resource requests and the number of allocated containers.
It uses this count to determine if it should ask for more containers or shrink
the number of containers. This calculation is currently done improperly and we
continue to request containers when we have enough requested.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)