Matthew Ho created GOBBLIN-1728:
-----------------------------------

             Summary: Yarn Service requests too many containers due to improper 
calculation
                 Key: GOBBLIN-1728
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1728
             Project: Apache Gobblin
          Issue Type: New Feature
            Reporter: Matthew Ho


Yarn Service is responsible for calculating the number of instances based on 
the helix tasks. Yarn service tracks the number of instances by asking Yarn for 
the number of resource requests and the number of allocated containers.

 

It uses this count to determine if it should ask for more containers or shrink 
the number of containers. This calculation is currently done improperly and we 
continue to request containers when we have enough requested.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to