Chris Riccomini created SAMZA-74:
------------------------------------
Summary: Use anti-affinity in YARN container requests
Key: SAMZA-74
URL: https://issues.apache.org/jira/browse/SAMZA-74
Project: Samza
Issue Type: Wish
Components: yarn
Affects Versions: 0.6.0
Reporter: Chris Riccomini
Samza's YARN containers are currently allocated according to whatever default
strategy the YARN RM uses. Sometimes, we get all of our containers allocated to
a single NM, even when many NMs have available resources.
YARN is in the process of getting an anti-affinity feature (YARN-1042). When
this is implemented, we should consider using it to prevent all the containers
from ending up on a single host.
NOTE: This anti-affinity feature might conflict with a
colocate-processor-with-data feature, if we were trying to colocate stream
processors near their data.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
