Hi Guys, After add 3 hosts to yarn cluster, some job can’t startup, then I found some informations as shown below:
2017-07-17 17:37:29.928 [AMRM Callback Handler Thread] YarnClusterResourceManager [INFO] Container allocated from RM on rflow79.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] YarnClusterResourceManager [INFO] Container allocated from RM on rflow6.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] YarnClusterResourceManager [INFO] Container allocated from RM on rflow5.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ContainerProcessManager [INFO] Container allocated from RM on rflow79.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource container_e38_1500040925911_0028_01_000007 in the buffer for ANY_HOST 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ContainerProcessManager [INFO] Container allocated from RM on rflow6.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource container_e38_1500040925911_0028_01_000008 in the buffer for ANY_HOST 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ContainerProcessManager [INFO] Container allocated from RM on rflow5.antfact.com 2017-07-17 17:37:29.929 [AMRM Callback Handler Thread] ResourceRequestState [INFO] Host affinity not enabled. Saving the samzaResource container_e38_1500040925911_0028_01_000010 in the buffer for ANY_HOST What does “Host affinity” mean? Thanks! ———————— Qi Shu