Re: [openstack-dev] [savanna] Anti-affinity
No, anti-affinity does not work that way. It allows to distribute nodes running the same process, but you can't separate nodes running different processes (i.e. master and workers). Dmitry 2013/12/5 Arindam Choudhury > Hi, > > Is it possible using anti-affinity to reserve a compute node only for > master(namenode+jobtracker)? > > Regards, > Arindam > > -- > From: arin...@live.com > To: openstack-dev@lists.openstack.org > Date: Thu, 5 Dec 2013 12:52:23 +0100 > > Subject: Re: [openstack-dev] [savanna] Anti-affinity > > Hi, > > Thanks a lot for your reply. > > Regards, > > Arindam > > -- > Date: Thu, 5 Dec 2013 15:41:33 +0400 > From: dmescherya...@mirantis.com > To: openstack-dev@lists.openstack.org > Subject: Re: [openstack-dev] [savanna] Anti-affinity > > Arindam, > > It is not achievable with the current Savanna. The anti-affinity feature > allows to run one VM per compute-node only. It can not evenly distribute > VMs in case the number of compute nodes is lower than the desired size of > Hadoop cluster. > > Dmitry > > > 2013/12/5 Arindam Choudhury > > HI, > > I have 11 compute nodes. I want to create a hadoop cluster with 1 > master(namenode+jobtracker) with 20 worker (datanode+tasktracker). > > How to configure the Anti-affinty so I can run the master in one host, > while others will be hosting two worker? > > I tried some configuration, but I can not achieve it. > > Regards, > Arindam > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > > > ___ OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [savanna] Anti-affinity
Hi, Is it possible using anti-affinity to reserve a compute node only for master(namenode+jobtracker)? Regards, Arindam From: arin...@live.com To: openstack-dev@lists.openstack.org Date: Thu, 5 Dec 2013 12:52:23 +0100 Subject: Re: [openstack-dev] [savanna] Anti-affinity Hi, Thanks a lot for your reply. Regards, Arindam Date: Thu, 5 Dec 2013 15:41:33 +0400 From: dmescherya...@mirantis.com To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [savanna] Anti-affinity Arindam, It is not achievable with the current Savanna. The anti-affinity feature allows to run one VM per compute-node only. It can not evenly distribute VMs in case the number of compute nodes is lower than the desired size of Hadoop cluster. Dmitry 2013/12/5 Arindam Choudhury HI, I have 11 compute nodes. I want to create a hadoop cluster with 1 master(namenode+jobtracker) with 20 worker (datanode+tasktracker). How to configure the Anti-affinty so I can run the master in one host, while others will be hosting two worker? I tried some configuration, but I can not achieve it. Regards, Arindam ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [savanna] Anti-affinity
Hi, Thanks a lot for your reply. Regards, Arindam Date: Thu, 5 Dec 2013 15:41:33 +0400 From: dmescherya...@mirantis.com To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [savanna] Anti-affinity Arindam, It is not achievable with the current Savanna. The anti-affinity feature allows to run one VM per compute-node only. It can not evenly distribute VMs in case the number of compute nodes is lower than the desired size of Hadoop cluster. Dmitry 2013/12/5 Arindam Choudhury HI, I have 11 compute nodes. I want to create a hadoop cluster with 1 master(namenode+jobtracker) with 20 worker (datanode+tasktracker). How to configure the Anti-affinty so I can run the master in one host, while others will be hosting two worker? I tried some configuration, but I can not achieve it. Regards, Arindam ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [savanna] Anti-affinity
Arindam, What exact AA configurations did you use for your cluster? Did you configure scheduler filters in Nova as it’s described here? http://docs.openstack.org/developer/savanna/userdoc/features.html#anti-affinity Also please send Savanna usage related questions to [openstack] openst...@lists.openstack.org not to openstack-dev. Regards, Alexander Ignatov On 05 Dec 2013, at 15:30, Arindam Choudhury wrote: > HI, > > I have 11 compute nodes. I want to create a hadoop cluster with 1 > master(namenode+jobtracker) with 20 worker (datanode+tasktracker). > > How to configure the Anti-affinty so I can run the master in one host, while > others will be hosting two worker? > > I tried some configuration, but I can not achieve it. > > Regards, > Arindam > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [savanna] Anti-affinity
Arindam, It is not achievable with the current Savanna. The anti-affinity feature allows to run one VM per compute-node only. It can not evenly distribute VMs in case the number of compute nodes is lower than the desired size of Hadoop cluster. Dmitry 2013/12/5 Arindam Choudhury > HI, > > I have 11 compute nodes. I want to create a hadoop cluster with 1 > master(namenode+jobtracker) with 20 worker (datanode+tasktracker). > > How to configure the Anti-affinty so I can run the master in one host, > while others will be hosting two worker? > > I tried some configuration, but I can not achieve it. > > Regards, > Arindam > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [savanna] Anti-affinity
HI, I have 11 compute nodes. I want to create a hadoop cluster with 1 master(namenode+jobtracker) with 20 worker (datanode+tasktracker). How to configure the Anti-affinty so I can run the master in one host, while others will be hosting two worker? I tried some configuration, but I can not achieve it. Regards, Arindam ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev