On Jan 19, 2012, at 6:03 PM, Joe Gordon wrote: > Hi Jorge, > > I have two questions: > > 1) Has anyone optimized nova to work in a HPC environment like you describe? > Such as an intelligent scheduler that will generate VMs that consume x > percent of a physical machines resources (so you don't end up with one > machine with two separate Hadoop instances competing for resources)? >
I don't know about that. It will be a great feature! > 2) Why not use something like > http://en.wikipedia.org/wiki/TORQUE_Resource_Manager or > http://hadoop.apache.org/common/docs/r0.16.4/hod.html? > I'm new with infrastructure for processing applications and I really didn't know these frameworks. Very interesting. But, the hadoop example is just one of our uses. There are another ones that not necessarily use HPC environment. So, the private cloud will be a easy way to provide infrastructure. And, there are others that use clusters but aren't map and reduce tasks, not using hadoop. > best, > Joe Gordon > > > On Thu, Jan 19, 2012 at 10:49 AM, Jorge Luiz Correa <corre...@gmail.com> > wrote: > Hum, I'm just studying and understanding the ccgroups to try this with > libvirt and kvm (all nodes are linux here). > > My case is a test that can be very useful for us. We have about 150 computers > spread over the LAN. These computers are desktops and notebook underutilized. > So, our test scenario is not an isolated datacenter, what I think is the > ideal scenario for private clouds. > > We need to run some simulations that requires, most of the time, a lot of > processor nodes with not so much memory (for example, to run Hadoop). Once > the computers have 8 GB or 16 GB and are used to run office applications, > they are idle. We think to attach them to the cloud (a controller of a > private cloud) and use these idle resources. But, we want to ensure > nova-compute not interfere in computers' usability (in this case we can > define what is considered usability, like 2 cores and 4 GB of memory). These > idle resources over the LAN can be VERY useful, and are cheap (they have > already been purchased)! > > And, we have a laboratory with 20 good hosts that is used along some periods > of time. At the lab we can use all the hosts resources when it isn't being > used. > > This is our test scenario. > > Regards. > > :) > > > On Thu, Jan 19, 2012 at 4:00 PM, Christian Berendt <bere...@b1-systems.de> > wrote: > Hi Jorge. > > > I would like to know if it's possible to configure quota in each > > nova-compute node. For example, I set up a new hardware with 8 GB of memory > > and install the nova-compute, but I wish only 4 GB of memory are used > > (dedicated to nova-compute). Is it possible? If so, how can I configure > > that? > > I can't remember such a function at the moment, but it's relative simple > to implement such a feature (at least for Linux systems) using cgroups. > > Can you please describe your use case. At the moment I can't follow > where I should use the feature. Why should I install nova-compute on a > bare metal system with 32 GByte memory and only use 16 GByte memory? > > Bye, Christian. > > -- > Christian Berendt > Linux / Unix Consultant & Developer > Mail: bere...@b1-systems.de > > B1 Systems GmbH > Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de > GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537 > > > _______________________________________________ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > > > > > -- > - MSc. Correa, J.L. > > > _______________________________________________ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > >
_______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
