Re: [Lxc-users] Using lxc on production
I am trying to use lxc in product environment， but i can not limit the guest's network bandwidth. I followed the list instructions, but it does take effect. How do you limit the guest's network bandwidth? # tc qdisc add dev virbr0 root handle 10: htb # tc filter add dev virbr0 parent 10: protocol ip prio 10 handle 1: cgroup # tc class add dev virbr0 parent 10: classid 10:1 htb rate 24Mbit # echo 0x11 /cgroup/c/net_cls.classid 在 2012-10-24 00:38:47，Stéphane Graber stgra...@ubuntu.com 写道： On 10/23/2012 12:29 AM, Ulli Horlacher wrote: On Mon 2012-10-22 (14:53), Stéphane Graber wrote: All in all, that's somewhere around 300-400 containers I'm managing How do you handle a host (hardware) failure? Everything that runs in the container is in a configuration management system, so any container can be redeployed from scratch in just a couple of minutes without needing the actual rootfs. On top of that, all the containers are backed up centrally using data deduplication, so if I really need it, I can extract a .tar.gz of the rootfs of any container in minutes and then just dump that on another machine. Though technically all the critical services are already redundant, so in case of a host failure, all I'd see is an increase of load on the other servers while I fix the host and get the rest back online. -- Stéphane Graber Ubuntu developer http://www.ubuntu.com -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
Re: [Lxc-users] Using lxc on production
On 10/23/2012 12:29 AM, Ulli Horlacher wrote: On Mon 2012-10-22 (14:53), Stéphane Graber wrote: All in all, that's somewhere around 300-400 containers I'm managing How do you handle a host (hardware) failure? Everything that runs in the container is in a configuration management system, so any container can be redeployed from scratch in just a couple of minutes without needing the actual rootfs. On top of that, all the containers are backed up centrally using data deduplication, so if I really need it, I can extract a .tar.gz of the rootfs of any container in minutes and then just dump that on another machine. Though technically all the critical services are already redundant, so in case of a host failure, all I'd see is an increase of load on the other servers while I fix the host and get the rest back online. -- Stéphane Graber Ubuntu developer http://www.ubuntu.com signature.asc Description: OpenPGP digital signature -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
[Lxc-users] Using lxc on production
I've been trying out lxc for a week now, and it seems there are a lot of issues if the host system is centos and things work fine while using ubuntu as the host. any way, right now I don't think lxc seems to be fit to run on production boxes. I was wondering if anyone is using lxc on production. and if you don't mind disclosing, for what purpose do you use it on production? cheers, swair -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
Re: [Lxc-users] Using lxc on production
On 10/22/2012 02:39 PM, swair shah wrote: I've been trying out lxc for a week now, and it seems there are a lot of issues if the host system is centos and things work fine while using ubuntu as the host. any way, right now I don't think lxc seems to be fit to run on production boxes. I was wondering if anyone is using lxc on production. and if you don't mind disclosing, for what purpose do you use it on production? cheers, swair I use LXC in production for all my server services (web hosting, dns servers, internal dhcp, directory services, ...) and for the Edubuntu WebLive VDI service (hundred of desktop installations running under LXC). All in all, that's somewhere around 300-400 containers I'm managing in production, without any problem so far. This is all running on Ubuntu 12.04 LTS with apparmor on both host and containers. Using apparmor fixes all the security concerns that have been highlighted so far with containers and Ubuntu ships the latest upstream LXC and has a container-aware userspace that doesn't require any kind of hack to work in containers. You mention you're using Centos, I'd suggest that's really your problem as nobody is working on LXC on Centos so the distribution probably wasn't made container aware, we don't actually have a maintained template for it and it's likely that some other bits of LXC plain don't work because nobody tested it on centos. We recently got some contributions for LXC support on Oracle Linux which as far as I know is pretty close to RHEL6/CentOS, so maybe that work will lead to a better experience on CentOS, but that may take some time. -- Stéphane Graber Ubuntu developer http://www.ubuntu.com signature.asc Description: OpenPGP digital signature -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
Re: [Lxc-users] Using lxc on production
On Mon, Oct 22, 2012 at 6:48 PM, Michael H. Warfield m...@wittsend.comwrote: On Mon, 2012-10-22 at 18:09 +0530, swair shah wrote: I've been trying out lxc for a week now, and it seems there are a lot of issues if the host system is centos and things work fine while using ubuntu as the host. any way, right now I don't think lxc seems to be fit to run on production boxes. I was wondering if anyone is using lxc on production. and if you don't mind disclosing, for what purpose do you use it on production? I'm using it on Fedora hosts just fine and I've got some deployed on CentOS as well with no problem. Before anyone says anything about Fedora - the reason is that I can generally yum upgrade from one release to the next but going through the upgrade from RHEL/CentOS from say 4 to 5 to 6 is a painful experience. I totally abandoned Ubuntu when they went to Unity and the changes they made make it almost impossible to setup freenx servers on those machines. Seems the packages are their but certain dependencies can not be resolved and reports I've read indicated, even AFTER you manually recompile some audio libraries and crap that Ubuntu dropped the ball on, it still is unreliable as all get out. I rely too much on NX for remote desktops with 5 remote locations even when I'm home (and six when I'm on the road). I can't have that. I gave up after a couple of days of trying and ripped Ubuntu off all my systems and replaced it with Fedora. To each his own... I have one host (Fedora 15) which has approximately 3 dozen VM's running on it doing a variety of things like web, mail, mailing lists, databases, remote desktops, DNS (authoritative and caching), Nagios etc, etc. My biggest headache is when a buddy of mine runs one of his database intensive scripts it runs the load average of the host up to over 10 for a couple of minutes but I'll beat on him later. I'd love to hear what issues you had on CentOS. Obviously, if you are running LXC, it must have been CentOS 6. What rev level and kernel? I'm using lxc version 0.7.5 and kernel version 2.6.32. Thishttp://pastebin.com/Qtue8g3P is the script I'm using. The recent issue is that once I start a container, and try to do an ssh from outside it doesn't show anything on the terminal. Though a ps aux says that a pts/1 has been allocated to an ssh login. It used to fail before and would give an error saying error: ioctl(TIOCSCTTY): Operation not permitted error: open /dev/tty failed - could not set controlling tty: No such device Which seems to be fixed by removing the mount of devpts from fstab and/or doing #mount -o remount,rw /dev/pts One more problem is that I have to reboot the host everytime after I shutdown any container to make everything work like before. After the remount of /dev/pts that seems to have been fixed. But the ssh thing is still a big issue. I'm thinking something is wrong with the mount of /dev. Can you share your script? or conf file? thanks! swair cheers, swair Regards, Mike -- Michael H. Warfield (AI4NB) | (770) 985-6132 | m...@wittsend.com /\/\|=mhw=|\/\/ | (678) 463-0932 | http://www.wittsend.com/mhw/ NIC whois: MHW9 | An optimist believes we live in the best of all PGP Key: 0x674627FF| possible worlds. A pessimist is sure of it! -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
Re: [Lxc-users] Using lxc on production
On Mon 2012-10-22 (18:09), swair shah wrote: I was wondering if anyone is using lxc on production. and if you don't mind disclosing, for what purpose do you use it on production? fex.rus.uni-stuttgart.de is a LXC container and runs smooth for nearly 2 years. It gives more than 300 MB/s for HTTP file transfers See http://fex.rus.uni-stuttgart.de/ for details -- Ullrich Horlacher Informationssysteme und Serverbetrieb Rechenzentrum IZUS/TIK E-Mail: horlac...@rus.uni-stuttgart.de Universitaet Stuttgart Tel:++49-711-68565868 Allmandring 30aFax:++49-711-682357 70550 Stuttgart (Germany) WWW:http://www.rus.uni-stuttgart.de/ REF: cakrdmx8czra3gvtg+octjvu2z2b-yjmjv_+vg2yurtd44my...@mail.gmail.com -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
Re: [Lxc-users] Using lxc on production
On Mon 2012-10-22 (14:53), Stéphane Graber wrote: All in all, that's somewhere around 300-400 containers I'm managing How do you handle a host (hardware) failure? -- Ullrich Horlacher Informationssysteme und Serverbetrieb Rechenzentrum IZUS/TIK E-Mail: horlac...@rus.uni-stuttgart.de Universitaet Stuttgart Tel:++49-711-68565868 Allmandring 30aFax:++49-711-682357 70550 Stuttgart (Germany) WWW:http://www.rus.uni-stuttgart.de/ REF: 508541dd.10...@ubuntu.com -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Lxc-users mailing list Lxc-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/lxc-users
