Re: [openstack-dev] My notes and experiences about OSv on OpenStack
Ahhh, that's bad. Do you think there is a need for pushing OSv integration in OpenStack in Kilo cycle? Would you come to Paris Summit? On Thu, Oct 16, 2014 at 1:24 PM, Gareth academicgar...@gmail.com wrote: yes :) I planed that if that topic were picked, I could apply that as a formal project in Intel. But failed... On Thu, Oct 16, 2014 at 12:53 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Hi, I'm also interested in it. You submitted a talk about it to Paris Summit right? On Thu, Oct 16, 2014 at 10:34 AM, Gareth academicgar...@gmail.com wrote: Here is introducing OSv to all OpenStack developers. OSv team is focusing on performance of KVM based guest OS, or cloud application. I'm interested in it because of their hard work on optimizing all details. And I had also worked on deploying OSv on OpenStack environment. However, since my work is only for private interests in off working time, my progress is pretty slow. So I have to share my experience and hope other engineers could join it: # OSv highlights in my mind 1, Super fast booting time means nearly zero down time services, an alternative way to dynamic flavor changing and time improvement for deploying instances in KVM based PaaS platform. 2, Great work on performance. Cloud engineers could borrow experience from their work on guest OS. 3, Better performance on JVM. We could imagine there are many overhead and redundancy in host OS/guest OS/JVM. Fixing that could help Java applications perform closer to bare-metal. # Enabling OSv on OpenStack Actually there should not be any big problems. The steps are that building OSv qcow2 image first and boot it via Nova then. You may face some problems because OSv image need many new Qemu features, such as virtio-rng-io/vhost and enable-kvm flag is necessary. Fortunately, I don't meet any problems with network, Neutron (actually I thought before network in OpenStack maybe hang me for a long time). OSv need a tap device and Neutron does good job on it. And then I could access OSv service very well. # OSv based demo The work I finished is only a memcached cluster. And the result is obvious: memory throughout of OSv based instance has 3 times than it in traditional virtual machines, and 90% of performance on host OS[0][1]. Since their work on memcached is quite mature, consider OSv if you need build memcached instance. Another valuable demo cluster is Hadoop. When talking about Hadoop on OpenStack, the topic asked most frequently is the performance on virtual machines. A known experience is higher version Qemu would help fix disk I/O performance[2]. But how does the overlap in JVM/guest OS? I would love to find that, but don't have so much time. After of all, the purpose of this thread is to bring an interesting topic on cloud performance and hope more and more efficient clusters based on OpenStack (in production use). I don't have so much time on OSv because this just is my personal interest, but I could prove OSv is a valuable way and topic. [0] http://paste.openstack.org/show/121382/ [1] https://github.com/cloudius-systems/osv/wiki/OSv-Case-Study:-Memcached [2] https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/performance-of-hadoop-on-openstack -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2 University of California, Irvine Email: zhipe...@uci.edu Office: Calit2 Building Room 2402 OpenStack, OpenDaylight, OpenCompute affcienado -- You received this message because you are subscribed to the Google Groups OSv Development group. To unsubscribe from this group and stop receiving emails from it, send an email to osv-dev+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2 University of California, Irvine Email: zhipe...@uci.edu Office: Calit2 Building Room 2402 OpenStack, OpenDaylight, OpenCompute affcienado ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] My notes and experiences about OSv on OpenStack
Pusihng it into OpenStack is not a hard job, because for OpenStack developers OSv image is a normal qcow2 image. What you need do is enabling some Qemu flags in Nova libvirt driver. yep, I will be there :) On Thu, Oct 16, 2014 at 2:10 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Ahhh, that's bad. Do you think there is a need for pushing OSv integration in OpenStack in Kilo cycle? Would you come to Paris Summit? On Thu, Oct 16, 2014 at 1:24 PM, Gareth academicgar...@gmail.com wrote: yes :) I planed that if that topic were picked, I could apply that as a formal project in Intel. But failed... On Thu, Oct 16, 2014 at 12:53 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Hi, I'm also interested in it. You submitted a talk about it to Paris Summit right? On Thu, Oct 16, 2014 at 10:34 AM, Gareth academicgar...@gmail.com wrote: Here is introducing OSv to all OpenStack developers. OSv team is focusing on performance of KVM based guest OS, or cloud application. I'm interested in it because of their hard work on optimizing all details. And I had also worked on deploying OSv on OpenStack environment. However, since my work is only for private interests in off working time, my progress is pretty slow. So I have to share my experience and hope other engineers could join it: # OSv highlights in my mind 1, Super fast booting time means nearly zero down time services, an alternative way to dynamic flavor changing and time improvement for deploying instances in KVM based PaaS platform. 2, Great work on performance. Cloud engineers could borrow experience from their work on guest OS. 3, Better performance on JVM. We could imagine there are many overhead and redundancy in host OS/guest OS/JVM. Fixing that could help Java applications perform closer to bare-metal. # Enabling OSv on OpenStack Actually there should not be any big problems. The steps are that building OSv qcow2 image first and boot it via Nova then. You may face some problems because OSv image need many new Qemu features, such as virtio-rng-io/vhost and enable-kvm flag is necessary. Fortunately, I don't meet any problems with network, Neutron (actually I thought before network in OpenStack maybe hang me for a long time). OSv need a tap device and Neutron does good job on it. And then I could access OSv service very well. # OSv based demo The work I finished is only a memcached cluster. And the result is obvious: memory throughout of OSv based instance has 3 times than it in traditional virtual machines, and 90% of performance on host OS[0][1]. Since their work on memcached is quite mature, consider OSv if you need build memcached instance. Another valuable demo cluster is Hadoop. When talking about Hadoop on OpenStack, the topic asked most frequently is the performance on virtual machines. A known experience is higher version Qemu would help fix disk I/O performance[2]. But how does the overlap in JVM/guest OS? I would love to find that, but don't have so much time. After of all, the purpose of this thread is to bring an interesting topic on cloud performance and hope more and more efficient clusters based on OpenStack (in production use). I don't have so much time on OSv because this just is my personal interest, but I could prove OSv is a valuable way and topic. [0] http://paste.openstack.org/show/121382/ [1] https://github.com/cloudius-systems/osv/wiki/OSv-Case-Study:-Memcached [2] https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/performance-of-hadoop-on-openstack -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2 University of California, Irvine Email: zhipe...@uci.edu Office: Calit2 Building Room 2402 OpenStack, OpenDaylight, OpenCompute affcienado -- You received this message because you are subscribed to the Google Groups OSv Development group. To unsubscribe from this group and stop receiving emails from it, send an email to osv-dev+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2 University of California, Irvine
Re: [openstack-dev] My notes and experiences about OSv on OpenStack
Hey Glauber that would be great! See you in Paris then :) On Thu, Oct 16, 2014 at 4:32 PM, Glauber Costa glom...@cloudius-systems.com wrote: Hello guys Just to let you know, I won't be in the Summit because I am too busy due to the fact I am relocating to a foreign country. However, that country happens to be France, and that city happens to be Paris. I am arriving Nov 4th around 3 pm, and would be happy to meet you (and other people interested in OSv) either that night, or even better, the following day or night. Cheers On Thu, Oct 16, 2014 at 10:56 AM, Zhipeng Huang zhipengh...@gmail.com wrote: Great let's have some f2f time discussion at Paris. Have you added what u mentioned in Nova Kilo summit topics? On Thu, Oct 16, 2014 at 2:54 PM, Gareth academicgar...@gmail.com wrote: Pusihng it into OpenStack is not a hard job, because for OpenStack developers OSv image is a normal qcow2 image. What you need do is enabling some Qemu flags in Nova libvirt driver. yep, I will be there :) On Thu, Oct 16, 2014 at 2:10 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Ahhh, that's bad. Do you think there is a need for pushing OSv integration in OpenStack in Kilo cycle? Would you come to Paris Summit? On Thu, Oct 16, 2014 at 1:24 PM, Gareth academicgar...@gmail.com wrote: yes :) I planed that if that topic were picked, I could apply that as a formal project in Intel. But failed... On Thu, Oct 16, 2014 at 12:53 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Hi, I'm also interested in it. You submitted a talk about it to Paris Summit right? On Thu, Oct 16, 2014 at 10:34 AM, Gareth academicgar...@gmail.com wrote: Here is introducing OSv to all OpenStack developers. OSv team is focusing on performance of KVM based guest OS, or cloud application. I'm interested in it because of their hard work on optimizing all details. And I had also worked on deploying OSv on OpenStack environment. However, since my work is only for private interests in off working time, my progress is pretty slow. So I have to share my experience and hope other engineers could join it: # OSv highlights in my mind 1, Super fast booting time means nearly zero down time services, an alternative way to dynamic flavor changing and time improvement for deploying instances in KVM based PaaS platform. 2, Great work on performance. Cloud engineers could borrow experience from their work on guest OS. 3, Better performance on JVM. We could imagine there are many overhead and redundancy in host OS/guest OS/JVM. Fixing that could help Java applications perform closer to bare-metal. # Enabling OSv on OpenStack Actually there should not be any big problems. The steps are that building OSv qcow2 image first and boot it via Nova then. You may face some problems because OSv image need many new Qemu features, such as virtio-rng-io/vhost and enable-kvm flag is necessary. Fortunately, I don't meet any problems with network, Neutron (actually I thought before network in OpenStack maybe hang me for a long time). OSv need a tap device and Neutron does good job on it. And then I could access OSv service very well. # OSv based demo The work I finished is only a memcached cluster. And the result is obvious: memory throughout of OSv based instance has 3 times than it in traditional virtual machines, and 90% of performance on host OS[0][1]. Since their work on memcached is quite mature, consider OSv if you need build memcached instance. Another valuable demo cluster is Hadoop. When talking about Hadoop on OpenStack, the topic asked most frequently is the performance on virtual machines. A known experience is higher version Qemu would help fix disk I/O performance[2]. But how does the overlap in JVM/guest OS? I would love to find that, but don't have so much time. After of all, the purpose of this thread is to bring an interesting topic on cloud performance and hope more and more efficient clusters based on OpenStack (in production use). I don't have so much time on OSv because this just is my personal interest, but I could prove OSv is a valuable way and topic. [0] http://paste.openstack.org/show/121382/ [1] https://github.com/cloudius-systems/osv/wiki/OSv-Case-Study:-Memcached [2] https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/performance-of-hadoop-on-openstack -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2
[openstack-dev] My notes and experiences about OSv on OpenStack
Here is introducing OSv to all OpenStack developers. OSv team is focusing on performance of KVM based guest OS, or cloud application. I'm interested in it because of their hard work on optimizing all details. And I had also worked on deploying OSv on OpenStack environment. However, since my work is only for private interests in off working time, my progress is pretty slow. So I have to share my experience and hope other engineers could join it: # OSv highlights in my mind 1, Super fast booting time means nearly zero down time services, an alternative way to dynamic flavor changing and time improvement for deploying instances in KVM based PaaS platform. 2, Great work on performance. Cloud engineers could borrow experience from their work on guest OS. 3, Better performance on JVM. We could imagine there are many overhead and redundancy in host OS/guest OS/JVM. Fixing that could help Java applications perform closer to bare-metal. # Enabling OSv on OpenStack Actually there should not be any big problems. The steps are that building OSv qcow2 image first and boot it via Nova then. You may face some problems because OSv image need many new Qemu features, such as virtio-rng-io/vhost and enable-kvm flag is necessary. Fortunately, I don't meet any problems with network, Neutron (actually I thought before network in OpenStack maybe hang me for a long time). OSv need a tap device and Neutron does good job on it. And then I could access OSv service very well. # OSv based demo The work I finished is only a memcached cluster. And the result is obvious: memory throughout of OSv based instance has 3 times than it in traditional virtual machines, and 90% of performance on host OS[0][1]. Since their work on memcached is quite mature, consider OSv if you need build memcached instance. Another valuable demo cluster is Hadoop. When talking about Hadoop on OpenStack, the topic asked most frequently is the performance on virtual machines. A known experience is higher version Qemu would help fix disk I/O performance[2]. But how does the overlap in JVM/guest OS? I would love to find that, but don't have so much time. After of all, the purpose of this thread is to bring an interesting topic on cloud performance and hope more and more efficient clusters based on OpenStack (in production use). I don't have so much time on OSv because this just is my personal interest, but I could prove OSv is a valuable way and topic. [0] http://paste.openstack.org/show/121382/ [1] https://github.com/cloudius-systems/osv/wiki/OSv-Case-Study:-Memcached [2] https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/performance-of-hadoop-on-openstack -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] My notes and experiences about OSv on OpenStack
yes :) I planed that if that topic were picked, I could apply that as a formal project in Intel. But failed... On Thu, Oct 16, 2014 at 12:53 PM, Zhipeng Huang zhipengh...@gmail.com wrote: Hi, I'm also interested in it. You submitted a talk about it to Paris Summit right? On Thu, Oct 16, 2014 at 10:34 AM, Gareth academicgar...@gmail.com wrote: Here is introducing OSv to all OpenStack developers. OSv team is focusing on performance of KVM based guest OS, or cloud application. I'm interested in it because of their hard work on optimizing all details. And I had also worked on deploying OSv on OpenStack environment. However, since my work is only for private interests in off working time, my progress is pretty slow. So I have to share my experience and hope other engineers could join it: # OSv highlights in my mind 1, Super fast booting time means nearly zero down time services, an alternative way to dynamic flavor changing and time improvement for deploying instances in KVM based PaaS platform. 2, Great work on performance. Cloud engineers could borrow experience from their work on guest OS. 3, Better performance on JVM. We could imagine there are many overhead and redundancy in host OS/guest OS/JVM. Fixing that could help Java applications perform closer to bare-metal. # Enabling OSv on OpenStack Actually there should not be any big problems. The steps are that building OSv qcow2 image first and boot it via Nova then. You may face some problems because OSv image need many new Qemu features, such as virtio-rng-io/vhost and enable-kvm flag is necessary. Fortunately, I don't meet any problems with network, Neutron (actually I thought before network in OpenStack maybe hang me for a long time). OSv need a tap device and Neutron does good job on it. And then I could access OSv service very well. # OSv based demo The work I finished is only a memcached cluster. And the result is obvious: memory throughout of OSv based instance has 3 times than it in traditional virtual machines, and 90% of performance on host OS[0][1]. Since their work on memcached is quite mature, consider OSv if you need build memcached instance. Another valuable demo cluster is Hadoop. When talking about Hadoop on OpenStack, the topic asked most frequently is the performance on virtual machines. A known experience is higher version Qemu would help fix disk I/O performance[2]. But how does the overlap in JVM/guest OS? I would love to find that, but don't have so much time. After of all, the purpose of this thread is to bring an interesting topic on cloud performance and hope more and more efficient clusters based on OpenStack (in production use). I don't have so much time on OSv because this just is my personal interest, but I could prove OSv is a valuable way and topic. [0] http://paste.openstack.org/show/121382/ [1] https://github.com/cloudius-systems/osv/wiki/OSv-Case-Study:-Memcached [2] https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/performance-of-hadoop-on-openstack -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Zhipeng Huang Research Assistant Mobile Ad-Hoc Network Lab, Calit2 University of California, Irvine Email: zhipe...@uci.edu Office: Calit2 Building Room 2402 OpenStack, OpenDaylight, OpenCompute affcienado -- You received this message because you are subscribed to the Google Groups OSv Development group. To unsubscribe from this group and stop receiving emails from it, send an email to osv-dev+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- Gareth *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball* *OpenStack contributor, kun_huang@freenode* *My promise: if you find any spelling or grammar mistakes in my email from Mar 1 2013, notify me * *and I'll donate $1 or ￥1 to an open organization you specify.* ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
