Re: [pve-devel] I/O Limit does not work correctly
Am 14.11.2012 08:22, schrieb Dietmar Maurer: Am 14.11.2012 08:09, schrieb Dietmar Maurer: Could you please test If that happens to you too? I would like to verify that it's not my own fault before reporting. Sure, if you provide me with the exact steps to reproduce it on latest qemu git code. Why not first check if it happens with current PVE code base? You can do that yourself. And you need to tell us what you test. 1.) what kvm command line do you use exactly - try to minimize that 2.) what guest OS do you use 3.) what benchmark do you run inside the guest OS to trigger the bug Seems to be a problem with my iops limit of 70. Even though the result is only 30 iops. I get full speed if i higher the iops limit. Stefan ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] [PATCH 1/4] RFC: Efficient VM backup for qemu
1 TB == 2MB bitmap I guess that is small enough. Oh yes, no problem ! - Mail original - De: Dietmar Maurer diet...@proxmox.com À: Alexandre DERUMIER aderum...@odiso.com Cc: pve-devel@pve.proxmox.com Envoyé: Mercredi 14 Novembre 2012 05:50:13 Objet: RE: [pve-devel] [PATCH 1/4] RFC: Efficient VM backup for qemu Do you keep some blocks maps in memory ? (if yes, what is the memory usage with big volume?) Yes, we use a bitmap, one bit for one cluster (cluster size = 65536 bytes) 1 TB == 16MB bitmap 2^40/2^16 = 2^(40-16) = 2^24 Oh, just noticed that this is the number of bits (not bytes), so you need to divide above result by 8: 1 TB == 2MB bitmap I guess that is small enough. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] [PATCH 1/4] RFC: Efficient VM backup for qemu
I have in mind some high database load, like 5000iops or more, so it need a fast backup storage in this case. Such tests would be very useful - maybe you can run a few tests with that workload? Yes, sure, I'll do tests. Also another question, what happen is the backup storage goes down or not available? (maybe a network storage, maybe on a wan or remote site). Does the vm will hang ? Maybe some timeout protection could be great ? (stop backup if storage not available since X seconds, or if X writes are hanging). - Mail original - De: Dietmar Maurer diet...@proxmox.com À: Alexandre DERUMIER aderum...@odiso.com Cc: pve-devel@pve.proxmox.com Envoyé: Mardi 13 Novembre 2012 19:07:31 Objet: RE: [pve-devel] [PATCH 1/4] RFC: Efficient VM backup for qemu I have in mind some high database load, like 5000iops or more, so it need a fast backup storage in this case. Such tests would be very useful - maybe you can run a few tests with that workload? ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] backup RFC preview
How can i test? Command line qm command? # git clone git://git.qemu-project.org/qemu.git then apply the patches. # cd qemu # ./configure --target-list=x86_64-softmmu # make You can then start qemu with something like that: # ./x86_64-softmmu/qemu-system-x86_64 -monitor stdio -enable-kvm -hda image.raw ... Are you going to use qemu instead qemu-kvm for 1.3 release ? (I have read that kvm will be finally officily merged in qemu for 1.3) - Mail original - De: Dietmar Maurer diet...@proxmox.com À: Stefan Priebe - Profihost AG s.pri...@profihost.ag Cc: pve-devel@pve.proxmox.com Envoyé: Mercredi 14 Novembre 2012 07:18:36 Objet: Re: [pve-devel] backup RFC preview How can i test? Command line qm command? # git clone git://git.qemu-project.org/qemu.git then apply the patches. # cd qemu # ./configure --target-list=x86_64-softmmu # make You can then start qemu with something like that: # ./x86_64-softmmu/qemu-system-x86_64 -monitor stdio -enable-kvm -hda image.raw ... ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] backup RFC preview
Are you going to use qemu instead qemu-kvm for 1.3 release ? (I have read that kvm will be finally officily merged in qemu for 1.3) Only if they announce that qemu-kvm is obsolete. I currently use qemu for the backup tests because it is required to send patches against qemu. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] backup RFC preview
I currently use qemu for the backup tests because it is required to send patches against qemu. Oh, you want to push patches upstream ? Great ! - Mail original - De: Dietmar Maurer diet...@proxmox.com À: Alexandre DERUMIER aderum...@odiso.com Cc: pve-devel@pve.proxmox.com, Stefan Priebe - Profihost AG s.pri...@profihost.ag Envoyé: Mercredi 14 Novembre 2012 16:41:29 Objet: RE: [pve-devel] backup RFC preview Are you going to use qemu instead qemu-kvm for 1.3 release ? (I have read that kvm will be finally officily merged in qemu for 1.3) Only if they announce that qemu-kvm is obsolete. I currently use qemu for the backup tests because it is required to send patches against qemu. ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] backup RFC preview
I currently use qemu for the backup tests because it is required to send patches against qemu. Oh, you want to push patches upstream ? Great ! Yes, that is the plan. It would be great if we can get at least the basic framework upstream (PATCH 2/4). Else we should think twice if we can maintain that ourselves. Usually it is a pain to get such things upstream, and that is why I posted it here first to get your opinions. So please tell me: - if anything is unclear - should I add further docs - any ideas for cleanups - anything else which helps to get it upsrteam ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
Re: [pve-devel] backup RFC preview
Ok, I'm not sure I have the skill to understand all the code, but I'll begin tests today and tomorrow, and I'll try to make a report next week. - Mail original - De: Dietmar Maurer diet...@proxmox.com À: Alexandre DERUMIER aderum...@odiso.com Cc: pve-devel@pve.proxmox.com, Stefan Priebe - Profihost AG s.pri...@profihost.ag Envoyé: Mercredi 14 Novembre 2012 18:31:30 Objet: RE: [pve-devel] backup RFC preview I currently use qemu for the backup tests because it is required to send patches against qemu. Oh, you want to push patches upstream ? Great ! Yes, that is the plan. It would be great if we can get at least the basic framework upstream (PATCH 2/4). Else we should think twice if we can maintain that ourselves. Usually it is a pain to get such things upstream, and that is why I posted it here first to get your opinions. So please tell me: - if anything is unclear - should I add further docs - any ideas for cleanups - anything else which helps to get it upsrteam ___ pve-devel mailing list pve-devel@pve.proxmox.com http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
