Re: [pve-devel] less cores more iops / speed

2012-11-12 Thread Stefan Priebe - Profihost AG
...@profihost.ag Cc: pve-de...@pve.proxmox.com Envoyé: Lundi 12 Novembre 2012 15:26:36 Objet: Re: [pve-devel] less cores more iops / speed Maybe some tracing on kvm process could give us clues to find where the cpu is used ? Also another idea, can you try with auth supported=none ? maybe they are some

Re: [pve-devel] less cores more iops / speed

2012-11-12 Thread Josh Durgin
12 Novembre 2012 15:26:36 Objet: Re: [pve-devel] less cores more iops / speed Maybe some tracing on kvm process could give us clues to find where the cpu is used ? Also another idea, can you try with auth supported=none ? maybe they are some overhead with ceph authenfication ? - Mail

Re: [pve-devel] less cores more iops / speed

2012-11-12 Thread Stefan Priebe
Hi Josh, For the client side you'd these settings to disable all debug logging: ... Thanks! Stefan -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: less cores more iops / speed

2012-11-09 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 16:53, schrieb Alexandre DERUMIER: So it is a problem of KVM which let's the processes jump between cores a lot. maybe numad from redhat can help ? http://fedoraproject.org/wiki/Features/numad It's try to keep process on same numa node and I think it's also doing some dynamic

Re: less cores more iops / speed

2012-11-08 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd be interesting to know how much the writer processes were shifting around on cores. What do you mean by that? I'm talking about the KVM guest not about the ceph nodes. Stefan, what tool were you

Re: less cores more iops / speed

2012-11-08 Thread Alexandre DERUMIER
...@profihost.ag À: Mark Nelson mark.nel...@inktank.com Cc: Joao Eduardo Luis joao.l...@inktank.com, ceph-devel@vger.kernel.org Envoyé: Jeudi 8 Novembre 2012 09:45:17 Objet: Re: less cores more iops / speed Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd

Re: less cores more iops / speed

2012-11-08 Thread Stefan Priebe - Profihost AG
:45:17 Objet: Re: less cores more iops / speed Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd be interesting to know how much the writer processes were shifting around on cores. What do you mean by that? I'm talking about the KVM guest not about

Re: less cores more iops / speed

2012-11-08 Thread Alexandre DERUMIER
@vger.kernel.org, Mark Nelson mark.nel...@inktank.com Envoyé: Jeudi 8 Novembre 2012 10:02:23 Objet: Re: less cores more iops / speed Am 08.11.2012 09:58, schrieb Alexandre DERUMIER: What do you mean by that? I'm talking about the KVM guest not about the ceph nodes. Do you have tried

Re: less cores more iops / speed

2012-11-08 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 10:05, schrieb Alexandre DERUMIER: Do you have tried to compare virtio-blk and virtio-scsi ? How to change? Right now i'm using the PVE defaults = scsi-hd. (virtio-blk is classic virtio ;) Do you have tried directly from the host with the rbd kernel module ? No don't know how

Re: less cores more iops / speed

2012-11-08 Thread Mark Nelson
On 11/08/2012 02:45 AM, Stefan Priebe - Profihost AG wrote: Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd be interesting to know how much the writer processes were shifting around on cores. What do you mean by that? I'm talking about the KVM guest

Re: less cores more iops / speed

2012-11-08 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 14:19, schrieb Mark Nelson: On 11/08/2012 02:45 AM, Stefan Priebe - Profihost AG wrote: Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd be interesting to know how much the writer processes were shifting around on cores. What do you

Re: less cores more iops / speed

2012-11-08 Thread Alexandre DERUMIER
Priebe - Profihost AG s.pri...@profihost.ag À: Mark Nelson mark.nel...@inktank.com Cc: Joao Eduardo Luis joao.l...@inktank.com, ceph-devel@vger.kernel.org Envoyé: Jeudi 8 Novembre 2012 16:14:32 Objet: Re: less cores more iops / speed Am 08.11.2012 14:19, schrieb Mark Nelson: On 11/08/2012 02

Re: less cores more iops / speed

2012-11-08 Thread Andrey Korolyov
@vger.kernel.org Envoyé: Jeudi 8 Novembre 2012 16:14:32 Objet: Re: less cores more iops / speed Am 08.11.2012 14:19, schrieb Mark Nelson: On 11/08/2012 02:45 AM, Stefan Priebe - Profihost AG wrote: Am 08.11.2012 01:59, schrieb Mark Nelson: There's also the context switching overhead. It'd

less cores more iops / speed

2012-11-07 Thread Stefan Priebe
Hello again, I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get 8000 iops (still 8 cores) when i then LOWER the assigned cores from 8 to 4 i get 14.500

Re: less cores more iops / speed

2012-11-07 Thread Joao Eduardo Luis
On 11/07/2012 10:02 PM, Stefan Priebe wrote: Hello again, I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get 8000 iops (still 8 cores) when i then LOWER

Re: less cores more iops / speed

2012-11-07 Thread Mark Nelson
On 11/07/2012 06:00 PM, Joao Eduardo Luis wrote: On 11/07/2012 10:02 PM, Stefan Priebe wrote: Hello again, I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get

Re: less cores more iops / speed

2012-11-07 Thread Mark Nelson
On 11/07/2012 06:00 PM, Joao Eduardo Luis wrote: On 11/07/2012 10:02 PM, Stefan Priebe wrote: Hello again, I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get

RE: less cores more iops / speed

2012-11-07 Thread Dietmar Maurer
I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get 8000 iops (still 8 cores) when i then LOWER the assigned cores from 8 to 4 i get 14.500 iops.

Re: less cores more iops / speed

2012-11-07 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 um 06:42 schrieb Dietmar Maurer diet...@proxmox.com: I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get 8000 iops (still 8 cores) when i

RE: less cores more iops / speed

2012-11-07 Thread Dietmar Maurer
Why is vhost net driver involved here at all? Kvm guest only uses ssh here. I though you are testing things (rdb) which depends on KVM network speed? -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info

Re: less cores more iops / speed

2012-11-07 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 um 06:49 schrieb Dietmar Maurer diet...@proxmox.com: I've noticed something really interesting. I get 5000 iops / VM for rand. 4k writes while assigning 4 cores on a 2.5 Ghz Xeon. When i move this VM to another kvm host with 3.6Ghz i get 8000 iops (still 8 cores) when i

Re: less cores more iops / speed

2012-11-07 Thread Stefan Priebe - Profihost AG
Am 08.11.2012 um 06:54 schrieb Dietmar Maurer diet...@proxmox.com: Why is vhost net driver involved here at all? Kvm guest only uses ssh here. I though you are testing things (rdb) which depends on KVM network speed? Kvm process uses librbd and both are running on host not in guest. Stefan