Re: rbd export speed limit

2013-02-20 Thread Andrey Korolyov
On Wed, Feb 13, 2013 at 12:22 AM, Stefan Priebe s.pri...@profihost.ag wrote: Hi, is there a speed limit option for rbd export? Right now i'm able to produce several SLOW requests from IMPORTANT valid requests while just exporting a snapshot which is not really important. rbd export runs

Re: rbd export speed limit

2013-02-13 Thread Sage Weil
On Wed, 13 Feb 2013, Stefan Priebe - Profihost AG wrote: Hi, Am 12.02.2013 21:45, schrieb Andrey Korolyov: you may be interested in throttle(1) as a side solution with stdout export option. What's throttle? Never seen this. Wouldn't it be possible to use tc? By the way, on which

Re: rbd export speed limit

2013-02-13 Thread Stefan Priebe
Hi, first sorry i got this totally wrong. The speed is not correct and i mixed this with another operation going on at the same time. The problem isn't the rbd export in my case it the fstrim issued on all VMs. This results in writes up to 400Mb/s per OSD and then results in aborted /

Re: rbd export speed limit

2013-02-13 Thread Sage Weil
On Wed, 13 Feb 2013, Stefan Priebe wrote: Hi, first sorry i got this totally wrong. The speed is not correct and i mixed this with another operation going on at the same time. The problem isn't the rbd export in my case it the fstrim issued on all VMs. This results in writes up to

Re: rbd export speed limit

2013-02-13 Thread Stefan Priebe
Hi, Am 13.02.2013 21:21, schrieb Sage Weil: This results in writes up to 400Mb/s per OSD and then results in aborted / hanging task in VMs. Is it possible to give trim commands lower priority? Is that 400Mb or MB? Measured over the network, or on the disk itself? Sorry it's MB - so the

Re: rbd export speed limit

2013-02-13 Thread Gregory Farnum
On Wed, Feb 13, 2013 at 12:27 PM, Stefan Priebe s.pri...@profihost.ag wrote: Hi, Am 13.02.2013 21:21, schrieb Sage Weil: This results in writes up to 400Mb/s per OSD and then results in aborted / hanging task in VMs. Is it possible to give trim commands lower priority? Is that 400Mb or

Re: rbd export speed limit

2013-02-13 Thread Stefan Priebe
HI Greg, Am 13.02.2013 21:38, schrieb Gregory Farnum: Sorry it's MB - so the SSDs get fully utilized meased via /proc/diskstats . I'm wondering if this is a lack of punch support on the kernel.. I'm using 3.7.7 running XFS. Sounds like maybe the client trim is ending up issuing a truly

rbd export speed limit

2013-02-12 Thread Stefan Priebe
Hi, is there a speed limit option for rbd export? Right now i'm able to produce several SLOW requests from IMPORTANT valid requests while just exporting a snapshot which is not really important. rbd export runs with 2400MB/s and each OSD with 250MB/s so it seems to block valid normal read /

Re: rbd export speed limit

2013-02-12 Thread Andrey Korolyov
Hi Stefan, you may be interested in throttle(1) as a side solution with stdout export option. By the way, on which interconnect you have manage to get such speeds, if you mean 'commited' bytes(e.g. not almost empty allocated image)? On Wed, Feb 13, 2013 at 12:22 AM, Stefan Priebe

Re: rbd export speed limit

2013-02-12 Thread Stefan Priebe - Profihost AG
Hi, Am 12.02.2013 21:45, schrieb Andrey Korolyov: you may be interested in throttle(1) as a side solution with stdout export option. What's throttle? Never seen this. Wouldn't it be possible to use tc? By the way, on which interconnect you have manage to get such speeds, Bonded Intel 2x 10GBE