Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-07 Thread Mariusz Gronczewski
I've often wished for some sort of bottleneck finder for ceph. An easy way for the system to say where it is experiencing critical latencies e.g. network, journals, osd data disks, etc. This would assist troubleshooting and initial deployments immensely. As mentioned above, it's

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-07 Thread Christian Balzer
On Thu, 7 Aug 2014 14:21:30 +0200 Mariusz Gronczewski wrote: I've often wished for some sort of bottleneck finder for ceph. An easy way for the system to say where it is experiencing critical latencies e.g. network, journals, osd data disks, etc. This would assist

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-06 Thread Chris Kitzmiller
On Aug 5, 2014, at 12:43 PM, Mark Nelson wrote: On 08/05/2014 08:42 AM, Mariusz Gronczewski wrote: On Mon, 04 Aug 2014 15:32:50 -0500, Mark Nelson mark.nel...@inktank.com wrote: On 08/04/2014 03:28 PM, Chris Kitzmiller wrote: On Aug 1, 2014, at 1:31 PM, Mariusz Gronczewski wrote: I got

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-06 Thread Christian Balzer
On Wed, 6 Aug 2014 09:19:57 -0400 Chris Kitzmiller wrote: On Aug 5, 2014, at 12:43 PM, Mark Nelson wrote: On 08/05/2014 08:42 AM, Mariusz Gronczewski wrote: On Mon, 04 Aug 2014 15:32:50 -0500, Mark Nelson mark.nel...@inktank.com wrote: On 08/04/2014 03:28 PM, Chris Kitzmiller wrote: On

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-05 Thread Mariusz Gronczewski
On Mon, 04 Aug 2014 15:32:50 -0500, Mark Nelson mark.nel...@inktank.com wrote: On 08/04/2014 03:28 PM, Chris Kitzmiller wrote: On Aug 1, 2014, at 1:31 PM, Mariusz Gronczewski wrote: I got weird stalling during writes, sometimes I got same write speed for few minutes and after some time it

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-05 Thread Mark Nelson
On 08/05/2014 08:42 AM, Mariusz Gronczewski wrote: On Mon, 04 Aug 2014 15:32:50 -0500, Mark Nelson mark.nel...@inktank.com wrote: On 08/04/2014 03:28 PM, Chris Kitzmiller wrote: On Aug 1, 2014, at 1:31 PM, Mariusz Gronczewski wrote: I got weird stalling during writes, sometimes I got same

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-04 Thread Chris Kitzmiller
On Aug 1, 2014, at 1:31 PM, Mariusz Gronczewski wrote: I got weird stalling during writes, sometimes I got same write speed for few minutes and after some time it starts stalling with 0 MB/s for minutes I'm getting very similar behavior on my cluster. My writes start well but then just kinda

Re: [ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-04 Thread Mark Nelson
On 08/04/2014 03:28 PM, Chris Kitzmiller wrote: On Aug 1, 2014, at 1:31 PM, Mariusz Gronczewski wrote: I got weird stalling during writes, sometimes I got same write speed for few minutes and after some time it starts stalling with 0 MB/s for minutes I'm getting very similar behavior on my

[ceph-users] Ceph writes stall for long perioids with no disk/network activity

2014-08-01 Thread Mariusz Gronczewski
Hi, when I am running rados bench -p benchmark 300 write --run-name bench --no-cleanup I got weird stalling during writes, sometimes I got same write speed for few minutes and after some time it starts stalling with 0 MB/s for minutes My configuration: ceph 0.80.5 pool 0 'data'