Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-20 Thread Andrew Guertin
On 08/18/2011 10:38 AM, Chris Mason wrote: Excerpts from Andrew Guertin's message of 2011-08-11 21:13:18 -0400: On 08/09/2011 05:29 PM, Andrew Guertin wrote: I have not tried 3.1-rc1, but plan to soon. I've tested now, this does still occur in 3.1-rc1. Ok, I had high hopes that the btrfs

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-19 Thread Chris Samuel
On 18/08/11 16:58, youagree wrote: Are these processes principally btrfs-submit and btrfs-transacti in particular? Then it may be related to my very similar issue reported earlier. I spent a little bit of time last night looking at it and it seems that what I'm seeing also affects ext4 on

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread youagree
This is most probably related to the same regression seen after 2.6.38, my blocked comment on 3 August included an indication to that the behavior was present in my distro 2.6.38 kernel too, it just was appearing after a considerably longer uptime (on my desktop system using btrfs as rootfs on an

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Chris Samuel
On 18/08/11 00:29, Michael Cronenworth wrote: I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes and I have not seen slow downs or hangs. I use Firefox. I've got btrfs on an external USB drive with the 3.0.1 kernel and I see that sync seems to take an age, according to iotop it seems

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread youagree
Are these processes principally btrfs-submit and btrfs-transacti in particular? Then it may be related to my very similar issue reported earlier. On 08/18/2011 08:47 AM, Chris Samuel wrote: On 18/08/11 00:29, Michael Cronenworth wrote: I'm running kernel 3.0 (Fedora 15's 2.6.40) on two

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/18/2011 02:44 AM, youagree wrote: Also, a patch by Josef Bacik was an attempt for fixing this, but no one reported about testing it on an affected system, it did not eliminate the slowdowns for me: PLEASE TEST: Everybody who is seeing weird and long hangs

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/17/2011 10:41 PM, Anand Jain wrote: Dave, good to have a test case on the 3.0 kernel. do you have btrfs as root fs ? and can you show how are you using the btrfs mainly I would need 'btrfs fi show' let me try if I can reproduce. Thanks, Anand Personally, I find that large compiles are

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread youagree
On 08/18/2011 09:29 AM, Andrew Guertin wrote: * Many processes occasionally hang for a short time * When this happens, my cpu monitor shows a short burst of cpu activity (100% of 1 core) followed by a longer period of IO * When this happens, iotop shows [btrfs-submit-0] and [btrfs-transacti]

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Andrew Guertin
On 08/18/2011 03:29 AM, Andrew Guertin wrote: I have not seen slowdowns on 2.6.38. More specifically, I observe the following behaviors after commit 4e69b59: * Many processes occasionally hang for a short time * When this happens, my cpu monitor shows a short burst of cpu activity (100% of

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-18 Thread Chris Mason
Excerpts from Andrew Guertin's message of 2011-08-11 21:13:18 -0400: On 08/09/2011 05:29 PM, Andrew Guertin wrote: I have not tried 3.1-rc1, but plan to soon. I've tested now, this does still occur in 3.1-rc1. Ok, I had high hopes that the btrfs changes in rc1 would fix this. Could you

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Andrew Guertin
On 08/09/2011 05:29 PM, Andrew Guertin wrote: On 06/21/2011 01:15 PM, Jan Stilow wrote: Hello, Nirbheek Chauhan nirbheek at gentoo.org writes: [...] Every few minutes, (I guess) when applications do fsync (firefox, xchat, vim, etc), all applications that use fsync() hang for several

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Michael Cronenworth
Andrew Guertin on 08/17/2011 09:24 AM wrote: I (and presumably others) haven't been able to upgrade my kernel past 2.6.38 because of this. I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes and I have not seen slow downs or hangs. I use Firefox. -- To unsubscribe from this list: send

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Andrew Guertin
On 08/17/2011 10:29 AM, Michael Cronenworth wrote: Andrew Guertin on 08/17/2011 09:24 AM wrote: I (and presumably others) haven't been able to upgrade my kernel past 2.6.38 because of this. I'm running kernel 3.0 (Fedora 15's 2.6.40) on two boxes and I have not seen slow downs or hangs. I

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Dave
On Wed, Aug 17, 2011 at 10:38:42AM -0400, Andrew Guertin wrote: Well I'd expect it to be somewhat uncommon, or it wouldn't survive 3 kernel versions :) But at least 3 people have reported it, and for me at least it's reliably reproducible enough to bisect, so I'm quite certain there's

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-17 Thread Anand Jain
Dave, good to have a test case on the 3.0 kernel. do you have btrfs as root fs ? and can you show how are you using the btrfs mainly I would need 'btrfs fi show' let me try if I can reproduce. Thanks, Anand I've been simply living with this issue. I can reproduce it by rsyncing very

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-09 Thread Andrew Guertin
On 06/21/2011 01:15 PM, Jan Stilow wrote: Hello, Nirbheek Chauhan nirbheek at gentoo.org writes: [...] Every few minutes, (I guess) when applications do fsync (firefox, xchat, vim, etc), all applications that use fsync() hang for several seconds, and applications that use general IO

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-08-03 Thread mck
On Mon, 2011-07-18 at 14:17 -0400, Josef Bacik wrote: I've been looking into this and I have a suspicion. Would you run with this patch and see if the problem goes away? Didn't help me. 2.6.39 is not usable. 3.0.0 is ok for a few hours then too becomes unusable. This is discussed in future

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-20 Thread Nirbheek Chauhan
On Mon, Jul 18, 2011 at 11:47 PM, Josef Bacik jo...@redhat.com wrote: On 06/06/2011 06:58 PM, Nirbheek Chauhan wrote: What can I do to debug this issue? What other information should I supply? Could someone guide me on how to figure out why my machine is unusable now? I've been looking into

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-18 Thread Mck
On Tue, 2011-06-07 at 04:28 +0530, Nirbheek Chauhan wrote: Every few minutes, (I guess) when applications do fsync (firefox, xchat, vim, etc), all applications that use fsync() hang for several seconds, and applications that use general IO suffer extreme slowdowns. iotop shows various

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-07-18 Thread Josef Bacik
On 06/06/2011 06:58 PM, Nirbheek Chauhan wrote: Hello list, I've been using btrfs on my personal machines for about two years now, and on this machine for about a year with absolutely no problems. Infact, it has held up better than ext4 with regards to reliability. However, recently,

Re: Applications using fsync cause hangs for several seconds every few minutes

2011-06-21 Thread Jan Stilow
Hello, Nirbheek Chauhan nirbheek at gentoo.org writes: However, recently, perhaps with 2.6.39, or after I quickly started filling up my disk again, it has become impossible for me to work for long periods on my machine. Every few minutes, (I guess) when applications do fsync (firefox,

Applications using fsync cause hangs for several seconds every few minutes

2011-06-06 Thread Nirbheek Chauhan
Hello list, I've been using btrfs on my personal machines for about two years now, and on this machine for about a year with absolutely no problems. Infact, it has held up better than ext4 with regards to reliability. However, recently, perhaps with 2.6.39, or after I quickly started filling up