Re: Blocked tasks on 3.15.1

2014-08-18 Thread James Cloos
MM == Marc MERLIN m...@merlins.org writes: MM Note 3.16.0 is actually worse than 3.15 for me. Here (a single partition btrfs), 3.16.0 works fine, but 3.17-rc1 fails again. My /var/log is also a compressed, single-partition btrfs; that doesn't show the problem with any version. Just the

Re: Blocked tasks on 3.15.1

2014-08-11 Thread Charles Cazabon
The blocked tasks issue that got significantly worse in 3.15 -- did anything go into 3.16 related to this? I didn't see a single btrfs in Linus' 3.16 announcement, so I don't know whether it should be better, the same, or worse in this respect... I haven't seen a definite statement about this on

Re: Blocked tasks on 3.15.1

2014-08-11 Thread Liu Bo
On Mon, Aug 11, 2014 at 08:55:21PM -0600, Charles Cazabon wrote: The blocked tasks issue that got significantly worse in 3.15 -- did anything go into 3.16 related to this? I didn't see a single btrfs in Linus' 3.16 announcement, so I don't know whether it should be better, the same, or worse

Re: Blocked tasks on 3.15.1

2014-08-11 Thread Duncan
Liu Bo posted on Tue, 12 Aug 2014 10:56:42 +0800 as excerpted: On Mon, Aug 11, 2014 at 08:55:21PM -0600, Charles Cazabon wrote: The blocked tasks issue that got significantly worse in 3.15 -- did anything go into 3.16 related to this? I didn't see a single btrfs in Linus' 3.16 announcement,

Re: Blocked tasks on 3.15.1

2014-08-11 Thread Marc MERLIN
On Mon, Aug 11, 2014 at 08:55:21PM -0600, Charles Cazabon wrote: The blocked tasks issue that got significantly worse in 3.15 -- did anything go into 3.16 related to this? I didn't see a single btrfs in Linus' 3.16 announcement, so I don't know whether it should be better, the same, or worse

Re: Blocked tasks on 3.15.1

2014-08-07 Thread Tobias Holst
Hi Is there anything new on this topic? I am using Ubuntu 14.04.1 and experiencing the same problem. - 6 HDDs - LUKS on every HDD - btrfs RAID6 over this 6 crypt-devices No LVM, no nodatacow files. Mount-options: defaults,compress-force=lzo,space_cache With the original 3.13-kernel

Re: Blocked tasks on 3.15.1

2014-08-07 Thread Duncan
Tobias Holst posted on Thu, 07 Aug 2014 17:12:17 +0200 as excerpted: Is there anything new on this topic? I am using Ubuntu 14.04.1 and experiencing the same problem. - 6 HDDs - LUKS on every HDD - btrfs RAID6 over this 6 crypt-devices No LVM, no nodatacow files. Mount-options:

Re: Blocked tasks on 3.15.1

2014-07-23 Thread Felix Seidel
On 23 Jul 2014, at 03:06, Rich Freeman r-bt...@thefreemanclan.net wrote: I disabled lzo and haven't had problems since. I'm now running on mainline without issue, but I think I did see the hang on mainline when I tried enabling lzo again briefly. Can confirm. I’m running mainline 3.16rc5 and

Re: Blocked tasks on 3.15.1

2014-07-23 Thread Martin Steigerwald
Am Dienstag, 22. Juli 2014, 17:15:21 schrieb Chris Mason: On 07/22/2014 05:13 PM, Martin Steigerwald wrote: Am Dienstag, 22. Juli 2014, 10:53:03 schrieb Chris Mason: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang

Re: Blocked tasks on 3.15.1

2014-07-23 Thread Charles Cazabon
Chris Mason c...@fb.com wrote: Thanks for the help in tracking this down everyone. We'll get there! Are you all running multi-disk systems (from a btrfs POV, more than one device?) I don't care how many physical drives this maps to, just does btrfs think there's more than one drive. Not

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to without the patch I got same results with

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Marc MERLIN
On Tue, Jul 22, 2014 at 10:53:03AM -0400, Chris Mason wrote: Thanks for the help in tracking this down everyone. We'll get there! Are you all running multi-disk systems (from a btrfs POV, more than one device?) I don't care how many physical drives this maps to, just does btrfs think there's

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/22/2014 03:42 PM, Torbjørn wrote: On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 09:50 PM, Chris Mason wrote: On 07/22/2014 03:42 PM, Torbjørn wrote: On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Martin Steigerwald
Am Dienstag, 22. Juli 2014, 10:53:03 schrieb Chris Mason: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/22/2014 05:13 PM, Martin Steigerwald wrote: Am Dienstag, 22. Juli 2014, 10:53:03 schrieb Chris Mason: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Rich Freeman
On Tue, Jul 22, 2014 at 10:53 AM, Chris Mason c...@fb.com wrote: Thanks for the help in tracking this down everyone. We'll get there! Are you all running multi-disk systems (from a btrfs POV, more than one device?) I don't care how many physical drives this maps to, just does btrfs think

Re: Blocked tasks on 3.15.1

2014-07-20 Thread Matt
[ deadlocks during rsync in 3.15 with compression enabled ] Hi everyone, I still haven't been able to reproduce this one here, but I'm going through a series of tests with lzo compression foraced and every operation forced to ordered. Hopefully it'll kick it out soon. While I'm hammering away,

Re: Blocked tasks on 3.15.1

2014-07-19 Thread Cody P Schafer
On Thu, Jul 17, 2014 at 8:18 AM, Chris Mason c...@fb.com wrote: [ deadlocks during rsync in 3.15 with compression enabled ] Hi everyone, I still haven't been able to reproduce this one here, but I'm going through a series of tests with lzo compression foraced and every operation forced to

Re: Blocked tasks on 3.15.1

2014-07-19 Thread Martin Steigerwald
Am Samstag, 19. Juli 2014, 12:38:53 schrieb Cody P Schafer: On Thu, Jul 17, 2014 at 8:18 AM, Chris Mason c...@fb.com wrote: [ deadlocks during rsync in 3.15 with compression enabled ] Hi everyone, I still haven't been able to reproduce this one here, but I'm going through a series

Re: Blocked tasks on 3.15.1, raid1 btrfs is no ends of trouble for me

2014-07-18 Thread Marc MERLIN
On Thu, Jul 17, 2014 at 09:18:07AM -0400, Chris Mason wrote: [ deadlocks during rsync in 3.15 with compression enabled ] Hi everyone, I still haven't been able to reproduce this one here, but I'm going through a series of tests with lzo compression foraced and every operation forced to

Re: Blocked tasks on 3.15.1, raid1 btrfs is no ends of trouble for me

2014-07-18 Thread Marc MERLIN
On Fri, Jul 18, 2014 at 05:33:45PM -0700, Marc MERLIN wrote: Howver, I have found that btrfs raid 1 on top of dmcrypt has given me no ends of trouble. I lost that filesystem twice due to corruption, and now it hangs my machine (strace finds that df is hanging on that partition).

Re: Blocked tasks on 3.15.1, raid1 btrfs is no ends of trouble for me

2014-07-18 Thread Marc MERLIN
TL;DR: 3.15.5 (or .1 when I tried it) just hang over and over again in multiple ways on my server. They also hang on my laptop reliably if I enable kmemleak, but otherwise my laptop mostly survives with 3.15.x without kmemleak (although it does deadlock eventually, but that could be after

Re: Blocked tasks on 3.15.1, raid1 btrfs is no ends of trouble for me

2014-07-18 Thread Chris Samuel
On Fri, 18 Jul 2014 05:44:57 PM Marc MERLIN wrote: Sorry, this may be a bit misleading. I actually lost 2 filesystems that were raid0 on top of dmcrypt. Stupid question I know, but does this happen without dmcrypt? cheers, Chris -- Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC

Re: Blocked tasks on 3.15.1, raid1 btrfs is no ends of trouble for me

2014-07-18 Thread Marc MERLIN
On Sat, Jul 19, 2014 at 11:59:24AM +1000, Chris Samuel wrote: On Fri, 18 Jul 2014 05:44:57 PM Marc MERLIN wrote: Sorry, this may be a bit misleading. I actually lost 2 filesystems that were raid0 on top of dmcrypt. Stupid question I know, but does this happen without dmcrypt? It's not a

Re: Blocked tasks on 3.15.1

2014-07-17 Thread Chris Mason
[ deadlocks during rsync in 3.15 with compression enabled ] Hi everyone, I still haven't been able to reproduce this one here, but I'm going through a series of tests with lzo compression foraced and every operation forced to ordered. Hopefully it'll kick it out soon. While I'm hammering

Re: Blocked tasks on 3.15.1

2014-07-02 Thread Chris Mason
On 07/02/2014 08:27 AM, Cody P Schafer wrote: Will do. The rsync I'm running is processing a lot of chromium cache files when it hangs (just for a reference), and ends up triggering a bunch of deletes as well. Still a problem with your v3.15.y (eb97581), here's the log with sysrq-t and

Re: Blocked tasks on 3.15.1

2014-07-02 Thread Chris Mason
On 07/02/2014 09:58 AM, Chris Mason wrote: On 07/02/2014 08:27 AM, Cody P Schafer wrote: Will do. The rsync I'm running is processing a lot of chromium cache files when it hangs (just for a reference), and ends up triggering a bunch of deletes as well. Still a problem with your v3.15.y

Re: Blocked tasks on 3.15.1

2014-07-01 Thread Chris Mason
On 06/30/2014 07:42 PM, Cody P Schafer wrote: On Mon, Jun 30, 2014 at 1:30 PM, Chris Mason c...@fb.com wrote: On 06/30/2014 02:11 PM, Chris Mason wrote: On 06/29/2014 04:02 PM, Cody P Schafer wrote: On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014

Re: Blocked tasks on 3.15.1

2014-06-30 Thread Chris Mason
On 06/29/2014 04:02 PM, Cody P Schafer wrote: On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was: ea4ebde02e08558b020c4b61bb9a4c0fcf63028e Btrfs: fix deadlocks with

Re: Blocked tasks on 3.15.1

2014-06-30 Thread Chris Mason
On 06/30/2014 02:11 PM, Chris Mason wrote: On 06/29/2014 04:02 PM, Cody P Schafer wrote: On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was:

Re: Blocked tasks on 3.15.1

2014-06-30 Thread Cody P Schafer
On Mon, Jun 30, 2014 at 1:30 PM, Chris Mason c...@fb.com wrote: On 06/30/2014 02:11 PM, Chris Mason wrote: On 06/29/2014 04:02 PM, Cody P Schafer wrote: On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken

Re: Blocked tasks on 3.15.1

2014-06-30 Thread Charles Cazabon
Chris Mason c...@fb.com wrote: On 06/29/2014 04:02 PM, Cody P Schafer wrote: been able to resurrect it yet. I'm also seeing stuck tasks on btrfs (3.14.4, 3.15.1, 3.15.2). I'm seeing these with 3.15.2 as well. Could you please send a sysrq-t and sysrq-l while you're stuck? That will

Re: Blocked tasks on 3.15.1

2014-06-29 Thread Cody P Schafer
On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was: ea4ebde02e08558b020c4b61bb9a4c0fcf63028e Btrfs: fix deadlocks with trylock on tree nodes. That patch applies

Re: Blocked tasks on 3.15.1

2014-06-29 Thread Cody P Schafer
On Sun, Jun 29, 2014 at 3:02 PM, Cody P Schafer d...@codyps.com wrote: On Fri, Jun 27, 2014 at 7:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was: ea4ebde02e08558b020c4b61bb9a4c0fcf63028e

Re: Blocked tasks on 3.15.1

2014-06-29 Thread Rich Freeman
On Fri, Jun 27, 2014 at 8:22 PM, Chris Samuel ch...@csamuel.org wrote: On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was: ea4ebde02e08558b020c4b61bb9a4c0fcf63028e Btrfs: fix deadlocks with trylock on tree nodes. That patch applies

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Tomasz Chmielewski
I've been getting blocked tasks on 3.15.1 generally at times when the filesystem is somewhat busy (such as doing a backup via scp/clonezilla writing to the disk). A week ago I had enabled snapper for a day which resulted in a daily cleanup of about 8 snapshots at once, which might have

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Duncan
Tomasz Chmielewski posted on Fri, 27 Jun 2014 12:02:43 +0200 as excerpted: I've been getting blocked tasks on 3.15.1 generally at times when the filesystem is somewhat busy (such as doing a backup via scp/clonezilla writing to the disk). I've started seeing similar on several servers, after

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Rich Freeman
On Fri, Jun 27, 2014 at 9:06 AM, Duncan 1i5t5.dun...@cox.net wrote: Hopefully that problem's fixed on 3.16-rc2+, but as of yet there's not enough 3.16-rc2+ reports out there from folks experiencing issues with 3.15 blocked tasks to rightfully say. Any chance that it was backported to 3.15.2?

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Chris Murphy
On Jun 27, 2014, at 9:14 AM, Rich Freeman r-bt...@thefreemanclan.net wrote: On Fri, Jun 27, 2014 at 9:06 AM, Duncan 1i5t5.dun...@cox.net wrote: Hopefully that problem's fixed on 3.16-rc2+, but as of yet there's not enough 3.16-rc2+ reports out there from folks experiencing issues with 3.15

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Duncan
Chris Murphy posted on Fri, 27 Jun 2014 09:52:46 -0600 as excerpted: On Jun 27, 2014, at 9:14 AM, Rich Freeman r-bt...@thefreemanclan.net wrote: On Fri, Jun 27, 2014 at 9:06 AM, Duncan 1i5t5.dun...@cox.net wrote: Hopefully that problem's fixed on 3.16-rc2+, but as of yet there's not enough

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Rich Freeman
On Fri, Jun 27, 2014 at 11:52 AM, Chris Murphy li...@colorremedies.com wrote: On Jun 27, 2014, at 9:14 AM, Rich Freeman r-bt...@thefreemanclan.net wrote: I got another block this morning and failed to capture a log before my terminals gave out. I switched back to 3.15.0 for the moment, and

Re: Blocked tasks on 3.15.1

2014-06-27 Thread Chris Samuel
On Fri, 27 Jun 2014 05:20:41 PM Duncan wrote: If I'm not mistaken the fix for the 3.16 series bug was: ea4ebde02e08558b020c4b61bb9a4c0fcf63028e Btrfs: fix deadlocks with trylock on tree nodes. That patch applies cleanly to 3.15.2 so if it is indeed the fix it should probably go to

Blocked tasks on 3.15.1

2014-06-26 Thread Rich Freeman
I've been getting blocked tasks on 3.15.1 generally at times when the filesystem is somewhat busy (such as doing a backup via scp/clonezilla writing to the disk). A week ago I had enabled snapper for a day which resulted in a daily cleanup of about 8 snapshots at once, which might have