Re: ENOSPC errors during balance

2014-07-22 Thread Marc Joliet
Am Tue, 22 Jul 2014 03:26:39 + (UTC) schrieb Duncan 1i5t5.dun...@cox.net: Marc Joliet posted on Tue, 22 Jul 2014 01:30:22 +0200 as excerpted: And now that the background deletion of the old snapshots is done, the file system ended up at: # btrfs filesystem df

Re: Unstable v3.15-rc tags

2014-07-22 Thread David Sterba
On Sat, Jul 05, 2014 at 03:10:17PM +0100, WorMzy Tykashi wrote: The v3.15-rc{2,3,4} tags seem to have disappeared from the unstable repo in the last day or so. Please could you re-push the tags, or were they removed for a reason? The tags were meant to mark the points in time where different

Re: [PATCH v4] btrfs-progs: Add minimum device size check

2014-07-22 Thread David Sterba
On Mon, Jul 07, 2014 at 08:39:25AM +0800, Qu Wenruo wrote: Oh crap, I left my note in subject of the v3 patch in git. I'd rather not let it to the final branch, but the rebase is be necessary. Sorry. I'll take v4 then. Sorry for the extra rebase work. No problem, it was my mistake and your

Re: [PATCH 2/2] btrfs-progs: Add mount point check for 'btrfs fi df' command

2014-07-22 Thread David Sterba
On Mon, Jul 07, 2014 at 08:44:56AM +0800, Qu Wenruo wrote: The 'fi usage' is supposed to give the user-friendly overview, but the patchset is stuck because I found the numbers wrong or misleading under some circumstances. Although these patchset may not be merged, I'm curious about the wrong

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-22 Thread TM
Wang Shilong wangsl.fnst at cn.fujitsu.com writes: The latest btrfs-progs include man page of btrfs-replace. Actually, you could use it something like: btrfs replace start srcdev|devid targetdev mnt You could use 'btrfs file show' to see missing device id. and then run btrfs

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to without the patch I got same results with

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-22 Thread Stefan Behrens
On Tue, 22 Jul 2014 14:43:45 + (UTC), Tm wrote: Wang Shilong wangsl.fnst at cn.fujitsu.com writes: The latest btrfs-progs include man page of btrfs-replace. Actually, you could use it something like: btrfs replace start srcdev|devid targetdev mnt You could use 'btrfs file show'

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Marc MERLIN
On Tue, Jul 22, 2014 at 10:53:03AM -0400, Chris Mason wrote: Thanks for the help in tracking this down everyone. We'll get there! Are you all running multi-disk systems (from a btrfs POV, more than one device?) I don't care how many physical drives this maps to, just does btrfs think there's

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-22 Thread Chris Murphy
On Jul 21, 2014, at 8:51 PM, Duncan 1i5t5.dun...@cox.net wrote: It does not matter at all what the average file size is. … and the filesize /does/ matter. I'm not sure how. A rebuild is replicating chunks, not doing the equivalent of cp or rsync on files. Copying chunks (or strips of

Re: [PATCH RFC] btrfs: code optimize use btrfs_get_bdev_and_sb() at btrfs_scan_one_device

2014-07-22 Thread David Sterba
On Tue, Jul 08, 2014 at 02:38:37AM +0800, Anand Jain wrote: (for review comments pls). btrfs_scan_one_device() needs SB, instead of doing it from scratch could use btrfs_get_bdev_and_sb() Please see

Re: [PATCH 1/2] btrfs: syslog when quota is enabled

2014-07-22 Thread David Sterba
On Tue, Jul 08, 2014 at 02:41:28AM +0800, Anand Jain wrote: must syslog when btrfs working config changes so is to support offline investigation of the issues. Missing Signed-off-by line Reviewed-by: David Sterba dste...@suse.cz -- To unsubscribe from this list: send the line unsubscribe

Re: [PATCH 2/2] btrfs: syslog when quota is disabled

2014-07-22 Thread David Sterba
On Tue, Jul 08, 2014 at 02:41:29AM +0800, Anand Jain wrote: Offline investigations of the issues would need to know when quota is disabled. Signed-off-by: Anand Jain anand.j...@oracle.com Reviewed-by: David Sterba dste...@suse.cz -- To unsubscribe from this list: send the line unsubscribe

Re: [PATCH v2] btrfs-progs: Add mount point output for 'btrfs fi df' command.

2014-07-22 Thread David Sterba
On Wed, Jul 09, 2014 at 02:56:57PM +0800, Qu Wenruo wrote: Add mount point output for 'btrfs fi df'. Also since the patch uses find_mount_root() to find mount point, now 'btrfs fi df' can output more meaningful error message when given a non-btrfs path. If a non-btrfs path is passed, the

Re: [PATCH] xfstests/btrfs: add test for quota groups and drop snapshot

2014-07-22 Thread David Sterba
On Wed, Jul 09, 2014 at 03:41:50PM -0700, Mark Fasheh wrote: +$BTRFS_UTIL_PROG fi sy $SCRATCH_MNT +$BTRFS_UTIL_PROG su sna $SCRATCH_MNT $SCRATCH_MNT/snap1 +$BTRFS_UTIL_PROG qu en $SCRATCH_MNT +$BTRFS_UTIL_PROG su de $SCRATCH_MNT/snap1 Please spell the full names of the subcommands. -- To

Re: [PATCH] xfstests/btrfs: add test for quota groups and drop snapshot

2014-07-22 Thread David Sterba
On Thu, Jul 10, 2014 at 12:00:55PM -0700, Mark Fasheh wrote: On Thu, Jul 10, 2014 at 11:32:28AM -0700, Zach Brown wrote: On Thu, Jul 10, 2014 at 10:36:14AM -0700, Mark Fasheh wrote: On Thu, Jul 10, 2014 at 10:43:30AM +1000, Dave Chinner wrote: On Wed, Jul 09, 2014 at 03:41:50PM -0700,

Re: [PATCH] xfstests/btrfs: add test for quota groups and drop snapshot

2014-07-22 Thread David Sterba
On Thu, Jul 10, 2014 at 12:00:55PM -0700, Mark Fasheh wrote: On Thu, Jul 10, 2014 at 11:32:28AM -0700, Zach Brown wrote: What interfaces would be needed for this to work precisely so we don't have to play this game ever again? Well there's also the 'sleep 45' below because we need to be

Re: [PATCH RESEND 1/4] btrfs-progs: Check fstype in find_mount_root()

2014-07-22 Thread David Sterba
On Thu, Jul 10, 2014 at 11:05:10AM +0800, Qu Wenruo wrote: When calling find_mount_root(), caller in fact wants to find the mount point of *BTRFS*. So also check ent-fstype in find_mount_root() and output proper error messages if needed. The utils.c functions should be mostly silent about

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep racing`) compared to

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/22/2014 03:42 PM, Torbjørn wrote: On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Torbjørn
On 07/22/2014 09:50 PM, Chris Mason wrote: On 07/22/2014 03:42 PM, Torbjørn wrote: On 07/22/2014 04:53 PM, Chris Mason wrote: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/

Re: 1 week to rebuid 4x 3TB raid10 is a long time!

2014-07-22 Thread TM
Stefan Behrens sbehrens at giantdisaster.de writes: TM, Just read the man-page. You could have used the replace tool after physically removing the failing device. Quoting the man page: If the source device is not available anymore, or if the -r option is set, the data is built only using

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Martin Steigerwald
Am Dienstag, 22. Juli 2014, 10:53:03 schrieb Chris Mason: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no extra error messages printed (`dmesg | grep

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Chris Mason
On 07/22/2014 05:13 PM, Martin Steigerwald wrote: Am Dienstag, 22. Juli 2014, 10:53:03 schrieb Chris Mason: On 07/19/2014 02:23 PM, Martin Steigerwald wrote: Running 3.15.6 with this patch applied on top: - still causes a hang with `rsync -hPaHAXx --del /mnt/home/nyx/ /home/nyx/` - no

Re: btrfs kernel workqueues performance regression

2014-07-22 Thread Dave Chinner
On Tue, Jul 15, 2014 at 01:39:11PM -0400, Chris Mason wrote: On 07/15/2014 11:26 AM, Morten Stevens wrote: Hi, I see that btrfs is using kernel workqueues since linux 3.15. After some tests I noticed performance regressions with fs_mark. mount options:

Re: [BUG] Quota Ignored On write problem still exist with 3.16-rc5

2014-07-22 Thread Satoru Takeuchi
Hi Wang, (2014/07/18 19:29), Wang Shilong wrote: On 07/18/2014 04:45 PM, Satoru Takeuchi wrote: Hi Josef, Chris, I found Quota Ignored On write problem still exist with 3.16-rc5, which Kevin reported before. Kevin's report:

Re: Blocked tasks on 3.15.1

2014-07-22 Thread Rich Freeman
On Tue, Jul 22, 2014 at 10:53 AM, Chris Mason c...@fb.com wrote: Thanks for the help in tracking this down everyone. We'll get there! Are you all running multi-disk systems (from a btrfs POV, more than one device?) I don't care how many physical drives this maps to, just does btrfs think

Re: [PATCH RESEND 1/4] btrfs-progs: Check fstype in find_mount_root()

2014-07-22 Thread Qu Wenruo
David, thanks for all the comments about the 'fi di' related patchset. Original Message Subject: Re: [PATCH RESEND 1/4] btrfs-progs: Check fstype in find_mount_root() From: David Sterba dste...@suse.cz To: Qu Wenruo quwen...@cn.fujitsu.com Date: 2014年07月23日 03:15 On Thu, Jul

Re: [PATCH v2] btrfs-progs: Add mount point output for 'btrfs fi df' command.

2014-07-22 Thread Qu Wenruo
Original Message Subject: Re: [PATCH v2] btrfs-progs: Add mount point output for 'btrfs fi df' command. From: David Sterba dste...@suse.cz To: Qu Wenruo quwen...@cn.fujitsu.com Date: 2014年07月23日 01:56 On Wed, Jul 09, 2014 at 02:56:57PM +0800, Qu Wenruo wrote: Add mount point

BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Chris Murphy
3.16.0-0.rc6.git0.1.fc21.1.x86_64 btfs-progs 3.14.2 Fortunately this is a test system so it is dispensable. But in just an hour I ran into 5 bugs, and managed to apparently completely destroy a btrfs file system beyond repair, and it wasn't intentional. 1. mkfs.btrfs /dev/sda6 ## volume's

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Chris Murphy
Interesting, if I remove /dev/sdc (the hdd), then this command works: [root@localhost ~]# mount -o degraded,recovery /dev/sdb /mnt [root@localhost ~]# btrfs replace status /mnt 72.1% done, 0 write errs, 0 uncorr. read errs 72.1% done, 0 write errs, 0 uncorr. read errs^C ## above command hangs,

Re: [BUG] Quota Ignored On write problem still exist with 3.16-rc5

2014-07-22 Thread Wang Shilong
Hi Satoru-san, On 07/23/2014 08:53 AM, Satoru Takeuchi wrote: Hi Wang, (2014/07/18 19:29), Wang Shilong wrote: On 07/18/2014 04:45 PM, Satoru Takeuchi wrote: Hi Josef, Chris, I found Quota Ignored On write problem still exist with 3.16-rc5, which Kevin reported before. Kevin's report:

[BUG] bogus out of space reported when mounted raid1 degraded

2014-07-22 Thread Chris Murphy
On Jul 22, 2014, at 7:34 PM, Chris Murphy li...@colorremedies.com wrote: BUG 1: The df command is clearly bogus six ways to Sunday. It's a 12.58 GiB partition, only 6.78GiB used, thus 5.8GiB free, yet df and apparently gvfs think it's full, maybe systemd too because the journal wigged out

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Eric Sandeen
This one (your bug #4) was likely caused by: commit 4cde9c59c2b8bb67d46d531b26cc73e39747 Author: Anand Jain anand.j...@oracle.com Date: Tue Jun 3 11:36:00 2014 +0800 btrfs: dev delete should remove sysfs entry and hopefully fixed by: commit 0bfaa9c5cb479cebc24979b384374fe47500b4c9

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Liu Bo
On Tue, Jul 22, 2014 at 07:34:58PM -0600, Chris Murphy wrote: 3.16.0-0.rc6.git0.1.fc21.1.x86_64 btfs-progs 3.14.2 Fortunately this is a test system so it is dispensable. But in just an hour I ran into 5 bugs, and managed to apparently completely destroy a btrfs file system beyond repair,

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Chris Murphy
On Jul 22, 2014, at 9:01 PM, Liu Bo bo.li@oracle.com wrote: so then he gets curious about replacing the missing disk== 7. btrfs replace start 2 /dev/sdb1 / ## this is a ~13GB partition that matches the size of the missing device This completes, no disk

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Chris Murphy
On Jul 22, 2014, at 8:52 PM, Eric Sandeen sand...@redhat.com wrote: This one (your bug #4) was likely caused by: commit 4cde9c59c2b8bb67d46d531b26cc73e39747 Author: Anand Jain anand.j...@oracle.com Date: Tue Jun 3 11:36:00 2014 +0800 btrfs: dev delete should remove sysfs entry

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Liu Bo
On Tue, Jul 22, 2014 at 09:28:52PM -0600, Chris Murphy wrote: On Jul 22, 2014, at 8:52 PM, Eric Sandeen sand...@redhat.com wrote: This one (your bug #4) was likely caused by: commit 4cde9c59c2b8bb67d46d531b26cc73e39747 Author: Anand Jain anand.j...@oracle.com Date: Tue Jun 3

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Chris Murphy
On Jul 22, 2014, at 9:36 PM, Liu Bo bo.li@oracle.com wrote: On Tue, Jul 22, 2014 at 09:28:52PM -0600, Chris Murphy wrote: On Jul 22, 2014, at 8:52 PM, Eric Sandeen sand...@redhat.com wrote: This one (your bug #4) was likely caused by: commit 4cde9c59c2b8bb67d46d531b26cc73e39747

Re: BUGS: bogus out of space reported when mounted raid1 degraded, btrfs replace failure, then oops

2014-07-22 Thread Eric Sandeen
On 7/22/14, 10:36 PM, Liu Bo wrote: On Tue, Jul 22, 2014 at 09:28:52PM -0600, Chris Murphy wrote: On Jul 22, 2014, at 8:52 PM, Eric Sandeen sand...@redhat.com wrote: This one (your bug #4) was likely caused by: commit 4cde9c59c2b8bb67d46d531b26cc73e39747 Author: Anand Jain

Re: [BUG] bogus out of space reported when mounted raid1 degraded

2014-07-22 Thread Duncan
Chris Murphy posted on Tue, 22 Jul 2014 20:36:55 -0600 as excerpted: On Jul 22, 2014, at 7:34 PM, Chris Murphy li...@colorremedies.com wrote: BUG 1: The df command is clearly bogus six ways to Sunday. It's a 12.58 GiB partition, only 6.78GiB used, thus 5.8GiB free, yet df and apparently

[PATCH 1/4] btrfs-progs: Remove fprintf() in find_mount_root().

2014-07-22 Thread Qu Wenruo
find_mount_root() function in utils.c should not print error string. Caller should be responsible to print error string. This patch will remove the only fprintf in find_mount_root() and modify the caller a little to use strerror() to prompt users. Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com

[PATCH v3 4/4] btrfs-progs: Add mount point output for 'btrfs fi df'

2014-07-22 Thread Qu Wenruo
Add mount point output for 'btrfs fi df'. Also since the patch uses find_mount_root() to find mount point, now 'btrfs fi df' can output more meaningful error message when given a non-btrfs path. Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com --- changelog: v2: Call realpath() before

[PATCH 3/4] btrfs-progs: Fix wrong indent in btrfs-progs.

2014-07-22 Thread Qu Wenruo
When editing cmds-filesystem.c, I found cmd_filesystem_df() uses 7 spaces as indent instead of 1 tab (or 8 spaces). which makes indent quite embarrassing. Such problem is especillay hard to detect when reviewing patches, since the leading '+' makes a tab only 7 spaces long, makeing 7 spaces look

[PATCH v2 2/4] btrfs-progs: Check fstype in find_mount_root()

2014-07-22 Thread Qu Wenruo
When calling find_mount_root(), caller in fact wants to find the mount point of *BTRFS*. So also check ent-fstype in find_mount_root() and do special error string output in caller. This will suppress a lot of Inapproiate ioctl for device error message. Signed-off-by: Qu Wenruo