Re: Btrfs RAID 1 Very poor file re read cache

2015-03-25 Thread Duncan
Chris Severance posted on Tue, 24 Mar 2015 00:00:32 -0400 as excerpted: System: Thinkserver TS140 E3-1225, 32GB ECC RAM, LSI9211-8i (IT unraid), 2 WD xe SAS as mdraid-raid1-ext4, 2 WD xe SAS as btrfs-raid1 Linux xyzzy 3.19.2-1-ARCH #1 SMP PREEMPT Wed Mar 18 16:21:02 CET 2015 x86_64

btrfs-transacti causing IO problem to btrfs

2015-03-25 Thread Ian Gordon
Hello, I have a btrfs filesystem which has been working ok for about 90days, but on Monday it become very slow (takes about 6hours to rsync backup a 3GB Ubuntu server - despite minimal changes from previous backup). I noticed, that even with no processes reading or writing to the filesystem,

Re: btrfs-transacti causing IO problem to btrfs (skinny-metadata?)

2015-03-25 Thread Martin
On 25/03/15 08:29, Ian Gordon wrote: Hello, I have a btrfs filesystem which has been working ok for about 90days, but on Monday it become very slow (takes about 6hours to rsync backup a 3GB Ubuntu server - despite minimal changes from previous backup). I noticed, that even with no

Re: [PATCH 3/3] fstests: btrfs balance with dm log writes test

2015-03-25 Thread Filipe David Manana
On Thu, Mar 19, 2015 at 8:31 PM, Josef Bacik jba...@fb.com wrote: This test runs fsstress+balance+defrag and then replays every FUA in the log and mounts, scrubs and then fscks the fs to make sure it does the balance recovery properly. Thanks, Signed-off-by: Josef Bacik jba...@fb.com

Re: [PATCH] fstests: btrfs test for incremental send with directory renames

2015-03-25 Thread David Sterba
On Sat, Feb 28, 2015 at 09:04:50PM +, Filipe Manana wrote: Test for incremental send where the difference between the parent and child snapshots is that a directory A was renamed and a directory B was renamed to the name directory A had before (in the parent snapshot), but directory A's

Re: [PATCH] fstests: test for btrfs incremental send/receive

2015-03-25 Thread David Sterba
On Sun, Mar 08, 2015 at 05:51:30PM +, Filipe Manana wrote: Test for incremental send where the difference between the parent and send snapshots is that for a subtree with the same path in both snapshots (p1/p2), the root directories were swapped. This issue was fixed by the following

Re: [PATCH 1/1] btrfs: incorrect handling for fiemap_fill_next_extent return

2015-03-25 Thread Liu Bo
On Tue, Mar 24, 2015 at 06:12:56PM -0400, Chengyu Song wrote: fiemap_fill_next_extent returns 0 on success, -errno on error, 1 if this was the last extent that will fit in user array. If 1 is returned, the return value may eventually returned to user space, which should not happen, according

[PATCH] btrfs: fix build breakage

2015-03-25 Thread Lad Prabhakar
From: Lad, Prabhakar prabhakar.cse...@gmail.com this patch adds necessary include file, fixing following build errors: fs/btrfs/inode.c:8094:13: error: undefined identifier 'iov_iter_alignment' fs/btrfs/inode.c:8105:33: error: using member 'nr_segs' in incomplete struct iov_iter

Re: [PATCH] btrfs: fix build breakage

2015-03-25 Thread David Sterba
On Wed, Mar 25, 2015 at 04:52:01PM +, Lad Prabhakar wrote: From: Lad, Prabhakar prabhakar.cse...@gmail.com this patch adds necessary include file, fixing following build errors: fs/btrfs/inode.c:8094:13: error: undefined identifier 'iov_iter_alignment' fs/btrfs/inode.c:8105:33: error:

Re: [PATCH] Btrfs: remove empty block groups automatically V3

2015-03-25 Thread David Sterba
Hi Josef, On Thu, Sep 18, 2014 at 11:20:02AM -0400, Josef Bacik wrote: --- a/fs/btrfs/disk-io.c +++ b/fs/btrfs/disk-io.c @@ -1764,6 +1764,7 @@ static int cleaner_kthread(void *arg) } btrfs_run_delayed_iputs(root); +

Btrfs progs release 3.19.1

2015-03-25 Thread David Sterba
Hi, btrfs-progs 3.19.1 have been released. Mostly a bugfix release with an enhancement to convert. User visible changes: - convert: - new option to specify metadata block size - --no-progress actually works - restore: properly handle the page boundary corner case - build fixes: - missing

Re: [PATCH 1/4] btrfs: add missing barriers before waitqueue_active

2015-03-25 Thread Chris Mason
On Tue, Feb 24, 2015 at 11:51 AM, David Sterba dste...@suse.cz wrote: The waitqueue might miss a wakeup due to memory ordering issues, the explicit barrier is required unless there's an implicit one. Thanks for going through these Dave, a few comments below: Signed-off-by: David Sterba

xfstests: btrfs: test for orphan item cleanup

2015-03-25 Thread Jeff Mahoney
This test tests three conditions where orphan items need to be cleaned up: 1) Default subvolume is fs tree root (mkfs default) 2) Default subvolume has been set explicitly to another subvolume (set-default) 3) Looking up a subvolume during a traversal In the kernel, these three cases use separate

[PATCH] btrfs: don't accept bare namespace as a valid xattr

2015-03-25 Thread David Sterba
Due to insufficient check in btrfs_is_valid_xattr, this unexpectedly works: $ touch file $ setfattr -n user. -v 1 file $ getfattr -d file user.=1 ie. the missing attribute name after the namespace. Bugzilla: https://bugzilla.kernel.org/show_bug.cgi?id=94291 Reported-by: William Douglas

Re: [PATCH V2][BTRFS-PROGS] Improve output of mkfs.btrfs command

2015-03-25 Thread Goffredo Baroncelli
On 2015-03-24 00:46, David Sterba wrote: FYI, I've added the following patches to 3.19 queue * btrfs-progs: return the fsid from make_btrfs() * btrfs-progs: add strdup in btrfs_add_to_fsid() to track the device path * btrfs-progs: add verbose option to btrfs_add_to_fsid() * btrfs-progs:

Metadata about to fill up, how to make it bigger next time?

2015-03-25 Thread Anand Patil
Hi everyone, I have a BTRFS filesystem on a 1TB block device, kernel 3.16.2+, tools v3.14_pre20140414. There are many (several thousand) subvolumes, folders and small files. When I run btrfs fi df /path/to/fs, I see: Data, single: total=53.01GiB, used=51.79GiB System, DUP: total=32.00MiB,

Re: Metadata about to fill up, how to make it bigger next time?

2015-03-25 Thread Sean Greenslade
On Wed, Mar 25, 2015 at 04:45:09PM -0700, Anand Patil wrote: Hi everyone, When I run btrfs fi df /path/to/fs, I see: Data, single: total=53.01GiB, used=51.79GiB System, DUP: total=32.00MiB, used=16.00KiB Metadata, DUP: total=16.00GiB, used=14.72GiB My most pressing question is, does

[PATCH] btrfs-progs: Doc: Add warning and note on btrfs-convert.

2015-03-25 Thread Qu Wenruo
Although btrfs-convert can rollback converted btrfs, it still has some limitation to ensure rollback. Add a warning on the limitations. Also add a note for users who decides to go on with btrfs and don't need the rollback ability. Signed-off-by: Qu Wenruo quwen...@cn.fujitsu.com ---

Re: snapshot destruction making IO extremely slow

2015-03-25 Thread Rich Freeman
On Wed, Mar 25, 2015 at 6:55 AM, Marc Cousin cousinm...@gmail.com wrote: On 25/03/2015 02:19, David Sterba wrote: as it reads the pre/post snapshots and deletes them if the diff is empty. This adds some IO stress. I couldn't find a clear explanation in the documentation. Does it mean that

Re: Metadata about to fill up, how to make it bigger next time?

2015-03-25 Thread Duncan
Anand Patil posted on Wed, 25 Mar 2015 16:45:09 -0700 as excerpted: I have a BTRFS filesystem on a 1TB block device, kernel 3.16.2+, tools v3.14_pre20140414. There are many (several thousand) subvolumes, folders and small files. Sean G answered your immediate question (no, about full metadata

Re: snapshot destruction making IO extremely slow

2015-03-25 Thread Marc Cousin
On 25/03/2015 02:19, David Sterba wrote: The snapshots get cleaned in the background, which usuall touches lots of data (depending on the age of the extents, IOW the level of sharing among the live and deleted snapshots). The slowdown is caused due to contention on the metadata (locking,

Re: Recursive subvolume snapshots and deletion?

2015-03-25 Thread Lennart Poettering
On Mon, 23.03.15 08:36, Chris Mason (c...@fb.com) wrote: On Mon, Mar 23, 2015 at 12:57 AM, Lennart Poettering mzerq...@0pointer.de wrote: Heya! So what's the story on recursive btrfs snapshotting and snapshot removal? Since a while systemd has now by default creating btrfs subvolumes for

[PATCH v2] btrfs-progs: Doc: Add warning and note on btrfs-convert.

2015-03-25 Thread Qu Wenruo
Although btrfs-convert can rollback converted btrfs, it still has some limitation to ensure rollback. Add a warning on the limitations. Also add a note for users who decides to go on with btrfs and don't need the rollback ability. Reported-by: Vytautas D vyt...@gmail.com Reported-by: Tsutomu

Re: Metadata about to fill up, how to make it bigger next time?

2015-03-25 Thread Anand Patil
AWESOME. Thanks so much for getting back to me so quickly. On Wed, Mar 25, 2015 at 7:10 PM, Sean Greenslade s...@seangreenslade.com wrote: On Wed, Mar 25, 2015 at 04:45:09PM -0700, Anand Patil wrote: Hi everyone, When I run btrfs fi df /path/to/fs, I see: Data, single: total=53.01GiB,

I think btrfs: fix leak of path in btrfs_find_item broke stable trees ...

2015-03-25 Thread Eric Sandeen
Looks like btrfs: fix leak of path in btrfs_find_item got sent to stable trees, but in my testing, it causes deadlocks on mount: [23379.359246] mount D 0 22541 22274 0x0080 [23379.366326] 8803ebadf6c8 0086 88027ff10230 00013680