Re: [PATCH V4 0/7 ] Btrfs-progs: enhance btrfs subvol list only to show read-only snapshots

2012-10-09 Thread Miao Xie
On Tue, 2 Oct 2012 20:03:04 -0400, Chris Mason wrote: On Tue, Sep 18, 2012 at 04:35:25AM -0600, Miao Xie wrote: We want 'btrfs subvolume list' only to list readonly subvolumes, this patch set introduces a new option 'r' to implement it. You can use the command like that: btrfs

Re: working quota example?

2012-10-09 Thread matthieu Barthélemy
On Mon, Oct 8, 2012 at 9:51 PM, Arne Jansen sensi...@gmx.net wrote: On 10/08/12 21:31, matthieu Barthélemy wrote: Are there any plan to maybe get a better 'btrfs quota show' output? Definitely. The first priority was to get the kernel part running, when that is settled, we can improve the

Re: Anyone seeing lots of Check tree block failed and other errors with latest kernel?

2012-10-09 Thread Richard W.M. Jones
On Mon, Oct 08, 2012 at 08:00:51PM -0400, Chris Mason wrote: On Mon, Oct 08, 2012 at 03:22:30PM -0600, Richard W.M. Jones wrote: I have now reproduced this bug locally. Adding sync() + fsync of each /dev/sd* device after the mkfs command does appear to fix the problem. However

Re: working quota example?

2012-10-09 Thread Arne Jansen
On 09.10.2012 09:13, matthieu Barthélemy wrote: On Mon, Oct 8, 2012 at 9:51 PM, Arne Jansen sensi...@gmx.net wrote: On 10/08/12 21:31, matthieu Barthélemy wrote: Are there any plan to maybe get a better 'btrfs quota show' output? Definitely. The first priority was to get the kernel part

Re: [RFC][PATCH V2 0/4] Btrfs: introduce extent buffer cache to btrfs

2012-10-09 Thread Miao Xie
Any comment? On wed, 26 Sep 2012 19:22:11 +0800, Miao Xie wrote: This patchset introduce extent buffer cache to btrfs. The basic idea is to reduce the search time and the contentions of the extent buffer lock by re-using the last search result. I ran stress.sh, xfstests and some other tools

Re: Anyone seeing lots of Check tree block failed and other errors with latest kernel?

2012-10-09 Thread Richard W.M. Jones
On Tue, Oct 09, 2012 at 08:20:02AM +0100, Richard W.M. Jones wrote: On Mon, Oct 08, 2012 at 08:00:51PM -0400, Chris Mason wrote: On Mon, Oct 08, 2012 at 03:22:30PM -0600, Richard W.M. Jones wrote: I have now reproduced this bug locally. Adding sync() + fsync of each /dev/sd*

Frozen transaction

2012-10-09 Thread Olivier Bonvalet
Hi, on one system I have a frozen transaction since more than 24 hours, without any IO. I can't umount the partition, delete a snapshot or write anything. I try to reboot the system, but the problem is still present. Here the frozen transaction : $ ps auxw | grep btrfs | grep D root 1835

Re: Will RAID have issues with disks that spin down?

2012-10-09 Thread Bart Noordervliet
On Thu, Oct 4, 2012 at 4:36 PM, Ken D'Ambrosio k...@jots.org wrote: Hi. I know that several hardware RAID solutions have issues with disks that spin down when idle; the time to spin back up -- usually on the order of five seconds -- causes unhappy timeouts, etc. I was wondering if that would

Re: ANN: linux-kernel-lzo-2.06.20120123 - update LZO to v2.06

2012-10-09 Thread David Sterba
On Wed, Jan 25, 2012 at 02:36:18AM +0100, Andi Kleen wrote: I ran benchmarks on the new miniLZO and LZ4 on 64bit. LZ4 is generally slower than snappy/lzo in the micro benchmarks. And the reason why you measured worse speed for LZ4 although (AFAICT) everybody else's measurements claim the

Re: Anyone seeing lots of Check tree block failed and other errors with latest kernel?

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 08:33:57AM +0100, Richard W.M. Jones wrote: On Tue, Oct 09, 2012 at 08:20:02AM +0100, Richard W.M. Jones wrote: On Mon, Oct 08, 2012 at 08:00:51PM -0400, Chris Mason wrote: Ok, what's a rough idea of the mainline git equiv of the buggy kernel? On my local

Re: Anyone seeing lots of Check tree block failed and other errors with latest kernel?

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 08:20:02AM +0100, Richard W.M. Jones wrote: On my local machine, I'm reproducing this with what Fedora calls 3.7.0-0.rc0.git2.4.fc19.x86_64 (note I found an unrelated but very serious bug in this kernel: http://marc.info/?l=linux-kernelm=134973394826408w=2 ) And it's

Re: Anyone seeing lots of Check tree block failed and other errors with latest kernel?

2012-10-09 Thread Richard W.M. Jones
On Tue, Oct 09, 2012 at 11:16:57AM +0200, David Sterba wrote: On Tue, Oct 09, 2012 at 08:20:02AM +0100, Richard W.M. Jones wrote: On my local machine, I'm reproducing this with what Fedora calls 3.7.0-0.rc0.git2.4.fc19.x86_64 (note I found an unrelated but very serious bug in this kernel:

Re: [PATCH][BTRFS-PROGS][V1] btrfs filesystem df

2012-10-09 Thread Bart Noordervliet
Hi Goffredo, thank you very much for your work on making the btrfs filesystem df output that much more understandable. It is a real improvement already. I would however like to bring this comment from Hugo to your attention once again: On Wed, Oct 3, 2012 at 1:56 PM, Hugo Mills

Re: Frozen transaction

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 09:37:48AM +0200, Olivier Bonvalet wrote: on one system I have a frozen transaction since more than 24 hours, without any IO. I can't umount the partition, delete a snapshot or write anything. I try to reboot the system, but the problem is still present. The processes

Re: Frozen transaction

2012-10-09 Thread Olivier Bonvalet
Thanks for your reply. On 09/10/2012 11:52, David Sterba wrote: On Tue, Oct 09, 2012 at 09:37:48AM +0200, Olivier Bonvalet wrote: on one system I have a frozen transaction since more than 24 hours, without any IO. I can't umount the partition, delete a snapshot or write anything. I try to

Re: [PATCH 1/2 RESEND] vfs: re-implement writeback_inodes_sb(_nr)_if_idle() and rename them

2012-10-09 Thread David Sterba
On Wed, Sep 05, 2012 at 05:54:04PM +0200, David Sterba wrote: Many users who use btrfs met the deadlock problem caused by writeback_inodes_sb(_nr)_if_idle(), so I send this patch again and hope it will be received as soon as possible if nobody objects. Yes please, this makes testing

Re: btrfs receive to subdirectory

2012-10-09 Thread Rory Campbell-Lange
On 08/10/12, Arne Jansen (sensi...@gmx.net) wrote: On 10/08/12 18:30, Rory Campbell-Lange wrote: I can send snapshots to volume, but not volume/dir. Please advise if what I am doing is incorrect. Try and snap to /mnt/subdir root@orchard:/bkp# mkdir /mnt/snaps root@orchard:/bkp#

Re: [PATCH][BTRFS-PROGS][V1] btrfs filesystem df

2012-10-09 Thread Goffredo Baroncelli
Hi Bart, On Tue, Oct 9, 2012 at 11:43 AM, Bart Noordervliet b...@noordervliet.net wrote: Hi Goffredo, thank you very much for your work on making the btrfs filesystem df output that much more understandable. It is a real improvement already. I would however like to bring this comment from

Re: Frozen transaction

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 12:07:20PM +0200, Olivier Bonvalet wrote: I didn't see any stack entry in /proc/$PID/ ; I will try to find which kernel option export that. CONFIG_STACKTRACE If the problem persists accross reboots, how long after mount does it take to get to this state? Cleaner

Re: Out of memory condition

2012-10-09 Thread Jérôme Poulin
Right now, with the patches applied on 3.5.0, Chrome didn't freeze under out of memory conditions (2 OOM killer invocation). On Fri, Oct 5, 2012 at 4:44 PM, Josef Bacik jba...@fusionio.com wrote: On Fri, Oct 05, 2012 at 02:23:25PM -0600, Jérôme Poulin wrote: I guess I'll be the guy who will

Re: [PATCH][BTRFS-PROGS][V1] btrfs filesystem df

2012-10-09 Thread Bart Noordervliet
On Tue, Oct 9, 2012 at 1:38 PM, Goffredo Baroncelli kreij...@gmail.com wrote: Hi Bart, I replayed in another email to Hugo about that. Basically I am not contrary to the change, only it is unrelated to my patches. In may patches I use the function pretty_sizes() which adds the suffix KB, MB,

Re: [PATCH v4 3/4] btrfs: extended inode refs

2012-10-09 Thread Jan Schmidt
Hi Chris, Hi Mark, I'm currently working on extended inode refs for btrfs send, reading the version of fs/btrfs/backref.c in Chris' next branch. Concerning commit f8728be56e48e4a64ed49a71c66b3e6436869838 ... On Mon, August 20, 2012 at 22:29 (+0200), Mark Fasheh wrote: Teach tree-log.c about

Re: btrfs receive to subdirectory

2012-10-09 Thread Alex Lyakas
Hi Rory, Arne, I think the problem is that currently mnt_fd in struct btrfs_receive is used both as mount root and directory in which the subvolume/snapshot needs to be created. Arne, does the following patch make sense? It uses Jan's find_mount_root function. With this patch both Rory's tests

Re: [PATCH] Btrfs: remove repeated eb-pages check in, disk-io.c/csum_dirty_buffer

2012-10-09 Thread Chris Mason
On Mon, Oct 08, 2012 at 07:26:15AM -0600, Wang Sheng-Hui wrote: In csum_dirty_buffer, we first get eb from page-private. Then we check if the page is the first page of eb. Later we check it again. Remove the repeated check here. You had the right idea here, two checks and one has a warning, so

[solved] Re: Frozen transaction

2012-10-09 Thread Olivier Bonvalet
On 09/10/2012 14:32, David Sterba wrote: On Tue, Oct 09, 2012 at 12:07:20PM +0200, Olivier Bonvalet wrote: I didn't see any stack entry in /proc/$PID/ ; I will try to find which kernel option export that. CONFIG_STACKTRACE CONFIG_STACKTRACE_SUPPORT=y CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y

Re: [PATCH][BTRFS-PROGS][V3] btrfs filesystem df

2012-10-09 Thread David Sterba
Hi, I hope I'm not late to the bikeshedding party, I've tried to use the proposed version and here are my observations/wishes, and also issues, pointed out in the threads, that were not addressed: * I'd like to re-add the -s -d options in some way that I can choose which sections I'll see; the

Re: [solved] Re: Frozen transaction

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 03:49:01PM +0200, Olivier Bonvalet wrote: On 09/10/2012 14:32, David Sterba wrote: On Tue, Oct 09, 2012 at 12:07:20PM +0200, Olivier Bonvalet wrote: I didn't see any stack entry in /proc/$PID/ ; I will try to find which kernel option export that. CONFIG_STACKTRACE

Re: [solved] Re: Frozen transaction

2012-10-09 Thread Olivier Bonvalet
On 09/10/2012 16:07, David Sterba wrote: On Tue, Oct 09, 2012 at 03:49:01PM +0200, Olivier Bonvalet wrote: On 09/10/2012 14:32, David Sterba wrote: On Tue, Oct 09, 2012 at 12:07:20PM +0200, Olivier Bonvalet wrote: I didn't see any stack entry in /proc/$PID/ ; I will try to find which kernel

Re: [PATCH] Btrfs-progs: introduce '-p' option and fullpath into subvolume set-default command

2012-10-09 Thread David Sterba
On Mon, Sep 24, 2012 at 02:42:13PM +0800, Chen Yang wrote: In command btrfs subvolume set-default, we used subvolume id and path to set the default subvolume of a filesystem. It's not easy for a common user, What is not easy? How often do you set-default subvolume that it's a concern to do it

Re: Frozen transaction

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 04:12:54PM +0200, Olivier Bonvalet wrote: What I didn't understand, is that since 24 hours, there was near 0 IO request done on that device. The cleanup processes was just «frozen», not doing anything visible (no CPU and no IO) ; like a deadlock. Yep, it was a deadlock

Re: [PATCH 2/4] btrfs-progs: btrfsck: Print which filesystem to be checked to stdout

2012-10-09 Thread David Sterba
On Mon, Oct 08, 2012 at 09:07:48PM +0200, Dieter Ries wrote: --- a/btrfsck.c +++ b/btrfsck.c @@ -3540,6 +3540,8 @@ int main(int ac, char **av) } else if(ret) { fprintf(stderr, %s is currently mounted. Aborting.\n, av[optind]); return -EBUSY; + } else

Re: [PATCH 3/4] btrfs-progs: btrfsck: Print feedback about fscking to stdout.

2012-10-09 Thread David Sterba
On Mon, Oct 08, 2012 at 09:07:49PM +0200, Dieter Ries wrote: Status reports of the checking process should be printed to stdout instead of stderr, as that is normal program output and not related to problems in btrfsck. I agree that the important messages from fsck process should be printed to

Re: [PATCH V2] Btrfs-progs: add parent uuid for snapshots

2012-10-09 Thread David Sterba
On Fri, Oct 05, 2012 at 10:25:22AM +0800, Anand jain wrote: @@ -128,6 +129,11 @@ struct { .need_print = 0, }, { + .name = puuid, + .column_name= PUUID, the capitalized 'P' looks like it's part of the UUID abbreviation. The

Re: [PATCH V4 0/7 ] Btrfs-progs: enhance btrfs subvol list only to show read-only snapshots

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 02:01:18PM +0800, Miao Xie wrote: On Tue, 2 Oct 2012 20:03:04 -0400, Chris Mason wrote: These are all really useful additions! How do you plan on using the table option? (just curious). It is just used to make the output be read easily. The old output always throw

[PATCH 1/4] btrfs-progs: upcase filter options

2012-10-09 Thread David Sterba
Rename filter options in 'subvol list' subcommand, that way we can distinguish them from the options that just show some option in the output and can have a matching uppercase filter. Signed-off-by: David Sterba dste...@suse.cz --- cmds-subvolume.c | 17 +++-- 1 files changed, 11

[PATCH 2/4] btrfs-progs: add option g to show generation, do not show it by default

2012-10-09 Thread David Sterba
The generation was not printed so far, and adding 'g' will pair the 'G' filter. Signed-off-by: David Sterba dste...@suse.cz --- btrfs-list.c |2 +- cmds-subvolume.c |8 ++-- 2 files changed, 7 insertions(+), 3 deletions(-) diff --git a/btrfs-list.c b/btrfs-list.c index

[PATCH 3/4] btrfs-progs: add option c to show ogeneration

2012-10-09 Thread David Sterba
This will also pair the 'C' filter. Signed-off-by: David Sterba dste...@suse.cz --- cmds-subvolume.c |8 ++-- 1 files changed, 6 insertions(+), 2 deletions(-) diff --git a/cmds-subvolume.c b/cmds-subvolume.c index a2dece6..7a0b49f 100644 --- a/cmds-subvolume.c +++ b/cmds-subvolume.c @@

[PATCH 4/4] btrfs-progs: update man pages of subvol list

2012-10-09 Thread David Sterba
- rename to match code where applicable - add missing - unify the help strings in short and detailed sections - fix a few typos Signed-off-by: David Sterba dste...@suse.cz --- man/btrfs.8.in | 24 +++- 1 files changed, 15 insertions(+), 9 deletions(-) diff --git

Re: [PATCH][BTRFS-PROGS][V3] btrfs filesystem df

2012-10-09 Thread Goffredo Baroncelli
Hi David, On 10/09/2012 03:51 PM, David Sterba wrote: Hi, I hope I'm not late to the bikeshedding party, I've tried to use the proposed version and here are my observations/wishes, and also issues, pointed out in the threads, that were not addressed: * I'd like to re-add the -s -d options in

Re: [PATCH][BTRFS-PROGS][V1] btrfs filesystem df

2012-10-09 Thread Goffredo Baroncelli
On 10/09/2012 02:51 PM, Bart Noordervliet wrote: On Tue, Oct 9, 2012 at 1:38 PM, Goffredo Baroncellikreij...@gmail.com wrote: Hi Bart, I replayed in another email to Hugo about that. Basically I am not contrary to the change, only it is unrelated to my patches. In may patches I use the

Re: [PATCH v4 3/4] btrfs: extended inode refs

2012-10-09 Thread Mark Fasheh
On Tue, Oct 09, 2012 at 02:52:29PM +0200, Jan Schmidt wrote: Hi Chris, Hi Mark, I'm currently working on extended inode refs for btrfs send, reading the version of fs/btrfs/backref.c in Chris' next branch. Concerning commit f8728be56e48e4a64ed49a71c66b3e6436869838 ... On Mon, August 20,

Re: [PATCH 0/3] Update LZO compression

2012-10-09 Thread Andrew Morton
On Sun, 7 Oct 2012 17:07:55 +0200 Markus F.X.J. Oberhumer mar...@oberhumer.com wrote: As requested by akpm I am sending my lzo-update branch at git://github.com/markus-oberhumer/linux.git lzo-update to lkml as a patch series created by git format-patch -M v3.5..lzo-update. You can

Re: [PATCH 0/3] Update LZO compression

2012-10-09 Thread Markus F.X.J. Oberhumer
Hi Stephen, On 2012-10-09 21:26, Andrew Morton wrote: On Sun, 7 Oct 2012 17:07:55 +0200 Markus F.X.J. Oberhumer mar...@oberhumer.com wrote: As requested by akpm I am sending my lzo-update branch at git://github.com/markus-oberhumer/linux.git lzo-update to lkml as a patch series created

[GIT PULL] Btrfs

2012-10-09 Thread Chris Mason
Hi Linus, This is a large pull, with the bulk of the updates coming from: * Hole punching * send/receive fixes * fsync performance * Disk format extension allowing more hardlinks inside a single directory (btrfs-progs patch required to enable the compat bit for this one) I'm cooking more

Re: [PATCH][BTRFS-PROGS][V3] btrfs filesystem df

2012-10-09 Thread David Sterba
On Tue, Oct 09, 2012 at 08:07:51PM +0200, Goffredo Baroncelli wrote: There was several emails about this topic. At the end we find more logical to avoid the options. See the thread [PATCH][BTRFS-PROGS][V3] btrfs filesystem df for the reasons. I had read all the threads before I responded to

Re: [PATCH 0/3] Update LZO compression

2012-10-09 Thread Stephen Rothwell
Hi Markus, On Tue, 09 Oct 2012 21:54:59 +0200 Markus F.X.J. Oberhumer mar...@oberhumer.com wrote: On 2012-10-09 21:26, Andrew Morton wrote: On Sun, 7 Oct 2012 17:07:55 +0200 Markus F.X.J. Oberhumer mar...@oberhumer.com wrote: As requested by akpm I am sending my lzo-update branch at

[PATCH v3 1/2] btrfs-progs: limit the max value of leafsize and nodesize

2012-10-09 Thread Robin Dong
From: Robin Dong san...@taobao.com Using mkfs.btrfs like: mkfs.btrfs -l 131072 /dev/sda will return no error, but after mount it, the dmesg will report: BTRFS: couldn't mount because metadata blocksize (131072) was too large The leafsize and nodesize are equal at present, so

[PATCH v3 2/2] btrfs-progs: limit the min value of total_bytes

2012-10-09 Thread Robin Dong
From: Robin Dong san...@taobao.com Using mkfs.btrfs like: mkfs.btrfs -b 1048576 /dev/sda will report error: mkfs.btrfs: volumes.c:796: btrfs_alloc_chunk: Assertion `!(ret)' failed. Aborted because the length of dev_extent is 4MB. For the single/single case it's 5MB