2.6.29-rc2 oops and assertion failure...

2011-04-07 Thread Daniel J Blueman
When running a practical stress-test on 2.6.29-rc2 trying to reproduce an older (extent refcounting) issue, I am consistently able to hit an oops [1] and an assertion failure [2]. Here, I'm testing with 8 block ramdisks, configured in the kernel to 256MB each (intentionally testing free-space

[RFC][PATCH] Btrfs: about chunk tree backups

2011-04-07 Thread WuBo
hi,all I've been diging into the idea of chunk tree backups. Here is the predesign, before finishing chunk alloc, the first block in this chunk will be written in some information, these information will be useful for chunk tree rebuilding if crash, also the first block will be moved into

Re: BUG: unable to handle kernel NULL pointer dereference at (null)

2011-04-07 Thread Johannes Hirte
On Wednesday 06 April 2011 19:15:41 Josef Bacik wrote: On Wed, Apr 06, 2011 at 01:10:38PM +0200, Johannes Hirte wrote: On Tuesday 05 April 2011 23:57:53 Josef Bacik wrote: Now it hit Man I cannot catch a break. I hope this is the last one. Thanks, Ok I give up, I just cleaned it

2.6.39-rc1: btrfs WARNING: at fs/btrfs/inode.c:2177

2011-04-07 Thread Jeff Wu
Hi , I run iozone stress test on a ceph client for x86_64, ceph 0.26 + linux-2.6.39-rc1 server, printk WARNING: at fs/btrfs/inode.c:2177 1.log1 : ... [ 1663.370008] CE: hpet2 increased min_delta_ns to 7500 nsec [ 1663.375399] CE: hpet2

Re: 2.6.39-rc1: btrfs WARNING: at fs/btrfs/inode.c:2177

2011-04-07 Thread Wido den Hollander
Hi, On Thu, 2011-04-07 at 17:41 +0800, Jeff Wu wrote: Hi , I run iozone stress test on a ceph client for x86_64, ceph 0.26 + linux-2.6.39-rc1 server, printk WARNING: at fs/btrfs/inode.c:2177 1.log1 : This is a known issue, see: http://tracker.newdream.net/issues/563 It has been passed

[PATCH] btrfs-progs: cast u64 to long long to avoid printf warnings

2011-04-07 Thread Anton Blanchard
When building on ppc64 I hit a number of warnings in printf: btrfs-map-logical.c:69: error: format ‘%Lu’ expects type ‘long long unsigned int’, but argument 4 has type ‘u64’ Fix them. Signed-off-by: Anton Blanchard an...@samba.org --- diff --git a/btrfs-list.c b/btrfs-list.c index

Re: BUG: unable to handle kernel NULL pointer dereference at (null)

2011-04-07 Thread Josef Bacik
On Wed, Apr 06, 2011 at 02:47:28PM -0600, Jordan Patterson wrote: Hi Josef: I tried your latest patch, since I had the same issue from the first email. With the patch applied, I am now hitting the BUG_ON(block_group-total_bitmaps = max_bitmaps); in add_new_bitmap in

Re: BUG: unable to handle kernel NULL pointer dereference at (null)

2011-04-07 Thread Jordan Patterson
On Thu, Apr 7, 2011 at 9:44 AM, Jordan Patterson jord...@gmail.com wrote: On Thu, Apr 7, 2011 at 7:17 AM, Josef Bacik jo...@redhat.com wrote: On Wed, Apr 06, 2011 at 02:47:28PM -0600, Jordan Patterson wrote: Hi Josef: I tried your latest patch, since I had the same issue from the first

[PATCH] Btrfs: deal with the case that we run out of space in the cache

2011-04-07 Thread Josef Bacik
Currently we don't handle running out of space in the cache, so to fix this we keep track of how far in the cache we are. Then we only dirty the pages if we successfully modify all of them, otherwise if we have an error or run out of space we can just drop them and not worry about the vm writing

Re: 2.6.39-rc1: btrfs WARNING: at fs/btrfs/inode.c:2177

2011-04-07 Thread Josef Bacik
On 04/07/2011 05:41 AM, Jeff Wu wrote: Hi , I run iozone stress test on a ceph client for x86_64, ceph 0.26 + linux-2.6.39-rc1 server, printk WARNING: at fs/btrfs/inode.c:2177 Crap I was hoping I had fixed this, could you run with this debug patch and get me the output so I can figure out

Re: 2.6.29-rc2 oops and assertion failure...

2011-04-07 Thread Josef Bacik
On 04/07/2011 03:21 AM, Daniel J Blueman wrote: When running a practical stress-test on 2.6.29-rc2 trying to reproduce an older (extent refcounting) issue, I am consistently able to hit an oops [1] and an assertion failure [2]. Sorry about that, please apply the patch I just sent this morning

[PATCH v3 0/8] Balance management

2011-04-07 Thread Hugo Mills
Hi, Chris, This is a rebased version of my original balance management patches to the latest kernel. I also include a series of patches which introduce filtered or partial balances. With these patches, it is possible to rebalance chunks on the basis of: * their chunk flags * residency on

[PATCH v4 8/8] btrfs: Balance filter for physical device address

2011-04-07 Thread Hugo Mills
Add a filter for balancing which allows the selection of chunks with data in the given byte range on any block device in the filesystem. On its own, this filter is of little use, but when used with the devid filter, it can be used to rebalance all chunks which lie on a part of a specific device.

[PATCH v4 3/8] btrfs: Factor out enumeration of chunks to a separate function

2011-04-07 Thread Hugo Mills
The main balance function has two loops which are functionally identical in their looping mechanism, but which perform a different operation on the chunks they loop over. To avoid repeating code more than necessary, factor this loop out into a separate iterator function which takes a function

[PATCH v4 4/8] btrfs: Implement filtered balance ioctl

2011-04-07 Thread Hugo Mills
The filtered balance ioctl provides a facility to perform a balance operation on a subset of the chunks in the filesystem. This patch implements the base ioctl for this operation, and one filter type. The filter in this patch selects chunks on the basis of their chunk flags field, and can select

[PATCH v4 1/8] btrfs: Balance progress monitoring

2011-04-07 Thread Hugo Mills
This patch introduces a basic form of progress monitoring for balance operations, by counting the number of block groups remaining. The information is exposed to userspace by an ioctl. Signed-off-by: Hugo Mills h...@carfax.org.uk --- fs/btrfs/ctree.h |9 +++ fs/btrfs/disk-io.c |2 +

[PATCH v4 5/8] btrfs: Balance filter for device ID

2011-04-07 Thread Hugo Mills
Balance filter to take only chunks which have (or had) a stripe on the given device. Useful if a device has been forcibly removed from the filesystem, and the data from that device needs rebuilding. Signed-off-by: Hugo Mills h...@carfax.org.uk --- fs/btrfs/ioctl.h |8 ++--

[PATCH v4 2/8] btrfs: Cancel filesystem balance

2011-04-07 Thread Hugo Mills
This patch adds an ioctl for cancelling a btrfs balance operation mid-flight. The ioctl simply sets a flag, and the operation terminates after the current block group move has completed. Signed-off-by: Hugo Mills h...@carfax.org.uk --- fs/btrfs/ctree.h |1 + fs/btrfs/ioctl.c | 28

Re: [PATCH v4 1/8] btrfs: Balance progress monitoring

2011-04-07 Thread Josef Bacik
On 04/07/2011 01:06 PM, Hugo Mills wrote: This patch introduces a basic form of progress monitoring for balance operations, by counting the number of block groups remaining. The information is exposed to userspace by an ioctl. Signed-off-by: Hugo Millsh...@carfax.org.uk --- fs/btrfs/ctree.h

Re: [PATCH v4 3/8] btrfs: Factor out enumeration of chunks to a separate function

2011-04-07 Thread Josef Bacik
On 04/07/2011 01:06 PM, Hugo Mills wrote: The main balance function has two loops which are functionally identical in their looping mechanism, but which perform a different operation on the chunks they loop over. To avoid repeating code more than necessary, factor this loop out into a separate

Re: [PATCH v4 1/8] btrfs: Balance progress monitoring

2011-04-07 Thread Li Zefan
01:06, Hugo Mills wrote: This patch introduces a basic form of progress monitoring for balance operations, by counting the number of block groups remaining. The information is exposed to userspace by an ioctl. Signed-off-by: Hugo Mills h...@carfax.org.uk --- fs/btrfs/ctree.h |9

Re: 2.6.29-rc2 oops and assertion failure...

2011-04-07 Thread Daniel J Blueman
Hi Josef, Chris, On 8 April 2011 00:23, Josef Bacik jo...@redhat.com wrote: On 04/07/2011 03:21 AM, Daniel J Blueman wrote: When running a practical stress-test on 2.6.29-rc2 trying to reproduce an older (extent refcounting) issue, I am consistently able to hit an oops [] and an assertion

Re: 2.6.39-rc1: btrfs WARNING: at fs/btrfs/inode.c:2177

2011-04-07 Thread Jeff Wu
Hi , I applied the patch to 2.6.39-rc1,took the following steps to compile it:make make modules_install make install mkinitramfs but , it seam that it don't run to WARN_ON(block_rsv == root-orphan_block_rsv); i attached the codes and logs at the below: