Re: 3.14.0-rc3 btrfs scrub is preventing my laptop from going to sleep

2014-03-03 Thread Marc MERLIN
On Mon, Mar 03, 2014 at 02:50:33PM +0800, Wang Shilong wrote: > >Here's the log of failure: > >http://marc.merlins.org/tmp/btrfs_nofreeze2.txt > > Unfortunately, i could not reproduce this problem here. > > It should not be the problem that i addressed before, there is not > deadlock here. > try

Re: 3.14.0-rc3 btrfs scrub is preventing my laptop from going to sleep

2014-03-02 Thread Marc MERLIN
On Mon, Mar 03, 2014 at 11:17:51AM +0800, Wang Shilong wrote: > Hi Marc, > > On 03/01/2014 11:22 PM, Marc MERLIN wrote: > >On Fri, Feb 28, 2014 at 09:09:37PM -0800, Marc MERLIN wrote: > >>On Fri, Feb 28, 2014 at 09:18:06AM +0800, Wang Shilong wrote: > >>>Coul

Re: 3.14.0-rc3 btrfs scrub is preventing my laptop from going to sleep

2014-03-01 Thread Marc MERLIN
On Fri, Feb 28, 2014 at 09:09:37PM -0800, Marc MERLIN wrote: > On Fri, Feb 28, 2014 at 09:18:06AM +0800, Wang Shilong wrote: > > Could you run the following command when scrub is blocked, we can know more > > why scrub is blocked here. > > > > # echo w > /proc/sy

Re: 3.14.0-rc3 btrfs scrub is preventing my laptop from going to sleep

2014-02-27 Thread Marc MERLIN
On Thu, Feb 27, 2014 at 11:06:56AM -0800, Marc MERLIN wrote: > This does not happen consistently, but sometimes: > > PM: Preparing system for mem sleep > Freezing user space processes ... > (...) > Freezing of tasks failed after 20.002 seconds (1 tasks refusing to fr

3.14.0-rc3 btrfs scrub is preventing my laptop from going to sleep

2014-02-27 Thread Marc MERLIN
This does not happen consistently, but sometimes: PM: Preparing system for mem sleep Freezing user space processes ... (...) Freezing of tasks failed after 20.002 seconds (1 tasks refusing to freeze, wq_busy=0): btrfs D 88017639c800 0 12239 12224 0x0084 880165ec196

Re: 3.14.0rc3: did not find backref in send_root

2014-02-26 Thread Marc MERLIN
On Wed, Feb 26, 2014 at 03:51:37PM +0800, Wang Shilong wrote: > >I've applied your patch from > >https://git.kernel.org/cgit/linux/kernel/git/josef/btrfs-next.git/commit/?id=1334bebe71bebbca47b3b92f25511ea980fdeab8 I can confirm this fixed the btrfs send error on my server, thank you. > >At snaps

Re: 3.14.0rc3: did not find backref in send_root

2014-02-25 Thread Marc MERLIN
On Wed, Feb 26, 2014 at 11:38:30AM +0800, Wang Shilong wrote: > Hi Marc, > > On 02/26/2014 01:30 AM, Marc MERLIN wrote: > >On Tue, Feb 25, 2014 at 03:50:15PM +0800, Wang Shilong wrote: > >>Hi Marc, > >> > >>This seems a regression which has been fixed by

Re: 3.14.0rc3: btrfs send ioctl failed with -5: Input/output error

2014-02-25 Thread Marc MERLIN
On Tue, Feb 25, 2014 at 03:50:15PM +0800, Wang Shilong wrote: > Hi Marc, > > This seems a regression which has been fixed by the following > commit(only pushed into btrfs-next): > > https://git.kernel.org/cgit/linux/kernel/git/josef/btrfs-next.git/commit/?id=1334bebe71bebbca47b3b92f25511ea980fdea

Re: btrfs userland interface isn't 32/64bit clean (breaks lsattr and btrfs send)

2014-02-24 Thread Marc MERLIN
On Mon, Feb 24, 2014 at 08:43:44AM +, Duncan wrote: > Hugo Mills posted on Mon, 24 Feb 2014 08:29:38 + as excerpted: > > > On Mon, Feb 24, 2014 at 06:32:14AM +, Duncan wrote: > >> > >> This is a known issue. There's patches in the pipeline for 32-bit > >> userspace on a 64-bit kernel

3.14.0rc3: did not find backref in send_root

2014-02-24 Thread Marc MERLIN
I got this during a btrfs send: BTRFS error (device dm-2): did not find backref in send_root. inode=22672, offset=524288, disk_byte=1490517954560 found extent=1490517954560 I'll try a scrub when I've finished my backup, but is there anything I can run on the file I've found from the inode? garga

Re: 3.14rc3 kernel also hangs some processes with btrfs

2014-02-24 Thread Marc MERLIN
On Mon, Feb 24, 2014 at 09:35:19AM -0800, Marc MERLIN wrote: > On Mon, Feb 24, 2014 at 07:29:58AM +, Duncan wrote: > > > But I'm still seeing these, albeit less often. > > > Any idea what they could be linked to? > > > (I have a btrs send/receive going rig

Re: 3.13.5 kernel hangs some processes with btrfs

2014-02-24 Thread Marc MERLIN
On Mon, Feb 24, 2014 at 07:29:58AM +, Duncan wrote: > > But I'm still seeing these, albeit less often. > > Any idea what they could be linked to? > > (I have a btrs send/receive going right now, it could hanging > > /mnt/btrfs_pool1 in a way that affects smbd, but the array feels ok > > otherwi

Re: 3.13.5 kernel hangs some processes with btrfs

2014-02-23 Thread Marc MERLIN
On Mon, Feb 24, 2014 at 06:42:30AM +, Duncan wrote: > I believe there's a fix coming (a cancel that blows away the tracking > file if it finds it and no actual running scrub is the most obvious fix), > but meanwhile, see the /var/lib/btrfs/scrub.status.* files. That's where > scrub state is

Re: 3.13.5 kernel hangs some processes with btrfs

2014-02-23 Thread Marc MERLIN
On Mon, Feb 24, 2014 at 02:27:46PM +0800, Wang Shilong wrote: > >Note that it says running for 5 seconds, but it started 4H ago. > > > >Any idea what's going on here? > What is dmesg output? > > Did it output something like "Skip abort transaction"? Also > what is your mount option? did you enable

Re: 3.13.5 kernel hangs some processes with btrfs

2014-02-23 Thread Marc MERLIN
On Sun, Feb 23, 2014 at 10:14:26PM -0800, Marc MERLIN wrote: > Does someone know how I can debug further why this is hanging? > > It seems that accessing a certain directory on one of my btrfs filesystems > causes this. > > The rest of my system seems ok, as long as I&#

3.13.5 kernel hangs some processes with btrfs

2014-02-23 Thread Marc MERLIN
Does someone know how I can debug further why this is hanging? It seems that accessing a certain directory on one of my btrfs filesystems causes this. The rest of my system seems ok, as long as I'm not touching this filesystem. Is this a bug, or a performance problem? [ 1930.287192] INFO: task

btrfs userland interface isn't 32/64bit clean (breaks lsattr and btrfs send)

2014-02-23 Thread Marc MERLIN
I was trying to make sense out of this: gargamel:~# lsattr lsattr: Inappropriate ioctl for device While reading flags on ./satapmtool lsattr: Inappropriate ioctl for device While reading flags on ./usbreset As well as the btrfs send issue I reported: gargamel:/mnt/btrfs_pool1# btrfs send media_ro

btrfs send ioctl failed with -25: Inappropriate ioctl for device

2014-02-22 Thread Marc MERLIN
On Sun, Feb 16, 2014 at 09:32:32PM -0800, Marc MERLIN wrote: > On Sun, Feb 16, 2014 at 09:08:57PM +, Filipe David Manana wrote: > > I'll see if I come up with other ways of getting into that issue. > > If you're collecting them, I found another bug, although it might

Re: How to recover from failing btrfs send | btrfs receive?

2014-02-16 Thread Marc MERLIN
On Sun, Feb 16, 2014 at 09:08:57PM +, Filipe David Manana wrote: > I'll see if I come up with other ways of getting into that issue. If you're collecting them, I found another bug, although it might not matter to most: if I put my laptop in S3 sleep during a send/receive, it reliably breaks th

Re: How to recover from failing btrfs send | btrfs receive?

2014-02-16 Thread Marc MERLIN
On Sun, Feb 16, 2014 at 03:38:18PM +, Filipe David Manana wrote: > On Sun, Feb 16, 2014 at 2:23 PM, Marc MERLIN wrote: > > Hi Fillipe, I see you have another fix for btrfs send (attached below), > > as ell as your other patch on Jan 21st (neither are in my 3.12.7). >

Re: How to recover from failing btrfs send | btrfs receive?

2014-02-16 Thread Marc MERLIN
2, 2014 at 06:22:07AM -0800, Marc MERLIN wrote: > So, I've veen running this for a few weeks, and soon should have > something half decent to share for others to use. > > Unfortunately, one of my backups is now failing like so: > > btrfs send -p "$src_snap" "$s

Re: How to recover from failing btrffs send | btrfs receive?

2014-02-13 Thread Marc MERLIN
Ok, let me try something else :) Of those who are using btrfs send/receive, has anyone gotten in a state where incrementals will not apply anymore? Thanks, Marc On Wed, Feb 12, 2014 at 06:22:07AM -0800, Marc MERLIN wrote: > So, I've veen running this for a few weeks, and soon sho

How to recover from failing btrffs send | btrfs receive?

2014-02-12 Thread Marc MERLIN
So, I've veen running this for a few weeks, and soon should have something half decent to share for others to use. Unfortunately, one of my backups is now failing like so: btrfs send -p "$src_snap" "$src_newsnap" | btrfs receive "$dest_pool/" + btrfs send -p /mnt/btrfs_pool1/home_ro.20140209_12:0

Re: Bedup bug report

2014-02-12 Thread Marc MERLIN
Does anyone know who the maintainer to send bug reports to, is? On Sat, Feb 08, 2014 at 09:19:36PM -0800, Marc MERLIN wrote: > kernel 3.12.7, python 2.7.6-5, debian testing/unstable, bedup installed as per > pip install --user bedup > > I tried installing the git version, but the

Bedup bug report

2014-02-08 Thread Marc MERLIN
kernel 3.12.7, python 2.7.6-5, debian testing/unstable, bedup installed as per pip install --user bedup I tried installing the git version, but the error is the same: Anyway, with the other bedup, I get: gargamel:/mnt/dshelf2/backup# bedup show Traceback (most recent call last): File "/usr/loca

Re: Can you keep reflink relationship during a copy/backup to another filesystem?

2014-02-07 Thread Marc MERLIN
On Wed, Jan 29, 2014 at 08:05:14AM +, Hugo Mills wrote: > On Tue, Jan 28, 2014 at 11:50:25PM -0800, Marc MERLIN wrote: > > So I used to use hardlinks to do historical backups of the same filesystem > > but I know it's preferable to use refllink with btrfs to avoid having to

btrfs snapshot is killing IO and hanging my device with delayed writes for 10mn+

2014-02-07 Thread Marc MERLIN
On my workstation, which unfortunately I can't easily upgrade the kernel on, so it's running 3.8.0 for now, I've had pretty perpelexing hangs from btrfs snapshot when I make a new snapshot every hour. I see the btrfs snapshot command in iotop for over a minute, and it completes eventually. Other

Can you keep reflink relationship during a copy/backup to another filesystem?

2014-01-28 Thread Marc MERLIN
So I used to use hardlinks to do historical backups of the same filesystem but I know it's preferable to use refllink with btrfs to avoid having too many hardlinks. But if I need to backup this filesystem to another one some other way than btrfs send/receive (let's say cp -a, tar, or rsync), is it

Re: Fwd: Is there a lightweight copy from one subvolume to another?

2014-01-25 Thread Marc MERLIN
On Sat, Jan 25, 2014 at 09:50:48PM +1300, Maxdamantus wrote: > Due to what I understand is some VFS limitation, you can only > reflink-copy between subvolumes under one Linux mountpoint. If > /mnt/btrfs1 provides access to all subvolumes, you should be able to > copy between them through that path,

Is there a lightweight copy from one subvolume to another?

2014-01-24 Thread Marc MERLIN
If I have /mnt/btrfs1/subvol1 /mnt/btrfs1/subvol2 Can I copy/move data from subvol1 to subvol2 without having to physically copy all the blocks as if it were an entirely different filesystem? reflink doesn't work for this: gargamel [mc]# cp -av --reflink=always misc/olympic Video/misc/ `misc/oly

Re: btrfs-convert destroyed my system

2014-01-18 Thread Marc MERLIN
On Fri, Jan 17, 2014 at 07:30:49PM -0800, Sir Civit wrote: > > > To start off, I have an encrypted LVM setup with a root logical volume and a > home > logical volume. Today decided to upgrade my home LV to btrfs for > compression. I installed btrfs-progs, unmounted /home, and ran > btrfs-conve

Re: btrfsck failes

2014-01-16 Thread Marc MERLIN
On Wed, Jan 15, 2014 at 10:16:13AM -0700, Chris Murphy wrote: > > On Jan 15, 2014, at 9:15 AM, Mitch Harder > wrote: > > > On Mon, Jan 13, 2014 at 6:37 PM, Chris Murphy > > wrote: > >> > >> On Jan 13, 2014, at 3:58 PM, Holger Brandsmeier > >> wrote: > >>> > >>> Currently btrfsck failes to

Re: btrfsck failes

2014-01-15 Thread Marc MERLIN
On Mon, Jan 13, 2014 at 05:37:31PM -0700, Chris Murphy wrote: > > On Jan 13, 2014, at 3:58 PM, Holger Brandsmeier wrote: > > > > Currently btrfsck failes to repair my partition, I get the output: > > > > [root@ho-think bholger]# btrfsck --repair /dev/sda5 > > This is almost the last resort and

Re: Fwd: btrfsck failes

2014-01-15 Thread Marc MERLIN
On Wed, Jan 15, 2014 at 08:53:55AM +0100, Holger Brandsmeier wrote: > # btrfs-zero-log /dev/sda5 > parent transid verify failed on 602529792 wanted 23460 found 23463 > parent transid verify failed on 602529792 wanted 23460 found 23463 > parent transid verify failed on 602529792 wanted 23460 found 2

Re: Is anyone using btrfs send/receive howto?

2014-01-08 Thread Marc MERLIN
On Tue, Jan 07, 2014 at 10:53:29AM +, Hugo Mills wrote: >You need to move /mnt/btrfs_pool2/tmp_read_only_new to a different > name as well. The send stream contains the name of the subvolume it > wants to create, so it's trying to create a subvolume called > "tmp_read_only_new" in /mnt/btrf

Re: btrfs-transaction blocked for more than 120 seconds

2014-01-07 Thread Marc MERLIN
On Fri, Jan 03, 2014 at 09:34:10PM +, Duncan wrote: > IIRC someone also mentioned problems with autodefrag and an about 3/4 gig > systemd journal. My gut feeling (IOW, *NOT* benchmarked!) is that double- > digit MiB files should /normally/ be fine, but somewhere in the lower > triple digits,

Re: Is anyone using btrfs send/receive howto?

2014-01-07 Thread Marc MERLIN
I read different howtos on the wiki and oracle docs, but I can't get it to work: legolas:/mnt/btrfs_pool1# btrfs subvolume snapshot -r tmp tmp_read_only_new Create a readonly snapshot of 'tmp' in './tmp_read_only_new' legolas:/mnt/btrfs_pool1# sync legolas:/mnt/btrfs_pool1# btrfs send tmp_read_onl

Re: coredump in btrfsck

2014-01-05 Thread Marc MERLIN
On Fri, Jan 03, 2014 at 05:14:56PM -0700, Chris Murphy wrote: > > On Jan 3, 2014, at 5:33 AM, Marc MERLIN wrote: > > > > Would it be possible for whoever maintains btrfs-tools to change both > > the man page and the help included in the tool to clearly state that >

Re: btrfs-transaction blocked for more than 120 seconds

2014-01-05 Thread Marc MERLIN
On Fri, Jan 03, 2014 at 09:34:10PM +, Duncan wrote: > > Thank you for that tip, I had been unaware of it 'till now. > > This will make my virtualbox image directory much happier :) > > I think I said it, but it bears repeating. Once you set that attribute > on the dir, you may want to move t

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2014-01-03 Thread Marc MERLIN
On Mon, Dec 30, 2013 at 09:57:40AM -0800, Marc MERLIN wrote: > On Mon, Dec 30, 2013 at 10:48:10AM -0700, Chris Murphy wrote: > > > > On Dec 30, 2013, at 10:10 AM, Marc MERLIN wrote: > > > > > > If one day, it could at least work on a subvolume level (only sync

Re: btrfs-transaction blocked for more than 120 seconds

2014-01-03 Thread Marc MERLIN
First, a big thank you for taking the time to post this very informative message. On Wed, Jan 01, 2014 at 12:37:42PM +, Duncan wrote: > Apparently the way some distribution installation scripts work results in > even a brand new installation being highly fragmented. =:^( If in > addition th

Re: coredump in btrfsck

2014-01-03 Thread Marc MERLIN
On Thu, Jan 02, 2014 at 10:37:28AM -0700, Chris Murphy wrote: > > On Jan 1, 2014, at 3:35 PM, Oliver Mangold wrote: > > > On 01.01.2014 22:58, Chris Murphy wrote: > >> On Jan 1, 2014, at 2:27 PM, Oliver Mangold wrote: > >> > >>> I fear, I broke my FS by running btrfsck. I tried 'btrfsck --repa

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-30 Thread Marc MERLIN
On Mon, Dec 30, 2013 at 10:48:10AM -0700, Chris Murphy wrote: > > On Dec 30, 2013, at 10:10 AM, Marc MERLIN wrote: > > > > If one day, it could at least work on a subvolume level (only sync a > > subvolume), then it would be more useful to me. Maybe later… > > Ma

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-30 Thread Marc MERLIN
On Mon, Dec 30, 2013 at 04:26:42PM +, Chris Mason wrote: > > 1) Does it need to be an exact byte for byte copy of the block device the > > source was on? > > > No, in fact this doesn't help. > > > 2) Or can the destination be seeded with a full rsync or cp -a and can > > btrfs receive > > ta

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-30 Thread Marc MERLIN
On Mon, Dec 30, 2013 at 04:05:03PM +, Chris Mason wrote: > On Sat, 2013-12-28 at 10:20 -0800, Marc MERLIN wrote: > > On Sat, Dec 28, 2013 at 10:07:58AM -0800, Marc MERLIN wrote: > > > For instance, if I use an existing rsync destination to start syncing > > > btrfs s

Re: Migrate to bcache: A few questions

2013-12-30 Thread Marc MERLIN
On Mon, Dec 30, 2013 at 02:22:55AM +0100, Kai Krakow wrote: > These thought are actually quite interesting. So you are saying that data > may not be fully written to SSD although the kernel thinks so? This is That, and worse. Incidently, I have just posted on my G+ about this: https://plus.goog

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-28 Thread Marc MERLIN
On Sat, Dec 28, 2013 at 10:07:58AM -0800, Marc MERLIN wrote: > For instance, if I use an existing rsync destination to start syncing > btrfs snapshots to after that, and one file operation can't be applied > because let's say the destination file it's supposed to be appli

Re: Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-28 Thread Marc MERLIN
On Sat, Dec 28, 2013 at 05:37:30PM +, Hugo Mills wrote: > > Is it still being worked on, or kind of frozen/good as is? > >It's almost feature-complete: there's one version bump expected in > the stream format, to handle files with holes in. There are probably > still awkward bugs in there

Is anyone using btrfs send/receive for backups instead of rsync?

2013-12-28 Thread Marc MERLIN
Currently, I have a nightly cronjob that rsyncs my SSD to my HD on my laptop. Of course, running rsync on an entire FS every night is slow, especially if I happen to try to use the laptop at the same time. Obviously, that's what btrfs send/receive is supposed to fix: https://btrfs.wiki.kernel.org

Re: Extremely slow metadata performance

2013-12-07 Thread Marc MERLIN
On Thu, Dec 05, 2013 at 07:39:30PM +, Duncan wrote: > John Goerzen posted on Thu, 05 Dec 2013 11:52:04 -0600 as excerpted: > > > Hello, > > > > I have observed extremely slow metadata performance with btrfs. This may > > be a bit of a nightmare scenario; it involves untarring a backup of > >

btrfs still core dumps

2013-11-20 Thread Marc MERLIN
Here is another way in which btrfs-tools crashes if it sees things it doesn't like. Is anyone interested in those, or not really? gandalfthegreat:/tmp# btrfs-find-root /dev/mapper/ssdcrypt Check tree block failed, want=20971520, have=10422900740180685247 Check tree block failed, want=20971520, h

Re: NMI from btrfs cron jobs in 3.11.6

2013-11-17 Thread Marc MERLIN
On Mon, Nov 18, 2013 at 01:43:51AM +1100, Russell Coker wrote: > On Thu, 14 Nov 2013, Duncan <1i5t5.dun...@cox.net> wrote: > > > It appears that running two scripts that create snapshots at the same > > > time as a script that removes maybe 97 snapshots causes an NMI. > > > > This is a known bug i

Re: OK to take hourly snapshots, then cull older ones?

2013-11-04 Thread Marc MERLIN
On Sun, Nov 03, 2013 at 12:50:24PM +0100, Matthias G. Eckermann wrote: > Hello David and all, > > On Mon, Oct 14, 2013 at 21:05 David Madden wrote: > > > I'd like to use BTRFS to do something like the old NetApp > > snapshot system: every hour or so, there'd be a snapshot, > > then the 23 of the

Re: btrfs-zero-log (v 0.20-rc1) corrupted double linked list.

2013-10-17 Thread Marc MERLIN
On Thu, Oct 17, 2013 at 02:29:24PM -0700, Marc MERLIN wrote: > I asked the debian maintainer to add btrfs-zero-log to the initramfs since I > unfortunately have to use it from time to time. > > It still fixes the problem for me when btrfs won't mount, but it errors at &g

btrfs-zero-log (v 0.20-rc1) corrupted double linked list.

2013-10-17 Thread Marc MERLIN
I asked the debian maintainer to add btrfs-zero-log to the initramfs since I unfortunately have to use it from time to time. It still fixes the problem for me when btrfs won't mount, but it errors at the end. See screenshot Marc -- "A mouse is a device used to point at the xterm you want to typ

Re: OK to take hourly snapshots, then cull older ones?

2013-10-14 Thread Marc MERLIN
On Mon, Oct 14, 2013 at 09:05:33PM -0700, David Madden wrote: > I'd like to use BTRFS to do something like the old NetApp snapshot > system: every hour or so, there'd be a snapshot, then the 23 of the > snapshots during a day would be deleted, leaving just a day snapshot, > then after a month, 6 of

btrfs race conditions on snapshot delete/create

2013-09-27 Thread Marc MERLIN
I had a cronjob that mistakenly created and deleted snapshots in the same place at the same time. Interesting output I got: /var/local/scr/btrfs_snaps: line 23: 26017 Segmentation fault (core dumped) /sbin/btrfs subvolume delete "$sub" On ubuntu precise (i.e. super ancient), but I upgraded

Newer kernels do not oops if log cannot be re-read at mount

2013-09-04 Thread Marc MERLIN
I just wanted to confirm that the crash on unexpected log read during mount is indeed fixed for me, I now just get a log read failed message. I've filed a bug with debian to encourage them to add btrfs-zero-log as a tool in the initrd so that one can have the choice of running this on a non mounti

Re: Ability to free space on a full btrfs filesystem

2013-08-25 Thread Marc MERLIN
On Sun, Aug 25, 2013 at 06:23:20PM +0200, Matthieu Dalstein wrote: > Hello, > > I'm currently experiencing some space issue on btrfs with linux kernel 3.10. > My btrfs partition is full and I fail to remove any data to give some > free space: Did you snapshot your filesystem? If so, delete some/

btrfs raid5 recovery with >1 half failed drive, or multiple drives kicked out at the same time.

2013-08-17 Thread Marc MERLIN
I know the raid5 code is still new and being worked on, but I was curious. With md raid5, I can do this: mdadm /dev/md7 --replace /dev/sde1 This is cool because it lets you replace a drive with bad sectors where at least one other drive in the array has bad sectors, and the md layer will read all

Re: kernel 3.8.8: btrfs still crashes on boot when it can't replay a log

2013-05-17 Thread Marc MERLIN
ernel, but I had to reboot to clear all those hangs (after reboot it was ok) Thanks, Marc On Fri, May 17, 2013 at 08:48:11AM -0700, Marc MERLIN wrote: > Sigh, last night my laptop hung again, I don't have a way to know why. > > When I rebooted wit 3.9.2, soon after boot, I started to g

Re: kernel 3.8.8: btrfs still crashes on boot when it can't replay a log

2013-05-17 Thread Marc MERLIN
On Thu, May 16, 2013 at 08:09:18AM -0700, Marc MERLIN wrote: > I've reported this bug a few times over different kernel versions over the > last year now, and unfortunately it's still not fixed as of 3.8 (yes, I know > 3.9 is out, I'm just about to switch). > > What

kernel 3.8.8: btrfs still crashes on boot when it can't replay a log

2013-05-16 Thread Marc MERLIN
I've reported this bug a few times over different kernel versions over the last year now, and unfortunately it's still not fixed as of 3.8 (yes, I know 3.9 is out, I'm just about to switch). What happens as far as I know: I have btrfs on top of dmcrypt on an SDD. The SSD on occasion seems to just

Re: zlib vs lzo uncompress speed, ssd vs nossd

2013-03-27 Thread Marc MERLIN
On Wed, Mar 27, 2013 at 04:12:27PM -0500, Mitch Harder wrote: > Lzo compression should be faster in every aspect than zlib, especially > for reading. Speaking of which, it would be awesome if there were a some chattr option to choose which encryption you'd like for a file or a subdirectory tree (c

Re: zlib vs lzo uncompress speed, ssd vs nossd

2013-03-27 Thread Marc MERLIN
On Wed, Mar 27, 2013 at 04:12:27PM -0500, Mitch Harder wrote: > On Wed, Mar 27, 2013 at 11:53 AM, Marc MERLIN wrote: > > > > Is my feeling of slower boot wrong, or is zlib also noticeably slower than > > lzo to read and decompress? > > > > Lzo compression shou

zlib vs lzo uncompress speed, ssd vs nossd

2013-03-27 Thread Marc MERLIN
I just setup a new SSD with my laptop root filesystem, and at the time I though, "eh, I'll just use zlib compression during the first copy, and then switch to lzo afterwards to maintain write speed when I'm using the laptop after the copy and reboot". Now, I rebooted with the new ssd and zlib comp

Re: multiple btrfsck runs

2013-03-16 Thread Marc MERLIN
On Sat, Mar 16, 2013 at 06:24:47AM -0600, cwillu wrote: > On Sat, Mar 16, 2013 at 6:02 AM, Russell Coker wrote: > > Is it expected that running btrfsck more than once will keep reporting > > errors? > > Without options, btrfsck does not write to the disk. Ah, that explains why I never got i

Re: kernel BUG at fs/btrfs/volumes.c:3753! These btrfs crashes at mount time on log replay are really a problem

2013-02-26 Thread Marc MERLIN
On Tue, Feb 26, 2013 at 10:24:42AM -0800, Zach Brown wrote: > > Am I wrong when saying that ending up with replay journals that have > > unexpected data and that can't be replayed is just inevitable and something > > any journalling filesystem must deal with? > > If by journal you mean the btrfs l

Re: kernel BUG at fs/btrfs/volumes.c:3753! These btrfs crashes at mount time on log replay are really a problem

2013-02-26 Thread Marc MERLIN
On Tue, Feb 26, 2013 at 09:23:00AM -0500, Josef Bacik wrote: > So how did you reproduce it? I'll take a fs_image, but being able to > reproduce > the problem is more valuable. Thanks, Here's the image: http://marc.merlins.org/tmp/fs_image I just wrote details in the other message I just Cced y

Re: WARNING: at fs/btrfs/inode.c:2165 btrfs_orphan_commit_root+0xcb/0xdf()

2013-02-26 Thread Marc MERLIN
On Tue, Feb 26, 2013 at 03:02:01PM +0800, Liu Bo wrote: > On Sun, Feb 24, 2013 at 06:55:46PM -0800, Marc MERLIN wrote: > > Is this useful to anyone? > > > > Hi Marc, > > Thanks for the report, of course they're useful. Thanks. I wasn't sure since I hav

kernel BUG at fs/btrfs/volumes.c:3753! These btrfs crashes at mount time on log replay are really a problem

2013-02-25 Thread Marc MERLIN
TL;DR; WARNING: at fs/btrfs/tree-log.c:1984 walk_down_log_tree+0x51/0x307() WARNING: at fs/btrfs/tree-log.c:1988 walk_down_log_tree+0x6c/0x307() kernel BUG at fs/btrfs/volumes.c:3753! It's way time for btrfs to stop crashing your system with no recovery flag that works to clear the log if the log

WARNING: at fs/btrfs/inode.c:2165 btrfs_orphan_commit_root+0xcb/0xdf()

2013-02-24 Thread Marc MERLIN
Is this useful to anyone? Got this after a crash/reboot: if (block_rsv) { WARN_ON(block_rsv->size > 0); << btrfs_free_block_rsv(root, block_rsv); } [ cut here ] WARNING: at fs/btrfs/inode.c:2165 btrfs_or

Re: Fwd: Current State of BTRFS

2013-02-09 Thread Marc MERLIN
On Fri, Feb 08, 2013 at 10:30:04PM +0100, Florian Hofmann wrote: > Hi everybody, > > I am using btrfs as my main fs for some time now, but I am > experiencing severe performance drawbacks. I can't qualify the > circumstances, but sometimes during disc access the whole system > freezes for some tim

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-17 Thread Marc MERLIN
On Thu, Jan 17, 2013 at 12:31:22PM +0100, David Sterba wrote: > On Sat, Jan 12, 2013 at 07:12:12PM -0800, Marc MERLIN wrote: > > On Fri, Jan 11, 2013 at 09:49:52AM -0500, Josef Bacik wrote: > > > Probably just related to whatever corruption it is you are seeing. > > >

Re: Can moving data to a subvolume not take as long as a fully copy?

2013-01-15 Thread Marc MERLIN
On Mon, Jan 14, 2013 at 10:48:50PM -0800, David Brown wrote: > Why not make a snapshot of the root volume, and then delete the files > you want to move from the original root, and delete the rest of root > from the snapshot? Are a snapshot of the root volume and a subvolume effectively the same th

Re: Can moving data to a subvolume not take as long as a fully copy?

2013-01-14 Thread Marc MERLIN
On Mon, Jan 14, 2013 at 05:41:55PM +, Hugo Mills wrote: > On Mon, Jan 14, 2013 at 09:32:50AM -0800, Marc MERLIN wrote: > > I made a mistake and copied data in the root of a new btrfs filesystem. > > I created a subvolume, and used mv to put everything in there. > > Someth

Can moving data to a subvolume not take as long as a fully copy?

2013-01-14 Thread Marc MERLIN
I made a mistake and copied data in the root of a new btrfs filesystem. I created a subvolume, and used mv to put everything in there. Something like: cd /mnt btrfs subvolume create dir mv * dir Except it's been running for over a day now (ok, it's 5TB of data) Looks like mv is really copying all

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-13 Thread Marc MERLIN
On Tue, Jan 08, 2013 at 05:10:12PM +, Hugo Mills wrote: > > If that helps, here's what I got after the fact when trying to mount the > > broken filesystem before zero'ing logs > [snip] > >That information may also be helpful in conjunction with the > btrfs-image dump of a broken FS. I'm no

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-12 Thread Marc MERLIN
On Fri, Jan 11, 2013 at 09:49:52AM -0500, Josef Bacik wrote: > On Thu, Jan 10, 2013 at 09:20:09AM -0700, Marc MERLIN wrote: > > On Tue, Jan 08, 2013 at 10:46:03AM -0800, Marc MERLIN wrote: > > > On Tue, Jan 08, 2013 at 01:25:41PM -0500, Josef Bacik wrote: > > > > On T

remounting 5 drive array (raid0) caused a bunch of errors and prevented unmount from suceeding (stuck in wait_block_group_cache_done)

2013-01-10 Thread Marc MERLIN
I had a 5 drive array where the SATA port multiplier one drive was in, crapped out. After fixing that, and remounting the array, I got a bunch of recovery errors, including warnings. They seem like a lot more than I should have, but maybe they're normal/expected, maybe not (at the bottom of the mi

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-10 Thread Marc MERLIN
On Tue, Jan 08, 2013 at 10:46:03AM -0800, Marc MERLIN wrote: > On Tue, Jan 08, 2013 at 01:25:41PM -0500, Josef Bacik wrote: > > On Tue, Jan 08, 2013 at 09:49:58AM -0700, Marc MERLIN wrote: > > > Unfortunately my laptop deadlocks from time to time, and too often > > > it

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-08 Thread Marc MERLIN
On Tue, Jan 08, 2013 at 01:25:41PM -0500, Josef Bacik wrote: > On Tue, Jan 08, 2013 at 09:49:58AM -0700, Marc MERLIN wrote: > > Unfortunately my laptop deadlocks from time to time, and too often > > it triggers this bug in btrfs which is quite hard to recover from. > > >

Re: kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-08 Thread Marc MERLIN
See bottom, my filesystem mounts, but apparently it's still corrupted as per btrfs-image output On Tue, Jan 08, 2013 at 05:10:12PM +, Hugo Mills wrote: > > Question #1: > > I have hourly snapshots of my root filesystem, and I wasn't able to mount > > any of them. I got the BUG at fs/btrfs/volu

kernel BUG at fs/btrfs/volumes.c:3707 still not fixed in 3.7.1 (btrfs-zero-log required) but shown as "RIP btrfs_num_copies"

2013-01-08 Thread Marc MERLIN
Unfortunately my laptop deadlocks from time to time, and too often it triggers this bug in btrfs which is quite hard to recover from. The bigger problem is that all the user sees (if anything) is seemingly unrelated info, namely, "RIP: btrfs_num_copies+0x42/0x0b" or somesuch http://marc.merlins.o

Re: Question about btrfs snapshot delay and rm -rf delay

2012-12-05 Thread Marc MERLIN
On Wed, Dec 05, 2012 at 11:56:27PM -0500, Sylvain Alain wrote: > Hi everyone, I'm running btrfs since octobre 2012 and I would like to > understand 2 behavior that I noticed. > > 1. When I delete a big directory, sometimes it can hang my box for 1 > minutes or so, it seems that's the btrfs lock my

Re: unable to mount a btrfs partition

2012-11-21 Thread Marc MERLIN
On Wed, Nov 21, 2012 at 04:17:57PM +0100, frantz.hacquard wrote: > Hello, > > i don't know if it's the right place to post my problem. > > yesterday my btrfs partition (/dev/sda4) worked very well but now i > can't mount my btrfs partition anymore. > it says : wrong fs type, bad option, bad supe

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707 - FIXED

2012-11-01 Thread Marc MERLIN
On Thu, Nov 01, 2012 at 11:56:18AM +0100, Sander wrote: > > For now, I'll stick with 3.5.3 for a while to make sure my drive is actually > > ok (it seems to be afterall), and once I'm happy that it's the case, I'll go > > back to 3.6.3 with serial console remote logging and try to capture the full

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707 - FIXED

2012-10-31 Thread Marc MERLIN
On Wed, Oct 31, 2012 at 10:24:40AM +0100, Sander wrote: > Marc MERLIN wrote (ao): > > What happened is that my SSD is craping out and failing to write after > > a certain number of uptime hours. > > What model ssd is that if I may ask? I had my first one, Crucial C300 just

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707 - FIXED

2012-10-30 Thread Marc MERLIN
On Mon, Oct 29, 2012 at 10:48:02AM -0700, Marc MERLIN wrote: > Then, I figured, I'd try mounting all the active snapshots one per one, > and they worked: > > After that, I was able to mount the root (volid 0) without a crash and > my filesystem looks fine again. Ok, I was wro

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707 - FIXED

2012-10-29 Thread Marc MERLIN
First, I used another tool to see how the FS looked like, and maybe in the hopes of having a list of subvolumes without mounting it: gandalfthegreat:~# btrfs-calc-size /dev/mapper/bootdsk Calculating size of root tree 180.00KB total size, 0.00 inline data, 1 nodes, 44 leaves, 2 levels Calc

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-29 Thread Marc MERLIN
Hi, Thanks for the reply and hints. On Sun, Oct 28, 2012 at 11:05:42PM -0600, Chris Murphy wrote: > > I also have hourly, daily, weekly > > btrfs subvolume snapshots, but I can't use those currently since I can't > > mount the base filesystem. > > It might be worth unmounting it. Then only remo

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-28 Thread Marc MERLIN
On Thu, Oct 25, 2012 at 01:12:23PM -0700, Marc MERLIN wrote: > On Thu, Oct 25, 2012 at 02:03:49PM -0600, cwillu wrote: > > > 3) Want me to try btrfsck although it may make it impossible for me to > > > reproduce the bug and test a fix, as well as potentially break the > &

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-26 Thread Marc MERLIN
If any devs want info out of my drive, please ask today, I really need to fix it tomorrow. I'll try btrfs-zero-log otherwise and if not, wipe and start over. Marc On Thu, Oct 25, 2012 at 12:58:05PM -0700, Marc MERLIN wrote: > Howdy, > > I can wait a day or maybe 2 before I ha

Re: Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-25 Thread Marc MERLIN
On Thu, Oct 25, 2012 at 02:03:49PM -0600, cwillu wrote: > > 3) Want me to try btrfsck although it may make it impossible for me to > > reproduce the bug and test a fix, as well as potentially break the > > filesystem > > more (last time I tried btrfsck, it outputted thousands of lines and never >

Need help mounting laptop corrupted root btrfs. Kernel BUG at fs/btrfs/volumes.c:3707

2012-10-25 Thread Marc MERLIN
Howdy, I can wait a day or maybe 2 before I have to wipe and restore from backup. Please let me know if you have a patch against 3.6.3 you'd like me to try to mount/recover this filesystem, or whether you'd like me to try btrfsck. My laptop had a problem with its boot drive which prevented linux

Re: crash in read_extent_buffer+0xb7/0xfb

2012-09-24 Thread Marc MERLIN
On Mon, Sep 24, 2012 at 03:08:47PM +0200, David Sterba wrote: > > I had a different crash while copying to a btrfs 5 disk array. Not sure if > > this is > > also fixed too, but pasting just in case. > > > > [207025.055956] btrfs: bdev /dev/mapper/crypt_sdo1 errs: wr 46779, rd 0, > > flush 7 6,

Re: crash in read_extent_buffer+0xb7/0xfb

2012-09-23 Thread Marc MERLIN
On Thu, Sep 20, 2012 at 08:46:52PM -0700, Marc MERLIN wrote: > On Thu, Sep 20, 2012 at 10:17:47AM -0700, Marc MERLIN wrote: > > I had a btrfs built on top of 5 drives (dmcrypt devices). > > > > The drive then died while I was writing to the filesystem and my system >

Re: kernel BUG at fs/btrfs/extent_io.c:1884!

2012-09-20 Thread Marc MERLIN
On Fri, Sep 21, 2012 at 06:57:32AM +0200, Stefan Behrens wrote: > > BUG_ON(!mirror_num); < > > > > This was fixed with commit c0901581ad077004145c9ee80e843fba71c100b8 and > is included in Linux 3.6 RC1. Congrats for all having a time machine and fixing my reported bugs in the past :)

Re: kernel BUG at fs/btrfs/extent_io.c:1884!

2012-09-20 Thread Marc MERLIN
On Thu, Sep 20, 2012 at 09:51:59PM -0600, cwillu wrote: > > Oh my, now I'm trying again with a new drive, and a big cp from an > > existing array to a new one dies with: > > [32042.079411] [ cut here ] > > [32042.085799] kernel BUG at fs/btrfs/extent_io.c:1884! > > [32042.09

Re: kernel BUG at fs/btrfs/extent_io.c:1884!

2012-09-20 Thread Marc MERLIN
On Thu, Sep 20, 2012 at 10:17:47AM -0700, Marc MERLIN wrote: > I had a btrfs built on top of 5 drives (dmcrypt devices). > > The drive then died while I was writing to the filesystem and my system > crashed and rebooted: > > [384555.534020] sd 10:0:0:0: rejecting I/O

<    2   3   4   5   6   7   8   >