Extend BTRFS_IOC_DEVICES_READY for degraded RAID

2015-01-05 Thread Harald Hoyer
We have BTRFS_IOC_DEVICES_READY to report, if all devices are present, so that a udev rule can report ID_BTRFS_READY and SYSTEMD_READY. I think we need a third state here for a degraded RAID, which can be mounted, but should only after a certain timeout/kernel command line params. We also have

Problem with applying incremental btrfs-send

2014-09-03 Thread Harald Hoyer
Hi, maybe someone can enlighten me. I am doing btrfs send receive with full snapshots and incremental updates. It basically looks like this: vol-0 and vol-1 are full subvolume image sends. inc-1 and inc-2 are incremental images with: # btrfs send -f inc-1 -p vol vol' # btrfs send -f inc-2 -p

Re: [RFC PATCH] Revert btrfs: allow mounting btrfs subvolumes with different ro/rw options

2014-07-02 Thread Harald Hoyer
On 01.07.2014 18:36, Chris Mason wrote: On 07/01/2014 11:32 AM, David Sterba wrote: (adding Harald to CC) On Tue, Jul 01, 2014 at 05:30:01PM +0800, Qu Wenruo wrote: This reverts commit 0723a0473fb48a1c93b113a28665b64ce5faf35a. This commit has the following problem: 1) Break the ro mount

[PATCH] btrfs: allow mounting btrfs subvolumes with different ro/rw options

2013-11-19 Thread harald
From: Harald Hoyer har...@redhat.com Given the following /etc/fstab entries: /dev/sda3 /mnt/foo btrfs subvol=foo,ro 0 0 /dev/sda3 /mnt/bar btrfs subvol=bar,rw 0 0 you can't issue: $ mount /mnt/foo $ mount /mnt/bar You would have to do: $ mount /mnt/foo $ mount -o remount,rw /mnt/foo $ mount

Re: [PATCH] btrfs: allow mounting btrfs subvolumes with different ro/rw options

2013-11-19 Thread Harald Hoyer
On 11/18/2013 11:53 AM, David Sterba wrote: On Sat, Sep 14, 2013 at 01:26:22PM +0200, Harald Hoyer wrote: Any comments? Not even a no, we don't want that ? Please resend. david done -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message

Re: [PATCH] btrfs: allow mounting btrfs subvolumes with different ro/rw options

2013-09-14 Thread Harald Hoyer
On 09/02/2013 12:55 PM, Harald Hoyer wrote: On 06/18/2013 05:29 PM, har...@redhat.com wrote: From: Harald Hoyer har...@redhat.com Given the following /etc/fstab entries: /dev/sda3 /mnt/foo btrfs subvol=foo,ro 0 /dev/sda3 /mnt/bar btrfs subvol=bar,rw 0 you can't issue: $ mount /mnt/foo

Re: [PATCH] btrfs: allow mounting btrfs subvolumes with different ro/rw options

2013-09-02 Thread Harald Hoyer
On 06/18/2013 05:29 PM, har...@redhat.com wrote: From: Harald Hoyer har...@redhat.com Given the following /etc/fstab entries: /dev/sda3 /mnt/foo btrfs subvol=foo,ro 0 /dev/sda3 /mnt/bar btrfs subvol=bar,rw 0 you can't issue: $ mount /mnt/foo $ mount /mnt/bar You would have to do

Re: Recommended settings for SSD

2013-05-26 Thread Harald Glatt
, Leonidas Spyropoulos artafi...@gmail.com wrote: On Sat, May 25, 2013 at 11:33 PM, Harald Glatt m...@hachre.de wrote: Data that already exists will only be compressed on re-write. You can do it with btrfs fi defrag and a script that traverses the fs to call defrag on every file. Another good way

Re: Recommended settings for SSD

2013-05-25 Thread Harald Glatt
Data that already exists will only be compressed on re-write. You can do it with btrfs fi defrag and a script that traverses the fs to call defrag on every file. Another good way is the find command that has been outlined here:

Re: kernel BUG at fs/btrfs/free-space-cache.c:1567!, Kernel 3.9.1

2013-05-15 Thread Harald Glatt
On Wed, May 15, 2013 at 4:19 PM, Philipp Dreimann phil...@dreimann.net wrote: Hello, my btrfs filesystem was not mountable anymore after a loss of power: kernel BUG at fs/btrfs/free-space-cache.c:1567! invalid opcode: [#1] SMP Modules linked in: btrfs libcrc32c xor zlib_deflate

Re: subvol copying

2013-05-15 Thread Harald Glatt
On Wed, May 15, 2013 at 6:43 PM, Chris Murphy li...@colorremedies.com wrote: On May 15, 2013, at 1:40 AM, Gabriel de Perthuis g2p.c...@gmail.com wrote: You can move subvolumes at any time, as if they were regular directories. In the example case, the subvolumes are read-only. So is it

Re: subvol copying

2013-05-15 Thread Harald Glatt
On Wed, May 15, 2013 at 7:28 PM, Chris Murphy li...@colorremedies.com wrote: On May 15, 2013, at 10:44 AM, Harald Glatt m...@hachre.de wrote: You make a ro snapshot rw by creating a snapshot of it that is rw. So yes to both questions, by doing the same thing in both cases. In other words

Re: Remove a materially failed device from a Btrfs single-raid using partitions

2013-05-13 Thread Harald Glatt
On Mon, May 13, 2013 at 4:15 PM, Vincent vinc...@influence-pc.fr wrote: Hello, I am on Ubuntu Server 13.04 with Linux 3.8. I've created a single-raid using /dev/sd{a,b,c,d}{1,3}. One of my hard drives has failed, I mean it's materially dead. :~$ sudo btrfs filesystem show Label: none

Re: Remove a materially failed device from a Btrfs single-raid using partitions

2013-05-13 Thread Harald Glatt
On Mon, May 13, 2013 at 4:33 PM, Vincent vinc...@influence-pc.fr wrote: Le 13/05/2013 16:29, Harald Glatt a écrit : On Mon, May 13, 2013 at 4:15 PM, Vincent vinc...@influence-pc.fr wrote: Hello, I am on Ubuntu Server 13.04 with Linux 3.8. I've created a single-raid using /dev/sd{a,b,c,d

Re: How many subvols/snapshots are possible? (limits?)

2013-05-09 Thread Harald Glatt
I can only speak from experience, a snapshot can take up to a minute to create later on, so minutely snapshots are out of the question then... I have snapshots every hour and I have no problems with that at all :) On Thu, May 9, 2013 at 12:10 PM, Martin m_bt...@ml1.co.uk wrote: Dear Devs, This

Re: hard freezes with 3.9.0 during io-intensive loads

2013-05-06 Thread Harald Glatt
I have this problem too, and I cannot reproduce it properly... When is that patch in btrfs-next going to be in the mainline kernel? On Mon, May 6, 2013 at 10:55 AM, Jan Schmidt list.bt...@jan-o-sch.net wrote: On Sun, May 05, 2013 at 18:10 (+0200), Kai Krakow wrote: Hello list, Kai Krakow

Re: grub/grub2 boot into btrfs raid root and with no initrd

2013-05-03 Thread Harald Glatt
On Fri, May 3, 2013 at 10:42 PM, Martin m_bt...@ml1.co.uk wrote: I've made a few attempts to boot into a root filesystem created using: mkfs.btrfs -d raid1 -m raid1 -L btrfs_root_3 /dev/sda3 /dev/sdb3 Both grub and grub2 pick up a kernel image fine from an ext4 /boot on /dev/sda1 for

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread Harald Glatt
/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:10 PM, John . btrfsp...@gmail.com wrote: Hi Harald, I did perform a defrag of the volume a few hours ago. This did not make a difference. :( Yours, John 2013/4/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:04 PM, John

Re: Btrfs performance problem; metadata size to blame?

2013-04-28 Thread Harald Glatt
Because performance was good again I was able to spam the volume with data and the metadata size also grew. No problems in that department either. ;-) 2013/4/28 Harald Glatt m...@hachre.de: On Sun, Apr 28, 2013 at 9:18 PM, John . btrfsp...@gmail.com wrote: I use Ubuntu with kernel 3.8.0-19

Re: [BUG] btrfs csum failed on v3.9.0-rc7

2013-04-24 Thread Harald Glatt
On Wed, Apr 24, 2013 at 1:24 PM, Tom Gundersen t...@jklm.no wrote: I'm having lots of problems with wrong checksums on the most recent kernels. Note that this is not a regression as far as I know, just more pronounced now than before (the increase in severity might be due to changes in my

Re: BTRFS 3.8.7 Kernel Crash Report

2013-04-22 Thread Harald Glatt
On Mon, Apr 22, 2013 at 4:01 PM, Mark Ridley m...@backupsystems.co.uk wrote: Thanks, David. What causes this corruption and how can I fix it? I'm very worried about running btrfs.fsck as last time it made a slight corruption like this worse and the whole volume had to be trashed. After

Re: BTRFS 3.8.7 Kernel Crash Report

2013-04-22 Thread Harald Glatt
the problems if they can't be fixed so I ran with --repair and it broke the volume. On 22/04/2013 15:02, Harald Glatt m...@hachre.de wrote: On Mon, Apr 22, 2013 at 4:01 PM, Mark Ridley m...@backupsystems.co.uk wrote: Thanks, David. What causes this corruption and how can I fix it? I'm very

Re: BTRFS 3.8.7 Kernel Crash Report

2013-04-22 Thread Harald Glatt
, Apr 22, 2013 at 4:16 PM, Mark Ridley m...@backupsystems.co.uk wrote: What does btrfs scrub do? Is that meant to detect and fix problems? Thanks, Mark On 22/04/2013 15:13, Harald Glatt m...@hachre.de wrote: Yeah, --repair is not recommended as of now. Maybe posting the btrfsck output just

Re: BTRFS 3.8.7 Kernel Crash Report

2013-04-22 Thread Harald Glatt
. On 22/04/2013 15:28, Harald Glatt m...@hachre.de wrote: I think it won't... That would just be the goal eventually. If scrub sees no errors all the data should be in tact and your best bet to get things working perfectly again is to create a new filesystem and transfer the data into it. I'm

Re: BTRFS 3.8.7 Kernel Crash Report

2013-04-22 Thread Harald Glatt
remount fixes the keys reverted problem? On 22/04/2013 15:18, Harald Glatt m...@hachre.de wrote: Only data errors (from CRC checks), maybe also some structure errors - I'm not sure. A remount should fix all errors. If it doesn't I think it's considered a bug - ultimately the goal is that no --repair

btrfs can't complete balance

2013-04-08 Thread Harald Glatt
though) I have backed up the newest state of the filesystem via rsync and am about to wipe and restore from backup with a new fs. Is anyone interested in a btrfs-image to debug this state? If so please tell me what command to run since I have never done this before... Thanks Harald

Re: btrfs can't complete balance

2013-04-08 Thread Harald Glatt
-image.c:518: create_metadump: Assertion `!(ret 0)' failed. [1]32513 abort (core dumped) On Mon, Apr 8, 2013 at 9:48 AM, Harald Glatt m...@hachre.de wrote: Hi all, I've managed to ruin my btrfs filesystem, but I don't know how. I basically have it split up into two subvolumes, one for the root

Re: btrfs can't complete balance

2013-04-08 Thread Harald Glatt
On Mon, Apr 8, 2013 at 10:45 AM, Harald Glatt m...@hachre.de wrote: The dmesg from the kernel panic can be seen here: http://pastebin.com/3QZqrqAX I've tried to create a btrfs-image but I'm getting a crash of the utility after only 50 MB... Check tree block failed, want=320304799744, have=0

Re: btrfs can't complete balance

2013-04-08 Thread Harald Glatt
://pastebin.com/3QZqrqAX On Mon, Apr 8, 2013 at 1:14 PM, Roman Mamedov r...@romanrm.ru wrote: On Mon, 8 Apr 2013 09:48:55 +0200 Harald Glatt m...@hachre.de wrote: At some point 'btrfs send' stopped working but gave no better error message than invalid argument. Usually in cases like this there are more

Re: [BUG] btrfs.fsck failing to fix corrupted block

2013-04-06 Thread Harald Glatt
On Sun, Apr 7, 2013 at 3:56 AM, Shripad Ratnaparkhi shripad.ratnapar...@gmail.com wrote: [Replying to my own email] Found a patch which seems to be discusses the fix in a patch provided here: https://patchwork.kernel.org/patch/1946561/ Still now sure whether that is already there in

Re: Moving...

2013-04-02 Thread Harald Glatt
On Tue, Apr 2, 2013 at 7:14 PM, Swâmi Petaramesh sw...@petaramesh.org wrote: Le 02/04/2013 19:04, Roman Mamedov a écrit : but at this point I trust my data to BTRFS more, than I would trust ZFS. My experience with ZFS on Linux is still somewhat limited, the only thing that I can say is that

Backup Options

2013-04-02 Thread Harald Glatt
suggestions? Thanks! Harald -- To unsubscribe from this list: send the line unsubscribe linux-btrfs in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Backup Options

2013-04-02 Thread Harald Glatt
On Tue, Apr 2, 2013 at 7:37 PM, Harald Glatt m...@hachre.de wrote: Hi list, what are currently the backup options for btrfs? Is it possible to somehow duplicate the entire filesystem including all snapshots without using the real space for each snapshot onto a remote server? (Maybe given

Re: Backup Options

2013-04-02 Thread Harald Glatt
On Wed, Apr 3, 2013 at 1:29 AM, Harald Glatt m...@hachre.de wrote: On Tue, Apr 2, 2013 at 7:37 PM, Harald Glatt m...@hachre.de wrote: Hi list, what are currently the backup options for btrfs? Is it possible to somehow duplicate the entire filesystem including all snapshots without using

Re: Backup Options

2013-04-02 Thread Harald Glatt
On Wed, Apr 3, 2013 at 4:23 AM, Harald Glatt m...@hachre.de wrote: On Wed, Apr 3, 2013 at 1:29 AM, Harald Glatt m...@hachre.de wrote: On Tue, Apr 2, 2013 at 7:37 PM, Harald Glatt m...@hachre.de wrote: Hi list, what are currently the backup options for btrfs? Is it possible to somehow

Re: [RFC] Online dedup for Btrfs

2013-04-01 Thread Harald Glatt
Oh man :D It was so elaborate that I really believed it :P On Mon, Apr 1, 2013 at 5:38 PM, Josef Bacik jba...@fusionio.com wrote: On Mon, Apr 01, 2013 at 08:50:34AM -0400, Josef Bacik wrote: Hello, I was bored this weekend so I hacked up online dedup for Btrfs. It's working quite well

Re: scrub correcting tons of errors ?

2013-03-29 Thread Harald Glatt
On that note, is btrfs doing automatic background scrubs of its own or do I have to use crontab to schedule scrubs? Thanks! On Fri, Mar 29, 2013 at 1:58 PM, Josef Bacik jba...@fusionio.com wrote: On Fri, Mar 29, 2013 at 03:50:15AM -0600, Swāmi Petaramesh wrote: Hi there, I've started btrfs

Space usage metering

2013-03-29 Thread Harald Glatt
Hi, I'm somewhat confused with who is right on what when it comes to showing disk usage and space free. I have a file system that I'm using for testing with a full linux installed as well as X and a desktop. I've created a good amount of snapshots and I've also done a lot of changes to the

Re: Space usage metering

2013-03-29 Thread Harald Glatt
a real world example. I've simply combined two differently sized partitions on the same disk together. So how much space is actually used now? On Fri, Mar 29, 2013 at 3:12 PM, Josef Bacik jba...@fusionio.com wrote: On Fri, Mar 29, 2013 at 07:58:40AM -0600, Harald Glatt wrote: Hi, I'm somewhat

Re: Space usage metering

2013-03-29 Thread Harald Glatt
Ah, now it makes sense!! Thanks! On Fri, Mar 29, 2013 at 3:27 PM, Hugo Mills h...@carfax.org.uk wrote: On Fri, Mar 29, 2013 at 03:18:03PM +0100, Harald Glatt wrote: Sorry I forgot to post that, - btrfs fi show Label: none uuid: 2feccf06-5af8-4d8a-ad8d-a090cf4ef69a Total devices 2 FS

Re: Any method to 'umount' a subvolume?

2013-03-13 Thread Harald Glatt
That's because the test shouldn't be in your root in the first place. The common way of thinking now is to create a btrfs volume with a structure for holding subvolumes inside of which your system root is a member. You then mount the system root via -o subvol= and will only see it and nothing

Re: Debian 3.7.1 BTRFS crash

2013-03-12 Thread Harald Glatt
If you care about the data, create a backup if you haven't already done so. Then you can try btrfsck, maybe you are in luck! On Wed, Mar 13, 2013 at 2:38 AM, Russell Coker russ...@coker.com.au wrote: I have a workstation running the Debian packaged 3.7.1 kernel from 24th December last year.

Re: Unable to boot btrfs filesystem, and btrfsck aborts

2013-03-11 Thread Harald Glatt
On Mon, Mar 11, 2013 at 11:44 PM, Matthew Booth matt...@heisenbug.com wrote: My laptop crashed hard earlier today. It reset immediately to a black screen followed by the BIOS. I have no idea why. However, it now fails to boot. I took a picture of the kernel panic that results from trying to

Re: Unable to boot btrfs filesystem, and btrfsck aborts

2013-03-11 Thread Harald Glatt
at 11:49 PM, Harald Glatt m...@hachre.de wrote: On Mon, Mar 11, 2013 at 11:44 PM, Matthew Booth matt...@heisenbug.com wrote: My laptop crashed hard earlier today. It reset immediately to a black screen followed by the BIOS. I have no idea why. However, it now fails to boot. I took a picture

Re: [PATCH 0/5] [RFC] RAID-level terminology change

2013-03-10 Thread Harald Glatt
On Sun, Mar 10, 2013 at 10:36 PM, Hugo Mills h...@carfax.org.uk wrote: Oh, sorry. It's reduced redundancy, aka DUP -- i.e. you get that number of copies, but not guarantee that the copies all live on different devices. I'm not devoted to showing it this way. Other suggestions for making

Re: [PATCH 0/5] [RFC] RAID-level terminology change

2013-03-10 Thread Harald Glatt
recover from (heavily paraphrased) so I knew that my 150 MB test was very close to the limit. On Sun, Mar 10, 2013 at 11:59 PM, Goffredo Baroncelli kreij...@gmail.com wrote: On 03/10/2013 10:45 PM, Harald Glatt wrote: I've noticed through my own tests that on a single device I can corrupt around

Re: [PATCH 0/5] [RFC] RAID-level terminology change

2013-03-10 Thread Harald Glatt
On Sun, Mar 10, 2013 at 11:24 PM, Hugo Mills h...@carfax.org.uk wrote: On 03/09/2013 09:31 PM, Hugo Mills wrote: Some time ago, and occasionally since, we've discussed altering the RAID-n terminology to change it to an nCmSpP format, where n is the number of copies, m is the number of

Re: [PATCH 0/5] [RFC] RAID-level terminology change

2013-03-09 Thread Harald Glatt
On Sun, Mar 10, 2013 at 6:41 AM, Roger Binns rog...@rogerbinns.com wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09/03/13 17:44, Hugo Mills wrote: You've got at least three independent parameters to the system in order to make that choice, though, and it's a fairly fuzzy decision

Re: [PATCH 0/5] [RFC] RAID-level terminology change

2013-03-09 Thread Harald Glatt
Very good points, I was also gonna write something by the lines of 'all that matters is achieving the minimum amount of redundancy, as requested by the user, at the maximum possible performance'. After reading your post now, Roger, I'm much more clear on what I actually wanted to say,

BTRFS Volume with defect Disk

2012-09-22 Thread Harald Weber
delete missing /mnt/data/ resulted in ERROR: error removing the device 'missing' - Invalid argument What can i do? Thanks Harald Kernel crash: [ 70.714877] device fsid d527b2b9-11bc-4340-a676-b84a09731938 devid 2 transid 58802 /dev/sdc1 [ 71.180771] btrfs: allowing degraded mounts

Re: [RFC] A way to tell if all the devices in a file system are available

2012-07-10 Thread Harald Hoyer
Am 21.06.2012 22:10, schrieb Josef Bacik: Harald Hoyer has had this as a feature request for ages and I've finally gotten around to hacking something up. This is probably going to get bikeshedded to death, bring it on, I'm not married to any of the behaviors in these patches, I just want

Re: [RFC] A way to tell if all the devices in a file system are available

2012-06-22 Thread Harald Hoyer
On 06/21/2012 10:10 PM, Josef Bacik wrote: Harald Hoyer has had this as a feature request for ages and I've finally gotten around to hacking something up. This is probably going to get bikeshedded to death, bring it on, I'm not married to any of the behaviors in these patches, I just want