Re: Using BtrFS and backup tools for keeping two systems in sync

2015-10-08 Thread Hugo Mills
ng to do git merge, I guess). > > Has anyone come across this situation and evolved any policies to handle it? You can't currently do this efficiently with send/receive. It should be possible, but it needs a change to the send stream format. Hugo. -- Hugo Mills | UNIX: Britis

Re: btrfs autodefrag?

2015-10-18 Thread Hugo Mills
he interests of consistency, checksums are disabled. Hugo. -- Hugo Mills | Nothing wrong with being written in Perl... Some of hugo@... carfax.org.uk | my best friends are written in Perl. http://carfax.org.uk/ | PGP: E2AB1DE4 |

Re: BTRFS RAID1 behavior after one drive temporal disconection

2015-10-08 Thread Hugo Mills
On Fri, Oct 09, 2015 at 12:16:43AM +0200, Pavel Pisa wrote: > Hello Hugo, > > On Thursday 08 of October 2015 23:13:52 Hugo Mills wrote: > > On Thu, Oct 08, 2015 at 07:47:33AM -0400, Austin S Hemmelgarn wrote: > > > On 2015-10-08 04:28, Pavel Pisa wrote: > > > >

Re: BTRFS RAID1 behavior after one drive temporal disconection

2015-10-08 Thread Hugo Mills
r the delay, I wrote this earlier, but had trouble sending it) > It is theoretically possible to wipe the FS signature on the out-of > sync drive, run a device scan, then run 'replace missing' pointing > at the now 'blank' device, although going that route is really > risky. >

Re: Questions about FIEMAP

2015-10-12 Thread Hugo Mills
file's location will have changed. This is the same reason that btrfs doesn't support swap files (although I don't know if swapon uses FIEMAP directly, or if there's just some equivalent mechanism to get the blocks). Hugo. -- Hugo Mills | Have found Lost City of Atlantis. High Priest

Re: btrfs subvolume clone or fork (btrfs-progs feature request)

2015-07-09 Thread Hugo Mills
in. Are you thinking of the read-only flag? That's not the same thing as the various UUID properties (e.g. parent) which can be used to detemine if a subvolume was made using a snapshot. Hugo. -- Hugo Mills | Someone's been throwing dead sheep down my Fun Well hugo@... carfax.org.uk

Re: Send/Receive Use Case

2015-07-10 Thread Hugo Mills
raw storage. Hugo. or do they need to be of the same replication scheme too ? On Jun 27, 2015, at 10:34 AM, Vincent Olivier vinc...@up4.com wrote: ok i’ll go home and rethink my life then ;) On Jun 27, 2015, at 10:21 AM, Hugo Mills h...@carfax.org.uk wrote: On Sat, Jun 27

Re: Concurrent write access

2015-07-09 Thread Hugo Mills
tried this one, because Samba and I get on like a house on fire(*). Hugo. (*) Screaming, shouting, people running away, emergency services. -- Hugo Mills | Alert status mauve ocelot: Slight chance of hugo@... carfax.org.uk | brimstone. Be prepared to make a nice cup of tea. http

Re: Kernel 3.19 and still "disk full" even though 'btrfs fi df" reports enough room left?

2015-11-18 Thread Hugo Mills
> ZFS since the very first day. With snapshots & all the fancy stuff like > ZRAID-1, lz4, ... My number of Issues there: 0 > -- Hugo Mills | Close enough for government work. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Btrfs duperemove corrupt data while dedup

2015-08-26 Thread Hugo Mills
- more corrupted. Smart of the disk, it's not looks, like damaged. (attach) What i can provide to help fix this issue? If it's needed, i can recompile kernel with some parameters if it can help, of course. -- Hugo Mills | Something must be done! hugo@... carfax.org.uk

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
doesn't work and eats your filesystem, sets fire to your sofa and feeds strychnine to your cat(*). I can't really recommend trying it. You can change the UUID offline using a recent (4.1 or later) version of btrfstune. Hugo. (*) No sofas were harmed in the writing of this email. -- Hugo

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
there's some separate handling to still keep the fs instances separate, but I don't know how that works at all or how ext4 and Btrfs differ. See my other email in this thread. :) Hugo. -- Hugo Mills | You know... I'm sure this code would seem a lot hugo@... carfax.org.uk | better

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
. ;) You need one full send to start off the process. After that, you can use the incremental feature. On Thu, Aug 27, 2015 at 05:59:47PM +, Hugo Mills wrote: See my other email in this thread. :) Didn't get that. Should I? Yes, you should have got it. You were cc'd. It's the one

Re: Understanding BTRFS storage

2015-08-28 Thread Hugo Mills
to help get it working again. -- Hugo Mills | Beware geeks bearing GIFs hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Understanding BTRFS storage

2015-08-26 Thread Hugo Mills
or replace them (with different sizes). Hugo. -- Hugo Mills | Preventing talpidian orogenesis. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: BTRFS cannot remove empty directory pretending it is not empty

2015-08-25 Thread Hugo Mills
on the problem and should eventually get it right, but it's just an incredibly difficult issue that has taken multiple tries. -- Hugo Mills | Great oxymorons of the world, no. 5: hugo@... carfax.org.uk | Manifesto Promise http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc

Re: unable to mount multi disk volume with recovery mode

2015-09-04 Thread Hugo Mills
the FS to be even partly recoverable with a missing device. (Or RAID-10, -5 or -6). Hugo. -- Hugo Mills | "There's more than one way to do it" is not a hugo@... carfax.org.uk | commandment. It is a dire warning. http://carfax.org.uk/ | PGP: E2AB1DE4 |

Re: unable to mount multi disk volume with recovery mode

2015-09-05 Thread Hugo Mills
. There's probably not enough of it left to make anything coherent. Hugo. > Thanks > > 2015-09-04 23:17 GMT+02:00 Hugo Mills <h...@carfax.org.uk>: > > On Fri, Sep 04, 2015 at 09:07:34PM +, Ivan wrote: > >> > >> Just to add this: > >> > &g

Re: unable to mount multi disk volume with recovery mode

2015-09-07 Thread Hugo Mills
On Mon, Sep 07, 2015 at 11:58:45AM -0600, Chris Murphy wrote: > On Sat, Sep 5, 2015 at 4:42 AM, Hugo Mills <h...@carfax.org.uk> wrote: > > On Sat, Sep 05, 2015 at 12:13:30PM +0200, Ivan Petrovic wrote: > > >> So you're saying that I can't make first and third partition

Re: raid6 + hot spare question

2015-09-08 Thread Hugo Mills
ally going from 5-drive raid6 to 4-drive > raid6). > > Can anyone confirm my assumption? Can I indeed rebalance from > 5-drive raid6 to 4-drive raid6 if the volume is not too big? Yes, you can, provided, as you say, the data is small enough to fit into the reduced filesystem. Hu

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
uld be a btrfs dev drop, which is the fail-like operation: tell the FS that a device is useless, and should be dropped from the array, so the FS doesn't keep trying to write to it. That's not implemented yet, though. Hugo. -- Hugo Mills | Alert status mauve ocelot: Slight chanc

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
; > make a mess of things... > > It is not possible to add a device to an ro filesystem, so effectively > the fs read-writeability is broken in this case. I thought this particular issue had already been dealt with in 4.2? (i.e. you can still mount an FS RW if it's degraded,

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
On Tue, Sep 08, 2015 at 10:33:54PM +0200, Ian Kumlien wrote: > On 8 September 2015 at 22:28, Hugo Mills <h...@carfax.org.uk> wrote: > > On Tue, Sep 08, 2015 at 02:17:55PM -0600, Chris Murphy wrote: > >> On Tue, Sep 8, 2015 at 2:13 PM, Ian Kumlien <ian.kuml...@gm

Re: How to properly and efficiently balance RAID6 after more drives are added?

2015-09-02 Thread Hugo Mills
probably will. These are going to take a very long time to run (in your case, I'd guess at least a week for each balance). I would recommend starting the balance in a tmux or screen session, and also creating a second shell in the same session to run monitoring processes. I typically use something lik

Re: Recovery possible on asynchronous transid ?

2015-09-15 Thread Hugo Mills
63414272(gen: 293905 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 100290560(gen: 293904 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 61906944(gen: 293904 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 99393536(gen: 293903 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 79740928(gen: 293903 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 47403008(gen: 293901 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 42622976(gen: 293899 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 40329216(gen: 293898 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 38137856(gen: 293897 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 36515840(gen: 293896 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > -x--x---x--x-- > > Thanks in advance > > > mit freundlichen Grüßen > Jürgen Sauer -- Hugo Mills | vi: The core of evil. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Csum I/O Error

2015-09-15 Thread Hugo Mills
with zeroes -- which is no worse than the random data you're likely to encounter from reading the broken data that the FS is (rightly) protecting you from. Hugo. -- Hugo Mills | A diverse working environment: Di longer you vork hugo@... carfax.org.uk | here, di verse it gets http://

Re: FYIO: A rant about btrfs

2015-09-16 Thread Hugo Mills
oadmap, but the roadmap is notoriously > short-sighted when it comes to time-frame for completion of > something. You have to understand also that the focus in BTRFS has > also been more on data safety than performance, because that's the > intended niche, and the area most people look to ZF

Re: FYIO: A rant about btrfs

2015-09-16 Thread Hugo Mills
king > >about general purpose use or is he talking about general purpose OLTP use? > > > My takeaway was that he intended 'general purpose use' to mean > generic every day usage across a wide variety of systems, he was not > particularly specific about it however. - -- Hugo M

Re: BTRFS as image store for KVM?

2015-09-17 Thread Hugo Mills
] No. If you try doing that particular combination of features, you end up with a filesystem that can be inconsistent: there's a race condition between updating the data in a file and updating the csum record for it, and the race can't be fixed. Hugo. -- Hugo Mills | I spent most of my

Re: Add stripes filter

2015-09-29 Thread Hugo Mills
by having one (for RAID-0) or up to three (for RAID-10) devices with more space left than the rest. Hugo. -- Hugo Mills | Dullest spy film ever: The Eastbourne Ultimatum hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | The Thick of It signature.asc Description: Digital signature

Re: [PATCH v2] fstests: generic: Check if a bull fallocate will change extent number

2015-09-29 Thread Hugo Mills
> diff --git a/tests/generic/110.out b/tests/generic/110.out > new file mode 100644 > index 000..64049da > --- /dev/null > +++ b/tests/generic/110.out > @@ -0,0 +1,3 @@ > +QA output created by 110 > +wrote 66560/66560 bytes at offset 0 > +XXX Bytes, X ops; XX:XX:

Re: [PATCH v2] fstests: generic: Check if a bull fallocate will change extent number

2015-09-29 Thread Hugo Mills
On Tue, Sep 29, 2015 at 06:13:37PM +0800, Qu Wenruo wrote: > > > 在 2015年09月29日 18:00, Hugo Mills 写道: > >On Tue, Sep 29, 2015 at 05:34:24PM +0800, Qu Wenruo wrote: > >>Normally, a bull fallocate call on a fully written and synced file > >>should not add an

Re: RAID5 doesn't mount on boot, but you can afterwards?

2015-10-01 Thread Hugo Mills
that time though) and mounted it just fine with the > LABEL only, so it might be something with RAID5. > > Anyway it's working now with just a much longer fstab line ;) > > Cheers, > Sjoerd > -- Hugo Mills | Vote early, vote often hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs: user space tool to force compression

2015-10-02 Thread Hugo Mills
w to force data recompression? btrfs fi defrag -c Hugo. -- Hugo Mills | A cross? Oy vey, have you picked the wrong vampire! hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs: obtain block checksums from user space

2015-09-28 Thread Hugo Mills
ke this on one > machine: > > [ 256MB ][    512 MB    ][ 256MB ] > > And like this on the other: > [     512MB     ][     512MB     ] > > Since the checksums are per block, and the blocks can be different > arrangements on different machines, they're not

Re: Unmountable btrfs after power failure

2015-09-09 Thread Hugo Mills
l support your use of btrfs on a kernel that old). 3.19 is about the earliest kernel I'd feel happy about using at this point. Hugo. -- Hugo Mills | UNIX: Japanese brand of food containers hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-23 Thread Hugo Mills
On Wed, Sep 23, 2015 at 03:12:26PM +0200, David Sterba wrote: > On Tue, Sep 22, 2015 at 02:36:02PM +0000, Hugo Mills wrote: > > > Yeah, right now there's no persistent default for the allocator. I'm > > > still hoping that the object properties will magically solve that

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-23 Thread Hugo Mills
On Wed, Sep 23, 2015 at 09:19:38PM +0800, Qu Wenruo wrote: > 在 2015年09月23日 21:12, David Sterba 写道: > >On Tue, Sep 22, 2015 at 02:36:02PM +0000, Hugo Mills wrote: > >>>Yeah, right now there's no persistent default for the allocator. I'm > >>>still hoping that the

Re: Btrfs check dont repair

2015-09-23 Thread Hugo Mills
> > [root@rak ~]# btrfs --version > btrfs-progs v4.2 > > [root@rak ~]# btrfs fi show > Label: 'data' uuid: 754a3186-c0ae-4680-ab28-864c8bdad8b5 > Total devices 1 FS bytes used 1.23TiB > devid1 size 1.72TiB used 1.24TiB path /dev/sdb2 > > bt

Re: btrfs receive bigger than original snapshot?

2015-09-22 Thread Hugo Mills
een the extremes of reckless rsync and overly > accurate git. It's just a steep learning mountain. > > > *) I used fdupes' output ran through a perl script that calls > "cp --reflink" for each match. Would "bedup" or "duperemove" > do a better job? bed

Re: Latest kernel to use?

2015-09-24 Thread Hugo Mills
- the 4.3.x (mainline)? > > Stable sounds more stable to me(hence the name ;) ), but the mainline kernel > seems to be in more active development? I'd suggest sticking to the 4.2 series for now. 4.3 will be in pre-release state for another couple of months (give or take).

Re: Too many missing devices, writeable mount is not allowed

2015-09-25 Thread Hugo Mills
et, which should then show up in btfs fi show, and allow you to keep using the FS. Hugo. -- Hugo Mills | If you see something, say nothing and drink to hugo@... carfax.org.uk | forget http://carfax.org.uk/ | PGP: E2AB1DE4 | Welcome to Night Vale signature.asc Description: Digital signature

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
As it stands, we can fake that in mkfs but it'll get stomped > > by balance nearly immediately. > > Please share those casual thoughts with the group. :) I had some as well last year (see my other mail). I hope they line up with Jeff's. :) Hugo. -- Hug

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
PeU52cfWHL05axe8l75pU6Ywwrk406QxyrTvx > 2Rh8tXBJItUeMA/D8mRnwWVZBWFUndl6JlBNSyf51fSP+4lPkChbM5UnSOjDOwvE > E7XpGy31TQI0bqpy8qoIkI9wkek6iOlMCppZ9U2vICbeP+65WtNZKfQcCO0t6Z1H > 6IqfHsaDvvaiorxEWWIarsIfHZWnWJeav545t6pd4VU3v52YQN2YIOLY8EhWv4Wt > 90Xc1izPvPvnyQa3eQPg1ISdqNfJRFlYjSJ75zGvSPurIy77oOyvPa1EfEO7IMys >

Re: BTRFS kernel error on mounted partition. Partition has errors detected but not repaired by btrfs-check.

2015-09-22 Thread Hugo Mills
s mounted in two > different places, and that I have some VMs on it, and am using the > nocow attribute on the VM files. > > Regards, > Sylvain -- Hugo Mills | "Can I offer you anything? Tea? Seedcake? Glass of hugo@... carfax.org.uk | Amontillado?" http://carfax

Re: Btrfs partition gets remounted as read only

2015-09-21 Thread Hugo Mills
nted (and it's definitely a > bug that it's not doing so today), but is unlikely to be ideal for a > different filesystem than the one it started out as. > -- Hugo Mills | vi vi vi: the Editor of the Beast. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: problem with long running btrfs mount operation

2015-09-22 Thread Hugo Mills
evice after I have unmount it? BTW: Is btrfs-progs needed for mounting? > > I should have been more clear and say "run btrfs check", which I originally > intended to write but then somehow didn't. Sorry. :-) > > btrfs-progs is not needed for mounting, only for administrativ

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
On Tue, Sep 22, 2015 at 04:23:33PM +0200, David Sterba wrote: > On Tue, Sep 22, 2015 at 01:41:31PM +0000, Hugo Mills wrote: > > On Tue, Sep 22, 2015 at 03:36:43PM +0200, Holger Hoffstätte wrote: > > > On 09/22/15 14:59, Jeff Mahoney wrote: > > > (snip) > > >

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
On Tue, Sep 22, 2015 at 10:54:45AM -0400, Austin S Hemmelgarn wrote: > On 2015-09-22 10:36, Hugo Mills wrote: > >On Tue, Sep 22, 2015 at 04:23:33PM +0200, David Sterba wrote: > >>On Tue, Sep 22, 2015 at 01:41:31PM +, Hugo Mills wrote: > >>>On Tue, Sep 22, 20

Re: Latest kernel to use?

2015-09-25 Thread Hugo Mills
ing the latest stable, and things have improved quite a bit. :) Hugo. -- Hugo Mills | For months now, we have been making triumphant hugo@... carfax.org.uk | retreats before a demoralised enemy who is advancing http://carfax.org.uk/ | in utter di

Re: Btrfs check dont repair

2015-09-25 Thread Hugo Mills
> Yes, I have bad ram. I ran memtest and memory is really bad. > > > > So a must buy new memory first. > > > > Thank you. > > > > Frantisek > > > > 2015-09-23 16:43 GMT+02:00 Hugo Mills <h...@carfax.org.uk>: > >> On Wed, Sep 23, 2

Re: Issues with unmountable BTRFS raid1 filesystem

2015-10-05 Thread Hugo Mills
, PSU, or CPU would be manifesting > with many more issues than just this. > 3. A disk failure would mean that two different disks, from > different manufacturing lots, are encountering errors on exactly the > same LBA's at exactly the same time, which while possible is > a

Re: btrfs scrub can neither start nor cancel

2015-12-08 Thread Hugo Mills
fs scrub start /t4 > ERROR: scrub is already running. > To cancel use 'btrfs scrub cancel /t4'. > To see the status use 'btrfs scrub status [-d] /t4'. > > -- Hugo Mills | Go not to the elves for counsel, for they will say hugo@... carfax.org.uk | both no and yes. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Bug/regression: Read-only mount not read-only

2015-12-02 Thread Hugo Mills
or ext4 support removing the > norecovery option from the mount flags through mount -o remount? > Even if they don't, that might be a nice feature to have in BTRFS if > we can safely support it. One minor awkwardness with "norecovery", I've just realised: we already h

Re: Subvolume UUID, data corruption?

2015-12-04 Thread Hugo Mills
d function correctly when received. (I can give you chapter and verse on how they're used if you like, but that's a bit excessive just for answering your question here). Hugo. > Thank you > > PS: Apologies for sending a second mail, somehow my first try didn't contain > any

Re: Subvolume UUID, data corruption?

2015-12-05 Thread Hugo Mills
On Sat, Dec 05, 2015 at 04:28:24AM +0100, Christoph Anton Mitterer wrote: > On Fri, 2015-12-04 at 13:07 +0000, Hugo Mills wrote: > > I don't think it'll cause problems. > Is there any guaranteed behaviour when btrfs encounters two filesystems > (i.e. not talking about

Re: Bug/regression: Read-only mount not read-only

2015-12-02 Thread Hugo Mills
to implement it first for non-remountable case as a try. > And for the option name, I prefer something like "notreereplay", but > I don't consider it the best one yet Thinking out loud... no-log-replay, no-log, hard-ro, ro-log, really-read-only-i-mean-it-this-time-honest-guvnor Delete hyphens at your pleasure. Hugo. -- Hugo Mills | ORLY? IÄ! R'LYH! hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: attacking btrfs filesystems via UUID collisions?

2015-12-10 Thread Hugo Mills
t anywhere near as simple as copying it with dd. The UUID > gets used internally somehow, and changing it would require rewriting > _all_ the metadata blocks. Indeed, but there is now a tool to do that. :) (btrfstune -u or -U) Hugo. -- Hugo Mills | Go not to the elves for counsel, for they will say hugo@... carfax.org.uk | both no and yes. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Kernel lockup, might be helpful log.

2015-12-14 Thread Hugo Mills
tracebacks, > because it's the method chosen to deliberately trigger them. It's not just btrfs. Invalid opcode is the way that the kernel's BUG and BUG_ON macro is implemented. Hugo. -- Hugo Mills | Great oxymorons of the world, no. 10: hugo@... carfax.org.uk | Business Ethics http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: attacking btrfs filesystems via UUID collisions?

2015-12-15 Thread Hugo Mills
it's known there's a > >mismatch. > > > That gets tricky too, because for example you have stuff like flat > files used as filesystem images. > > However, if we then use some separate UUID (possibly hashed off of > the file location) in place of the device serial/WWN, th

Re: attacking btrfs filesystems via UUID collisions?

2015-12-15 Thread Hugo Mills
On Tue, Dec 15, 2015 at 09:27:12AM -0500, Austin S. Hemmelgarn wrote: > On 2015-12-15 09:18, Hugo Mills wrote: > >On Tue, Dec 15, 2015 at 08:54:01AM -0500, Austin S. Hemmelgarn wrote: > >>On 2015-12-14 16:26, Chris Murphy wrote: > >>>On Mon, Dec 14, 2015 at

Re: BTRFS File trace from superblock using memory dumps

2015-12-31 Thread Hugo Mills
erblock to find the tree of tree roots, and then follow that into the other trees (at which point, you can start using the data structures page). Hugo. -- Hugo Mills | Comic Sans goes into a bar, and the barman says, "We hugo@... carfax.org.uk | don't serve your type here." http

Re: RAID10 question

2015-12-31 Thread Hugo Mills
uestion is: can I achieve that directly with BTRFS > RAID10? No, not at the moment. Hugo. -- Hugo Mills | Comic Sans goes into a bar, and the barman says, "We hugo@... carfax.org.uk | don't serve your type here." http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs fail behavior when a device vanishes

2015-12-31 Thread Hugo Mills
e insertion, > formatting, mounting, copying to then from, and device yanking is here > (should be permanent): > http://pastebin.com/raw/Wfe1pY4N > > And the copy did successfully complete anyway, and the resulting files > have the same hashes as their originals. So, yay, despite

Re: how btrfs uses devid?

2016-01-01 Thread Hugo Mills
tree. If one of those doesn't match up with a currently-known device for that filesystem (as determined by btrfs dev scan), then it's missing. Hugo. -- Hugo Mills | I gave up smoking, drinking and sex once. It was the hugo@... carfax.org.uk | scariest 20 minutes of my life. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: defrag vs autodefrag

2015-12-22 Thread Hugo Mills
On Mon, Dec 21, 2015 at 09:28:37AM +, Filipe Manana wrote: > On Mon, Dec 21, 2015 at 8:14 AM, Hugo Mills <h...@carfax.org.uk> wrote: > > On Sun, Dec 20, 2015 at 07:26:07PM -0600, Donald Pearson wrote: > >> I read an implication in a different thread that defrag an

Re: How to change BTRFS filesystem UUID

2015-12-27 Thread Hugo Mills
e the same > ID. > > This seem to confuse UDEV, because /dev/disk/by-uuid seem to show > just one link, not two links to two disks. > > Is there a way to change the BTRFS ID (generate new one) that I can > differentiate between the two disks on one host? btrfstune, with -u or -U H

Re: [PATCH] improve documentation of snapshot unaware defrag

2015-12-27 Thread Hugo Mills
Isn't this an FAQ already? There is already a patch to rename the RAID modes. It's been sitting in the progs patch queue for about 2 years, because none of the senior devs has acked it yet (since it's a big user-visible change). Hugo. -- Hugo Mills | Talking about music i

Re: How to change BTRFS filesystem UUID

2015-12-27 Thread Hugo Mills
> So whenever you do your recovery works, make sure that there's never a > moment where more than one btrfs block device appears with the same > UUID. > Even when it's just for some seconds it may already cause corruption. > > > Cheers, > Chris. -- Hugo Mills |

Re: corrupt lead, bad key order & no csum found for inode & csum failed ino & input/output error

2015-12-27 Thread Hugo Mills
, but don't even know > what they are in the context of btrfs. If it's a single file, how do > I use the corrupt leaf, bad key order block number to see what it > corresponds to, like I did with btrfs inspect-internal with the > inodes? -- Hugo Mills | Talking about music is like dancing about hugo@... carfax.org.uk | architecture http://carfax.org.uk/ | PGP: E2AB1DE4 | Frank Zappa signature.asc Description: Digital signature

Re: defrag vs autodefrag

2015-12-21 Thread Hugo Mills
te, as well as just the piece that's being written by userspace). Hugo. -- Hugo Mills | UNIX: Japanese brand of food containers hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: BTRFS: could not find root 8

2015-12-24 Thread Hugo Mills
oot 8 > [ 25.855431] BTRFS: could not find root 8 > [ 25.856834] BTRFS: could not find root 8 > [ 25.860539] BTRFS: could not find root 8 > [ 25.862021] BTRFS: could not find root 8 > [ 29.778795] IPv6: ADDRCONF(NETDEV_UP): enp3s0: link is not ready > … >

Re: shall distros run btrfsck on boot?

2015-11-24 Thread Hugo Mills
fy the disk data after an unclean shitdown, in order to be useful (because the FS isn't consistent without the journal replay). Hugo. -- Hugo Mills | I'll take your bet, but make it ten thousand francs. hugo@... carfax.org.uk | I'm only a _poor_ corrupt offici

Re: subvols and parents - how?

2015-11-24 Thread Hugo Mills
On Wed, Nov 25, 2015 at 12:20:09AM +0100, Christoph Anton Mitterer wrote: > On Tue, 2015-11-24 at 21:55 +0000, Hugo Mills wrote: > >    In practice, new content is checked by a number of people when > > it's > > put in, so the case of someone putting random poorly-thought-out

Re: shall distros run btrfsck on boot?

2015-11-24 Thread Hugo Mills
On Wed, Nov 25, 2015 at 12:01:49AM +0100, Christoph Anton Mitterer wrote: > On Tue, 2015-11-24 at 22:33 +0000, Hugo Mills wrote: > > whereas a read-only mount of a journalling FS _must_ modify the disk > > data after an unclean shitdown, in order to be useful (because the FS >

Re: subvols and parents - how?

2015-11-24 Thread Hugo Mills
parent IDs accordingly... Pretty much, yes. Note that the "parent" of send -p and of snapshots is not the same relationship as the "parent" (containing subvol) of the tree structure. This is an awkward nomenclature problem, and I'm not sure how to fix it. The first m

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Hugo Mills
(writable) snapshot of the reference subvol, and modifies it according to the stream data. -c makes a new empty subvol, and populates it from scratch, using the reflink ioctl to use data which is known to exist in the reference subvols. Hugo. -- Hugo Mills | Anyone who claims

Re: btrfs check help

2015-11-24 Thread Hugo Mills
; >total extent tree bytes: 3075457024 > >btree space waste bytes: 2880474254 > The only other thing I know that's worth mentioning is that if the > numbers on these next two lines don't match, you may be missing some > writes from right before the crash. > >file data blocks al

Re: [auto-]defrag, nodatacow - general suggestions?(was: btrfs: poor performance on deleting many large files?)

2015-11-25 Thread Hugo Mills
expect > it (e.g. the defrag or the balance+compression case?)... btrfs seem to > require much more in-depth knowledge and especially care (that even > depends on the type of data) on the end-user/admin side than the > traditional filesystems. > Are there for example any gene

Re: Imbalanced RAID1 with three unequal disks

2015-11-25 Thread Hugo Mills
s. Hugo. > Thank you! > Mario > > [1] > http://git.kernel.org/cgit/linux/kernel/git/mkp/linux.git/commit/?h=bugzilla-93581=7c4fbd50bfece00abf529bc96ac989dd2bb83ca4 > [2] https://bugzilla.kernel.org/show_bug.cgi?id=93581 -- Hugo Mills | I was cursed with poetry very youn

Re: BTRFS: could not find root 8

2015-11-27 Thread Hugo Mills
That's the quota tree. I don't know exactly what's happening, but possibly systemd is now enabling qgroups for its own purposes, and what you're seeing is simply the qgroups being enabled for the first time? Hugo. -- Hugo Mills | Great oxymorons of the world, no. 8: hugo@... carfa

Bug/regression: Read-only mount not read-only

2015-11-28 Thread Hugo Mills
We've just had someone on IRC with a problem mounting their FS. The main problem is that they've got a corrupt log tree. That isn't the subject of this email, though. The issue I'd like to raise is that even with -oro as a point option, the FS is trying to replay the log tree. The dmesg

Re: "disk full" on a 5 GB btrfs filesystem, FAQ outdated?

2015-11-29 Thread Hugo Mills
btrfs --convert=single --force balance, btfs > device remove, btr balance start -mconvert=dup --force and finally > balance start again. > > Is there any solution to solve this more elegantly? Recreate the FS with --mixed, and that should deal with it. Hugo. -- Hugo Mills | There isn't a noun that can't be verbed. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs send reproducibly fails for a specific subvolume after sending 15 GiB, scrub reports no errors

2015-11-24 Thread Hugo Mills
On Tue, Nov 24, 2015 at 10:36:26PM +0100, Christoph Anton Mitterer wrote: > On Tue, 2015-11-24 at 21:27 +0000, Hugo Mills wrote: > >    -p only sends the file metadata for the changes from the reference > > snapshot to the sent snapshot. -c sends all the file metadata, but &g

Re: Bug/regression: Read-only mount not read-only

2015-11-30 Thread Hugo Mills
On Mon, Nov 30, 2015 at 11:48:01AM -0500, Chris Mason wrote: > On Sat, Nov 28, 2015 at 01:46:34PM +0000, Hugo Mills wrote: > >We've just had someone on IRC with a problem mounting their FS. The > > main problem is that they've got a corrupt log tree. That isn't the > >

Re: Bug/regression: Read-only mount not read-only

2015-11-30 Thread Hugo Mills
On Mon, Nov 30, 2015 at 09:59:40AM -0500, Austin S Hemmelgarn wrote: > On 2015-11-28 08:46, Hugo Mills wrote: > >We've just had someone on IRC with a problem mounting their FS. The > >main problem is that they've got a corrupt log tree. That isn't the > >subject

Re: Kernel 3.19 and still "disk full" even though 'btrfs fi df" reports enough room left?

2015-11-20 Thread Hugo Mills
> >>would lose the fact that global reserve is actually in use, that the > >>broken out global reserve line exposes. > >> > >>I'd actually argue in favor of the latter, directly folding global > >>reserve allocation into metadata used, sinc

Re: anything wrong with `balance -dusage -musage` together?

2015-11-19 Thread Hugo Mills
er. This is typically too much data allocation, and metadata has run out (so -d is more often used than -m). For the "usual" case of running out of metadata allocation, you don't actually need much space to reclaim, so -dlimit=X for small X is an easier approach to

Re: free space is missing after dist upgrade on lzo compressed vol

2015-11-21 Thread Hugo Mills
s that by > >> default. Never heard of snapper before. > >> > >> Don't see how open files could be a problem, since the computer has > >> been rebooted several times. > >> > >> I wonder... could the distribution upgrade have moved all the old > &g

Re: btrfs

2016-06-05 Thread Hugo Mills
that can be put in place (true CoW rather than btrfs's redirect-on-write, like some databases do, where the original data is copied elsewhere before overwriting; cache aggressively and with knowledge of the CoW nature of the FS, like ZFS does), but they all have their drawbacks and pathologica

Re: [PATCH] btrfs: chunk_width_limit mount option

2016-06-06 Thread Hugo Mills
guration, applied to the top of subvol 5. If the feature allows configuration on a per-subvol or per-object basis, then there should also be a name for the relevant xattr (also in the btrfs namespace) that can be created on each object as required. Hugo. -- Hugo Mills | Klytus, I'm

Re: What is the worst case scenario of splitting an extent-tree's node or leaf?

2016-06-06 Thread Hugo Mills
te > the number that the split starts looping. For reference for anyone replying, we've already had this conversation as far as I could manage it on IRC a few days ago: http://logs.tvrrug.org.uk/logs/%23btrfs/2016-05-29.html#2016-05-29T10:13:53 Hugo. -- Hugo Mills | In one respect at l

Re: "No space left on device" and balance doesn't work

2016-06-04 Thread Hugo Mills
lance decides where to put data from chunks it frees? I.e. let's > say I have one free data chunk and 10 chunks filled to 10%. Will "btrfs > ba start -dusage=10" pack data from all 10 chunks into single one, this > freeing 10 chunks for further processing? Yes, it w

Re: [PATCH] btrfs-progs: utils: use better wrappered random generator

2016-05-25 Thread Hugo Mills
schemes, so we'll use a standard random number source or API. > > /dev/random gives about 1-2MB/s of random data on several machines I've > tried. Just use /dev/urandom? See, e.g. http://www.2uo.de/myths-about-urandom/ Hugo. -- Hugo Mills | Putting U back in Honor, Valor, and Trth. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: [PATCH] btrfs-progs: doc: correct the destination of btrfs-receive

2016-06-14 Thread Hugo Mills
an 'end cmd' marker in the stream. > > ie. all the context lines start with two spaces instead of one. I'll > apply this patch manually but please have a look. Looking at this, I suspect it's a consequence of sending it as "Content-Type: format=flowed; delsp=yes". I'm not sure wh

Re: [PATCH] Btrfs-progs: add check-only option for balance

2016-06-14 Thread Hugo Mills
ndexing works (concatenation of the key elements, resulting in lexical ordering of keys), you'd still have to do exactly the same work, only in the kernel instead. The only thing you really win is the number of context switches. It would really have to be a new ioctl, too. You can't change the behaviour of the existing one. Hugo. > > > > So, the important line here was: "...when the extent_item just > > manages to squeeze in as last result into the current result buffer > > from the ioctl..." > > > > -- Hugo Mills | "What are we going to do tonight?" hugo@... carfax.org.uk | "The same thing we do every night, Pinky. Try to http://carfax.org.uk/ | take over the world!" PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: [PATCH] btrfs: chunk_width_limit mount option

2016-06-14 Thread Hugo Mills
ee that appears to be currently unused, so > perhaps I will look at developing a group-aware allocator instead of > just limiting the chunk width. I made some design notes on a generalised approach for this a while ago: http://www.spinics.net/lists/linux-btrfs/msg33782.html http://www.spi

Re: raid5/6 production use status?

2016-06-02 Thread Hugo Mills
ocated: 18.19TiB > Device missing: 0.00B > Used:0.00B > Free (estimated):0.00B (min: 8.00EiB) > > btrfs --version ==> btrfs-progs v4.5.3-70-gc1c27b9 > kernel ==> 4.6.0 > > -- Hugo Mi

Re: btrfs on disk consistency

2016-05-26 Thread Hugo Mills
suspension, so it would be a really bad idea. In general, this would be the use-case for LVM. However, that's a dangerous operation with btrfs, because the snapshot ends up being included in the original FS (because it has the same UUID), and thus causes the kernel to get ver

Re: Is "btrfs balance start" truly asynchronous?

2016-06-21 Thread Hugo Mills
t easily start a balance on a > remote system via a ssh command, which is the specific use case I > have). There's quite a bit of infrastructure in the userspace tools to deal with managing an asynchronous scrub. It would probably be worth looking at that in the first instance to see if it can be reused for balance. Hugo. -- Hugo Mills | hugo@... carfax.org.uk | __(_'> http://carfax.org.uk/ | Squeak! PGP: E2AB1DE4 | signature.asc Description: Digital signature

<    6   7   8   9   10   11   12   13   14   >