Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-23 Thread Hugo Mills
On Wed, Sep 23, 2015 at 03:12:26PM +0200, David Sterba wrote: > On Tue, Sep 22, 2015 at 02:36:02PM +0000, Hugo Mills wrote: > > > Yeah, right now there's no persistent default for the allocator. I'm > > > still hoping that the object properties will magically solve that

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-23 Thread Hugo Mills
On Wed, Sep 23, 2015 at 09:19:38PM +0800, Qu Wenruo wrote: > 在 2015年09月23日 21:12, David Sterba 写道: > >On Tue, Sep 22, 2015 at 02:36:02PM +0000, Hugo Mills wrote: > >>>Yeah, right now there's no persistent default for the allocator. I'm > >>>still hoping that the

Re: Btrfs check dont repair

2015-09-23 Thread Hugo Mills
> > [root@rak ~]# btrfs --version > btrfs-progs v4.2 > > [root@rak ~]# btrfs fi show > Label: 'data' uuid: 754a3186-c0ae-4680-ab28-864c8bdad8b5 > Total devices 1 FS bytes used 1.23TiB > devid1 size 1.72TiB used 1.24TiB path /dev/sdb2 > > bt

Re: btrfs receive bigger than original snapshot?

2015-09-22 Thread Hugo Mills
een the extremes of reckless rsync and overly > accurate git. It's just a steep learning mountain. > > > *) I used fdupes' output ran through a perl script that calls > "cp --reflink" for each match. Would "bedup" or "duperemove" > do a better job? bed

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
As it stands, we can fake that in mkfs but it'll get stomped > > by balance nearly immediately. > > Please share those casual thoughts with the group. :) I had some as well last year (see my other mail). I hope they line up with Jeff's. :) Hugo. -- Hug

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
PeU52cfWHL05axe8l75pU6Ywwrk406QxyrTvx > 2Rh8tXBJItUeMA/D8mRnwWVZBWFUndl6JlBNSyf51fSP+4lPkChbM5UnSOjDOwvE > E7XpGy31TQI0bqpy8qoIkI9wkek6iOlMCppZ9U2vICbeP+65WtNZKfQcCO0t6Z1H > 6IqfHsaDvvaiorxEWWIarsIfHZWnWJeav545t6pd4VU3v52YQN2YIOLY8EhWv4Wt > 90Xc1izPvPvnyQa3eQPg1ISdqNfJRFlYjSJ75zGvSPurIy77oOyvPa1EfEO7IMys >

Re: BTRFS kernel error on mounted partition. Partition has errors detected but not repaired by btrfs-check.

2015-09-22 Thread Hugo Mills
s mounted in two > different places, and that I have some VMs on it, and am using the > nocow attribute on the VM files. > > Regards, > Sylvain -- Hugo Mills | "Can I offer you anything? Tea? Seedcake? Glass of hugo@... carfax.org.uk | Amontillado?" http://carfax

Re: problem with long running btrfs mount operation

2015-09-22 Thread Hugo Mills
evice after I have unmount it? BTW: Is btrfs-progs needed for mounting? > > I should have been more clear and say "run btrfs check", which I originally > intended to write but then somehow didn't. Sorry. :-) > > btrfs-progs is not needed for mounting, only for administrativ

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
On Tue, Sep 22, 2015 at 04:23:33PM +0200, David Sterba wrote: > On Tue, Sep 22, 2015 at 01:41:31PM +0000, Hugo Mills wrote: > > On Tue, Sep 22, 2015 at 03:36:43PM +0200, Holger Hoffstätte wrote: > > > On 09/22/15 14:59, Jeff Mahoney wrote: > > > (snip) > > >

Re: [PATCH] btrfs: Fix no space bug caused by removing bg

2015-09-22 Thread Hugo Mills
On Tue, Sep 22, 2015 at 10:54:45AM -0400, Austin S Hemmelgarn wrote: > On 2015-09-22 10:36, Hugo Mills wrote: > >On Tue, Sep 22, 2015 at 04:23:33PM +0200, David Sterba wrote: > >>On Tue, Sep 22, 2015 at 01:41:31PM +, Hugo Mills wrote: > >>>On Tue, Sep 22, 20

Re: Btrfs partition gets remounted as read only

2015-09-21 Thread Hugo Mills
nted (and it's definitely a > bug that it's not doing so today), but is unlikely to be ideal for a > different filesystem than the one it started out as. > -- Hugo Mills | vi vi vi: the Editor of the Beast. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: BTRFS as image store for KVM?

2015-09-17 Thread Hugo Mills
] No. If you try doing that particular combination of features, you end up with a filesystem that can be inconsistent: there's a race condition between updating the data in a file and updating the csum record for it, and the race can't be fixed. Hugo. -- Hugo Mills | I spent most of my

Re: FYIO: A rant about btrfs

2015-09-16 Thread Hugo Mills
oadmap, but the roadmap is notoriously > short-sighted when it comes to time-frame for completion of > something. You have to understand also that the focus in BTRFS has > also been more on data safety than performance, because that's the > intended niche, and the area most people look to ZF

Re: FYIO: A rant about btrfs

2015-09-16 Thread Hugo Mills
king > >about general purpose use or is he talking about general purpose OLTP use? > > > My takeaway was that he intended 'general purpose use' to mean > generic every day usage across a wide variety of systems, he was not > particularly specific about it however. - -- Hugo M

Re: Recovery possible on asynchronous transid ?

2015-09-15 Thread Hugo Mills
63414272(gen: 293905 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 100290560(gen: 293904 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 61906944(gen: 293904 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 99393536(gen: 293903 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 79740928(gen: 293903 level: 0) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 47403008(gen: 293901 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 42622976(gen: 293899 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 40329216(gen: 293898 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 38137856(gen: 293897 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > Well block 36515840(gen: 293896 level: 2) seems good, but > generation/level doesn't match, want gen: 293924 level: 2 > -x--x---x--x-- > > Thanks in advance > > > mit freundlichen Grüßen > Jürgen Sauer -- Hugo Mills | vi: The core of evil. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Csum I/O Error

2015-09-15 Thread Hugo Mills
with zeroes -- which is no worse than the random data you're likely to encounter from reading the broken data that the FS is (rightly) protecting you from. Hugo. -- Hugo Mills | A diverse working environment: Di longer you vork hugo@... carfax.org.uk | here, di verse it gets http://

Re: Unmountable btrfs after power failure

2015-09-09 Thread Hugo Mills
l support your use of btrfs on a kernel that old). 3.19 is about the earliest kernel I'd feel happy about using at this point. Hugo. -- Hugo Mills | UNIX: Japanese brand of food containers hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: raid6 + hot spare question

2015-09-08 Thread Hugo Mills
ally going from 5-drive raid6 to 4-drive > raid6). > > Can anyone confirm my assumption? Can I indeed rebalance from > 5-drive raid6 to 4-drive raid6 if the volume is not too big? Yes, you can, provided, as you say, the data is small enough to fit into the reduced filesystem. Hu

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
uld be a btrfs dev drop, which is the fail-like operation: tell the FS that a device is useless, and should be dropped from the array, so the FS doesn't keep trying to write to it. That's not implemented yet, though. Hugo. -- Hugo Mills | Alert status mauve ocelot: Slight chanc

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
; > make a mess of things... > > It is not possible to add a device to an ro filesystem, so effectively > the fs read-writeability is broken in this case. I thought this particular issue had already been dealt with in 4.2? (i.e. you can still mount an FS RW if it's degraded,

Re: [btrfs tools] ability to fail a device...

2015-09-08 Thread Hugo Mills
On Tue, Sep 08, 2015 at 10:33:54PM +0200, Ian Kumlien wrote: > On 8 September 2015 at 22:28, Hugo Mills <h...@carfax.org.uk> wrote: > > On Tue, Sep 08, 2015 at 02:17:55PM -0600, Chris Murphy wrote: > >> On Tue, Sep 8, 2015 at 2:13 PM, Ian Kumlien <ian.kuml...@gm

Re: unable to mount multi disk volume with recovery mode

2015-09-07 Thread Hugo Mills
On Mon, Sep 07, 2015 at 11:58:45AM -0600, Chris Murphy wrote: > On Sat, Sep 5, 2015 at 4:42 AM, Hugo Mills <h...@carfax.org.uk> wrote: > > On Sat, Sep 05, 2015 at 12:13:30PM +0200, Ivan Petrovic wrote: > > >> So you're saying that I can't make first and third partition

Re: unable to mount multi disk volume with recovery mode

2015-09-05 Thread Hugo Mills
. There's probably not enough of it left to make anything coherent. Hugo. > Thanks > > 2015-09-04 23:17 GMT+02:00 Hugo Mills <h...@carfax.org.uk>: > > On Fri, Sep 04, 2015 at 09:07:34PM +, Ivan wrote: > >> > >> Just to add this: > >> > &g

Re: unable to mount multi disk volume with recovery mode

2015-09-04 Thread Hugo Mills
the FS to be even partly recoverable with a missing device. (Or RAID-10, -5 or -6). Hugo. -- Hugo Mills | "There's more than one way to do it" is not a hugo@... carfax.org.uk | commandment. It is a dire warning. http://carfax.org.uk/ | PGP: E2AB1DE4 |

Re: How to properly and efficiently balance RAID6 after more drives are added?

2015-09-02 Thread Hugo Mills
probably will. These are going to take a very long time to run (in your case, I'd guess at least a week for each balance). I would recommend starting the balance in a tmux or screen session, and also creating a second shell in the same session to run monitoring processes. I typically use something lik

Re: Understanding BTRFS storage

2015-08-28 Thread Hugo Mills
to help get it working again. -- Hugo Mills | Beware geeks bearing GIFs hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
doesn't work and eats your filesystem, sets fire to your sofa and feeds strychnine to your cat(*). I can't really recommend trying it. You can change the UUID offline using a recent (4.1 or later) version of btrfstune. Hugo. (*) No sofas were harmed in the writing of this email. -- Hugo

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
there's some separate handling to still keep the fs instances separate, but I don't know how that works at all or how ext4 and Btrfs differ. See my other email in this thread. :) Hugo. -- Hugo Mills | You know... I'm sure this code would seem a lot hugo@... carfax.org.uk | better

Re: Impossible to mount two different copies of the same btrfs

2015-08-27 Thread Hugo Mills
. ;) You need one full send to start off the process. After that, you can use the incremental feature. On Thu, Aug 27, 2015 at 05:59:47PM +, Hugo Mills wrote: See my other email in this thread. :) Didn't get that. Should I? Yes, you should have got it. You were cc'd. It's the one

Re: Btrfs duperemove corrupt data while dedup

2015-08-26 Thread Hugo Mills
- more corrupted. Smart of the disk, it's not looks, like damaged. (attach) What i can provide to help fix this issue? If it's needed, i can recompile kernel with some parameters if it can help, of course. -- Hugo Mills | Something must be done! hugo@... carfax.org.uk

Re: Understanding BTRFS storage

2015-08-26 Thread Hugo Mills
or replace them (with different sizes). Hugo. -- Hugo Mills | Preventing talpidian orogenesis. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: BTRFS cannot remove empty directory pretending it is not empty

2015-08-25 Thread Hugo Mills
on the problem and should eventually get it right, but it's just an incredibly difficult issue that has taken multiple tries. -- Hugo Mills | Great oxymorons of the world, no. 5: hugo@... carfax.org.uk | Manifesto Promise http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc

Re: understanding btrfs fi df

2015-08-19 Thread Hugo Mills
On Wed, Aug 19, 2015 at 06:10:06PM +0200, Hendrik Friedel wrote: Hello Hugo, thanks for your hint. On 16.08.2015 16:57, Hugo Mills wrote: Here's your problem -- you've got a RAID 5 filesystem, which has a minimum allocation of 2 devices, but only one device has free space

Re: understanding btrfs fi df

2015-08-16 Thread Hugo Mills
-Mail wurde von Avast Antivirus-Software auf Viren geprüft. https://www.avast.com/antivirus -- Hugo Mills | ©1973 Unclear Research Ltd hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Oddness with phantom device replacing real device.

2015-08-13 Thread Hugo Mills
. Hugo. -- Hugo Mills | A gentleman doesn't do damage unless he's paid for hugo@... carfax.org.uk | it. http://carfax.org.uk/ | PGP: E2AB1DE4 |Juri Papay signature.asc Description: Digital signature

Re: RAID0 wrong (raw) device?

2015-08-13 Thread Hugo Mills
going to be dangerous. The second may or may not be, depending on how well DRBD copes with direct writes to its backing store, and how lucky you are about the kernel identifying the right devices to use for the FS. Hugo. -- Hugo Mills | Big data doesn't just mean increasing the font

Re: Scaling to 100k+ snapshots/subvolumes

2015-08-12 Thread Hugo Mills
than having hundreds of half-hourly snapshots a year old to choose from. And 250-ish snapshots per subvolume really does turn out to be VERY reasonable, provided you're doing reasonable thinning.) -- Hugo Mills | Some days, it's just not worth gnawing through the hugo

Re: RAID0 wrong (raw) device?

2015-08-12 Thread Hugo Mills
the solution here would be to blacklist the backing store from btrfs dev scan. I recall that there was such a capability at some point -- I don't know if it made it into the userspace tools? Hugo. -- Hugo Mills | Great oxymorons of the world, no. 7: hugo@... carfax.org.uk | The Simple

Re: raid1 on uneven-sized disks

2015-08-09 Thread Hugo Mills
not like my file system to be the weakest link in the backup chain. Regards, Jim -- Hugo Mills | Guards! Help! We're being rescued! hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | The Stainless Steel Rat Forever signature.asc

Re: fs unreadable after powercycle: BTRFS (device sda): parent transid verify failed on 427084513280 wanted 390924 found 390922

2015-08-08 Thread Hugo Mills
(gen: 390808 level: 1) seems good, but generation/level doesn't match, want gen: 390924 level: 1 regards Martin 1: https://btrfs.wiki.kernel.org/index.php/Problem_FAQ#parent_transid_verify_failed -- Hugo Mills | This chap Anon is writing some perfectly lovely hugo

Re: Data single *and* raid?

2015-08-07 Thread Hugo Mills
= selects chunks of that profile. If you wanted to change the RAID level, you should use convert=. Hugo. Greetings, Hendrik On 01.08.2015 22:44, Chris Murphy wrote: On Sat, Aug 1, 2015 at 2:32 PM, Hugo Mills h...@carfax.org.uk wrote: On Sat, Aug 01, 2015 at 10:09:35PM +0200, Hendrik

Re: BTRFS disaster (of my own making). Is this recoverable?

2015-08-03 Thread Hugo Mills
. There's nothing at all here to indicate that you've got a broken log, so dropping it would be at best pointless. The chunk tree is also most likely undamaged on both copies. Hugo. -- Hugo Mills | The early bird gets the worm, but the second mouse hugo@... carfax.org.uk | gets

Re: BTRFS disaster (of my own making). Is this recoverable?

2015-08-03 Thread Hugo Mills
empty single chunks left behind by mkfs are still there. I don't think we have a good solution to this yet (other than fixing mkfs so it doesn't happen in the first place). Hugo. -- Hugo Mills | Our so-called leaders speak hugo@... carfax.org.uk | with words they try to jail ya http

Re: Data single *and* raid?

2015-08-02 Thread Hugo Mills
(which might be empty?). -- Hugo Mills | I'll take your bet, but make it ten thousand francs. hugo@... carfax.org.uk | I'm only a _poor_ corrupt official. http://carfax.org.uk/ | PGP: E2AB1DE4 | Capt. Renaud, Casablanca signature.asc Description

Re: Data single *and* raid?

2015-08-01 Thread Hugo Mills
? A scrub is currently running and showed no errors yet. -- Hugo Mills | You've read the project plan. Forget that. We're hugo@... carfax.org.uk | going to Do Stuff and Have Fun doing it. http://carfax.org.uk/ | PGP: E2AB1DE4

Re: Data single *and* raid?

2015-08-01 Thread Hugo Mills
. That really ought to be filed as a bug with that distro to flat out remove 4.1.1 from the repos. If they picked up 4.1.1 fast enough, they should pick up 4.1.2 just as quickly... Hugo. -- Hugo Mills | What are we going to do tonight? hugo@... carfax.org.uk | The same thing we do

Re: ext4 convert bugs, wiki warning?

2015-08-01 Thread Hugo Mills
mean a warning like the very first sentence, in bold, that's already on the wiki page? https://btrfs.wiki.kernel.org/index.php/Conversion_from_Ext3 Hugo. -- Hugo Mills | You've read the project plan. Forget that. We're hugo@... carfax.org.uk | going to Do Stuff and Have Fun doing

Re: [PATCH 2/3] btrfs: add replace missing and replace RAID 5/6 to profile configs

2015-07-27 Thread Hugo Mills
YKWpWyKVh7qlENEoqKb4exqr1WGYKU+kBLXRs4wdm3xb66EcWYs0Er1u6v+K1trx nryFrfUxYtMJsSuR9ZJm88DOsXKAuX1LEdRKVOlq7krsIK8HlTizccMXAl10gKk= =ndkL -END PGP SIGNATURE- -- Hugo Mills | I'm on a 30-day diet. So far I've lost 18 days. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4

Re: I'd like a -r flag on btrfs subvolume delete

2015-07-16 Thread Hugo Mills
as important (I need to retain fewer of them) is very useful. -- Hugo Mills | Hail and greetings. We are a flat-pack invasion hugo@... carfax.org.uk | force from Planet Ikea. We come in pieces. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: BTRFS raid6 unmountable after a couple of days of usage.

2015-07-15 Thread Hugo Mills
-physical lookups, and the root tree and log tree locations make sense. I don't know whether btrfs-image works any differently from that, or if so, how it differs. Hugo. -- Hugo Mills | Radio is superior to television: the pictures are hugo@... carfax.org.uk | better http

Re: counting fragments takes more time than defragmenting

2015-07-14 Thread Hugo Mills
On Tue, Jul 14, 2015 at 09:09:00PM +0200, Patrik Lundquist wrote: On 14 July 2015 at 20:41, Hugo Mills h...@carfax.org.uk wrote: On Tue, Jul 14, 2015 at 01:57:07PM +0200, Patrik Lundquist wrote: On 24 June 2015 at 12:46, Duncan 1i5t5.dun...@cox.net wrote: Regardless of whether 1 or huge

Re: counting fragments takes more time than defragmenting

2015-07-14 Thread Hugo Mills
of the internal data structures). Hugo. -- Hugo Mills | Go not to the elves for counsel, for they will say hugo@... carfax.org.uk | both no and yes. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Send/Receive Use Case

2015-07-10 Thread Hugo Mills
raw storage. Hugo. or do they need to be of the same replication scheme too ? On Jun 27, 2015, at 10:34 AM, Vincent Olivier vinc...@up4.com wrote: ok i’ll go home and rethink my life then ;) On Jun 27, 2015, at 10:21 AM, Hugo Mills h...@carfax.org.uk wrote: On Sat, Jun 27

Re: btrfs subvolume clone or fork (btrfs-progs feature request)

2015-07-09 Thread Hugo Mills
in. Are you thinking of the read-only flag? That's not the same thing as the various UUID properties (e.g. parent) which can be used to detemine if a subvolume was made using a snapshot. Hugo. -- Hugo Mills | Someone's been throwing dead sheep down my Fun Well hugo@... carfax.org.uk

Re: Concurrent write access

2015-07-09 Thread Hugo Mills
tried this one, because Samba and I get on like a house on fire(*). Hugo. (*) Screaming, shouting, people running away, emergency services. -- Hugo Mills | Alert status mauve ocelot: Slight chance of hugo@... carfax.org.uk | brimstone. Be prepared to make a nice cup of tea. http

Re: kernel crash on btrfs device delete missing

2015-07-07 Thread Hugo Mills
, but sticking a copy of what you've discovered so far into bugzilla.kernel.org may help it not to get lost. Hugo. -- Hugo Mills | I don't like the look of it, I tell you. hugo@... carfax.org.uk | Well, stop looking at it, then. http://carfax.org.uk/ | PGP: E2AB1DE4

Re: Btrfs - distribute files equally across multiple devices

2015-07-06 Thread Hugo Mills
/write multiple files from/to different disks, so less performance only for single-file-reads/writes [3] using two disks, otherwise (totalDisks-failedDisks)/totalDisks -- Hugo Mills | How deep will this sub go? hugo@... carfax.org.uk | Oh, she'll go all the way to the bottom if we don't

Re: size 2.73TiB used 240.97GiB after balance

2015-07-06 Thread Hugo Mills
could further degrade). What is your recommendation? Physically remove the device from the array, mount with -o degraded, optionally add the new device, and run a balance. Hugo. -- Hugo Mills | I lost my leg in 1942. Some bastard stole it in a hugo@... carfax.org.uk | pub

Re: Send/Receive Use Case

2015-06-27 Thread Hugo Mills
is it ignored by send/receive or does send/receive re-enacts” the journal exactly ? It'll be ignored. The FS doesn't keep track of how it reached a particular state -- only what that state is. Hugo. -- Hugo Mills | IMPROVE YOUR ORGANISMS!! hugo@... carfax.org.uk | http

Re: BTRFS: read error corrected: ino 1 off 226840576 (dev /dev/mapper/dshelf1 sector 459432)

2015-06-17 Thread Hugo Mills
of parity RAID repair code in it. I'll do a scrub later, for now I have to wait 20 hours for the raid rebuild first. You'll probably find that the rebuild is equivalent to a scrub anyway. Hugo. -- Hugo Mills | If you're not part of the solution, you're part of hugo

Re: BTRFS: read error corrected: ino 1 off 226840576 (dev /dev/mapper/dshelf1 sector 459432)

2015-06-17 Thread Hugo Mills
On Wed, Jun 17, 2015 at 12:58:35PM +0200, Sander wrote: Hugo Mills wrote (ao): On Wed, Jun 17, 2015 at 12:16:54AM -0700, Marc MERLIN wrote: I had a few power offs due to a faulty power supply, and my mdadm raid5 got into fail mode after 2 drives got kicked out since their sequence

Re: RAID10 Balancing Request for Comments and Advices

2015-06-17 Thread Hugo Mills
cases, all you need to do is clean up one data chunk to give the metadata enough space to work in. Instead of manually iterating through several values of usage= until you get a useful response, you can use limit=n to stop after n successful block group relocations. Hugo. -- Hugo Mills

Re: Automatic balance after mkfs?

2015-06-16 Thread Hugo Mills
On Tue, Jun 16, 2015 at 01:13:40PM +, Holger Hoffstätte wrote: Forking from the other thread.. On Tue, 16 Jun 2015 12:25:45 +, Hugo Mills wrote: Yes. It's an artefact of the way that mkfs works. If you run a balance on those chunks, they'll go away. (btrfs balance start

Re: RAID10 Balancing Request for Comments and Advices

2015-06-16 Thread Hugo Mills
or once a month -- opinions vary (as do runtimes). My fourth question, still within the same context: are there best practices when using smartctl for periodically testing (long test, short test) btrfs RAID devices? I can't answer that one, I'm afraid. Hugo. -- Hugo Mills

Re: Replacing a drive from a RAID 1 array

2015-06-16 Thread Hugo Mills
. In my big disk array at home, I have two 4-slot enclosures, and I leave one of them empty specifically for this reason. It's a less attractive proposition with only 4 slots in total, though. Hugo. -- Hugo Mills | What are we going to do tonight? hugo@... carfax.org.uk | The same

Re: CoW with webserver databases: innodb_file_per_table and dedicated tables for blobs?

2015-06-16 Thread Hugo Mills
. Is this likely to give me ok-ish performance? What other possibilities are there? I would recommend benchmarking over time with your workloads, and seeing how your performance degrades. Hugo. -- Hugo Mills | emacs: Eighty Megabytes And Constantly Swapping. hugo

Re: CoW with webserver databases: innodb_file_per_table and dedicated tables for blobs?

2015-06-15 Thread Hugo Mills
performance? What other possibilities are there? I would recommend benchmarking over time with your workloads, and seeing how your performance degrades. Hugo. -- Hugo Mills | You are not stuck in traffic: you are traffic hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP

Re: [PATCH] Btrfs: use received_uuid of parent during send

2015-06-11 Thread Hugo Mills
have to go in the FARv2 update, though. However, since this patch doesn't rule out the above happening at some future date, and I think it'll do the job as described above, Reviewed-by: Hugo Mills h...@carfax.org.uk for whatever little it's worth. Hugo. Reported-by: Neil Horman nhor

Re: [PATCH] Btrfs: use received_uuid of parent during send

2015-06-11 Thread Hugo Mills
On Thu, Jun 11, 2015 at 01:16:26PM -0400, Josef Bacik wrote: On 06/11/2015 01:09 PM, Hugo Mills wrote: On Thu, Jun 04, 2015 at 05:17:25PM -0400, Josef Bacik wrote: Neil Horman pointed out a problem where if he did something like this receive A snap A B change B send -p A B

Re: @ prefix in subvolume paths

2015-06-10 Thread Hugo Mills
3517706 top level 5 path var/tmp ID 276 gen 3517669 top level 5 path .snapshots -- Hugo Mills | ... one ping(1) to rule them all, and in the hugo@... carfax.org.uk | darkness bind(2) them. http://carfax.org.uk/ | PGP: E2AB1DE4

Re: Metadata size limitations of btrfs

2015-05-28 Thread Hugo Mills
=190.00GiB, used=176.47GiB System, DUP: total=32.00MiB, used=48.00KiB Metadata, DUP: total=8.00GiB, used=6.08GiB GlobalReserve, single: total=512.00MiB, used=0.00B -- Hugo Mills | emacs: Eighty Megabytes And Constantly Swapping. hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP

Re: btrfs on disk stability

2015-05-26 Thread Hugo Mills
about which device(s) it's meant to be writing to. Hugo. -- Hugo Mills | Q: What goes, Pieces of seven! Pieces of seven!? hugo@... carfax.org.uk | A: A parroty error. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: intermittent -ENOSPC errors on btrfs filesystem with 170G free

2015-05-26 Thread Hugo Mills
a filtered balance on it to clean up unused chunks: # btrfs balance start -dusage=5 / as suggested in the FAQ [1]. Hugo. [1] https://btrfs.wiki.kernel.org/index.php/FAQ#if_your_device_is_large_.28.3E16GiB.29 -- Hugo Mills | Two things came out of Berkeley in the 1960s: LSD hugo

Re: btrfs on disk stability

2015-05-26 Thread Hugo Mills
On Tue, May 26, 2015 at 09:29:25AM +, sri wrote: Hugo Mills hugo at carfax.org.uk writes: On Tue, May 26, 2015 at 08:45:06AM +, sri wrote: Hi, According to btrfs wiki page, under Stability status it is written that The filesystem disk format is no longer unstable

Re: Removing a device from a metadata raid1 - data raid0

2015-05-22 Thread Hugo Mills
definitely support conversion to DUP, and prevent the automatic upgrade to RAID-1, but I think we don't at the moment. Hugo. -- Hugo Mills | Two things came out of Berkeley in the 1960s: LSD hugo@... carfax.org.uk | and Unix. This is not a coincidence. http://carfax.org.uk/ | PGP

Re: raid 5 and different device size

2015-05-11 Thread Hugo Mills
on any one of the drives, right? Is that also true during reading of data, i.e. is the parity also checked for read operations? Parity is spread evenly across all devices, so a read of more than a trivial quantity of data would almost certainly spin up all devices anyway. Hugo. -- Hugo

Re: Filesystem with Errors, Unusual behavior

2015-04-28 Thread Hugo Mills
GlobalReserve, single: total=512.00MiB, used=0.00B -- Hugo Mills | Quantum est ille canis in fenestra? hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs freeze/thaw when using with LVM2

2015-04-27 Thread Hugo Mills
between the original block device and the snapshot, and may try using the wrong one (or possibly both). Hugo. -- Hugo Mills | Someone's been throwing dead sheep down my Fun Well hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4

Re: btrfs freeze/thaw when using with LVM2

2015-04-27 Thread Hugo Mills
On Mon, Apr 27, 2015 at 02:41:41PM +, sri wrote: Hugo Mills hugo at carfax.org.uk writes: On Mon, Apr 27, 2015 at 12:05:28PM +, sri wrote: Hi, I would like to know if btrfs file system is created on LVM2 logical volumes, does freeze and thaw operations takes place

Re: btrfs freeze/thaw when using with LVM2

2015-04-27 Thread Hugo Mills
On Mon, Apr 27, 2015 at 10:34:42PM +0500, Roman Mamedov wrote: On Mon, 27 Apr 2015 14:55:49 + Hugo Mills h...@carfax.org.uk wrote: This is strange considering that I wanted a consistent snapshot of entire btrfs filesystem at volume level. Is there a way to achive

Re: raid0 needs mounting alternate device every boot? open_ctree failed (3.19.5)

2015-04-26 Thread Hugo Mills
the cryptsetup open operation). Hugo. -- Hugo Mills | You can't expect a boy to be vicious until he's gone hugo@... carfax.org.uk | to a good school. http://carfax.org.uk/ | PGP: E2AB1DE4 | Saki signature.asc Description: Digital

Re: [PATCH] btrfs-progs: receive explicit parent support

2015-04-26 Thread Hugo Mills
the process to mount using chroot, --max-errors N Terminate as soon as N errors happened while, processing commands from the send stream., -- Hugo Mills | Questions are a burden, and answers a prison for hugo@... carfax.org.uk | oneself http://carfax.org.uk/ | PGP

Re: rollback of a snapshot is just read-only

2015-04-24 Thread Hugo Mills
) to select the subvolume you want to mount. If you want to make a read-only snapshot into a read-write one, you can simply snapshot it again without the -r option. Hugo. -- Hugo Mills | Reading Mein Kampf won't make you a Nazi. Reading hugo@... carfax.org.uk | Das Kapital won't make

Re: Help with btrfs filesystem problems

2015-04-22 Thread Hugo Mills
check --readonly on the filesystem (unmounted), and report back what that says. Hugo. -- Hugo Mills | People are too unreliable to be replaced by hugo@... carfax.org.uk | machines. http://carfax.org.uk/ | PGP: E2AB1DE4 | Nathan Spring, Star

Re: unable to mount a btrfs file system kernel 3.19.2

2015-04-20 Thread Hugo Mills
I could fix this issue? See the first issue here: https://btrfs.wiki.kernel.org/index.php/Gotchas Hugo. -- Hugo Mills | Do not meddle in the affairs of system hugo@... carfax.org.uk | administrators, for they are subtle, and quick to http://carfax.org.uk/ | anger. PGP

Re: btrfs send to file differences

2015-04-20 Thread Hugo Mills
is of 5Mb. So for incremetal backup, it consumes total of 11Mb. I want a way to reduce it to total of 6Mb but there should a way to recover from fist snapshot dump and second snapshot dump as well. -- Hugo Mills | UDP jokes: It's OK if no-one gets them. hugo@... carfax.org.uk | http

Re: The FAQ on fsync/O_SYNC

2015-04-19 Thread Hugo Mills
On Sun, Apr 19, 2015 at 07:50:32PM +0200, Martin Steigerwald wrote: Am Sonntag, 19. April 2015, 15:18:51 schrieb Hugo Mills: On Sun, Apr 19, 2015 at 05:10:30PM +0200, Martin Steigerwald wrote: Am Sonntag, 19. April 2015, 22:31:02 schrieb Craig Ringer: I'm curious as to whether +C has any

Re: The FAQ on fsync/O_SYNC

2015-04-19 Thread Hugo Mills
On Sun, Apr 19, 2015 at 08:41:39PM +0200, Martin Steigerwald wrote: Am Sonntag, 19. April 2015, 18:18:24 schrieb Hugo Mills: On Sun, Apr 19, 2015 at 07:50:32PM +0200, Martin Steigerwald wrote: Am Sonntag, 19. April 2015, 15:18:51 schrieb Hugo Mills: On Sun, Apr 19, 2015 at 05:10:30PM

Re: The FAQ on fsync/O_SYNC

2015-04-19 Thread Hugo Mills
the checksumming features of the FS, and hence the self-healing properties if you're running with btrfs-native RAID. Hugo. -- Hugo Mills | Nothing right in my left brain. Nothing left in my hugo@... carfax.org.uk | right brain. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc

Re: how many chunk trees and extent trees present

2015-04-17 Thread Hugo Mills
themselves), then it's already been done with qgroups, and you don't need to write any btrfs code at all. What exactly are you going to be doing with this information? Hugo. -- Hugo Mills | O tempura! O moresushi! hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4

Re: btrfs balance {,meta}data to raid5 not working?

2015-04-11 Thread Hugo Mills
to balance two drive btrfs raid1 to two drive btrfs raid5 -- Hugo Mills | The enemy have elected for Death by Powerpoint. hugo@... carfax.org.uk | That's what they shall get. http://carfax.org.uk/ | PGP: E2AB1DE4 | gdb

Re: incremental full file backups to smaller mediums possible?

2015-04-09 Thread Hugo Mills
for working out what goes on which disks, and you're done. Hugo. -- Hugo Mills | Dullest spy film ever: The Eastbourne Ultimatum hugo@... carfax.org.uk | http://carfax.org.uk/ | PGP: E2AB1DE4 | The Thick of It signature.asc Description

Re: Re: Porting BTRFS to user space

2015-04-08 Thread Hugo Mills
, so there probably isn't much BTRFS specific literature out there. I would, however suggest looking at the FUSE drivers for ext4 and ZFS, as those are both ported from kernel space, and should give some good examples of where to start. pnbsp;/ppnbsp;/p -- Hugo Mills | I lost

Re: btrfs subvolume default subvolume

2015-04-07 Thread Hugo Mills
to mount root: rootflags=subvol=root Hugo. -- Hugo Mills | The trouble with you, Ibid, is you think you know hugo@... carfax.org.uk | everything. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: btrfs subvolume default subvolume

2015-04-07 Thread Hugo Mills
On Tue, Apr 07, 2015 at 01:08:59PM +0200, arnaud gaboury wrote: On Tue, Apr 7, 2015 at 1:03 PM, Hugo Mills h...@carfax.org.uk wrote: On Tue, Apr 07, 2015 at 12:58:28PM +0200, arnaud gaboury wrote: [snip] After more reading, it seems to me creating a top root subvolume is the right thing

Re: btrfs subvolume default subvolume

2015-04-07 Thread Hugo Mills
On Tue, Apr 07, 2015 at 06:31:36PM +0200, arnaud gaboury wrote: On Tue, Apr 7, 2015 at 4:20 PM, Hugo Mills h...@carfax.org.uk wrote: On Tue, Apr 07, 2015 at 01:08:59PM +0200, arnaud gaboury wrote: On Tue, Apr 7, 2015 at 1:03 PM, Hugo Mills h...@carfax.org.uk wrote: On Tue, Apr 07, 2015

Re: Are attachments allowed?

2015-04-07 Thread Hugo Mills
://www.tux.org/lkml/#s3 -- Hugo Mills | Alert status mauve ocelot: Slight chance of hugo@... carfax.org.uk | brimstone. Be prepared to make a nice cup of tea. http://carfax.org.uk/ | PGP: E2AB1DE4 | signature.asc Description: Digital signature

Re: Btrfs hangs 3.19-10

2015-04-06 Thread Hugo Mills
On Mon, Apr 06, 2015 at 10:40:03AM +0300, Pavel Volkov wrote: On Sunday, April 5, 2015 1:04:17 PM MSK, Hugo Mills wrote: That's these, I think: #define BTRFS_FEATURE_INCOMPAT_BIG_METADATA (1ULL 5) #define BTRFS_FEATURE_INCOMPAT_EXTENDED_IREF(1ULL 6) so it's definitely -O

Re: Btrfs hangs 3.19-10

2015-04-05 Thread Hugo Mills
On Sun, Apr 05, 2015 at 03:30:47AM +, Russell Coker wrote: On Sun, 5 Apr 2015 03:16:21 AM Duncan wrote: Hugo Mills posted on Sat, 04 Apr 2015 13:00:47 + as excerpted: On Sat, Apr 04, 2015 at 12:55:08PM +, Russell Coker wrote: As an aside are there options to mkfs.btrfs

Re: Btrfs hangs 3.19-10

2015-04-04 Thread Hugo Mills
mention be added to the man page. Yes, there are. It's probably -O^extref, but if you can show the dmesg output from the 3.2 kernel on the failed mount (so that it shows what the actual failure was), we should be able to give you a more precise answer. Hugo. -- Hugo Mills | Welcome

<    1   2   3   4   5   6   7   8   9   10   >