Re: [gentoo-user] compressed filesystem
2.6.37 on one machine, and 2.6.39 on the other - those two corrupted during bad shutdowns whilst writing to the FS (well, I am bad for triggering the remote power OFF :) Its not the corruption that was the issue, but that a wipe, reformat and reload was the only fix. Cant remember the exact error - its been known for awhile, but wasn't all that common when i searched for it. If they get a set of usable tools, especially online fsck I'd go back to it as having a drive offline for hours whilst checking reiserfs isn't great (though at least it doesnt happen often) BillK On Thu, 2011-09-01 at 17:13 +1000, Adam Carter wrote: > > Is it reliable? > > So far so go for me. I'm using lzo on my main partition and zlib on > /home and on an external drive i use for backup. > > > A month ago I returned all my BTRFS partitions to reiserfs because of > > unfixable errors. Initially I was quite impressed, but until the tools > > catch up with real world problems I'll watch from the sidelines. Errors > > will happen, but fixing them is important too. > > Which kernel was that with? Was the issue caused by a power loss or > normal running? The lack of tools is why Fedora are sticking with ext4 > for 16. >
Re: [gentoo-user] compressed filesystem
> Is it reliable? So far so go for me. I'm using lzo on my main partition and zlib on /home and on an external drive i use for backup. > A month ago I returned all my BTRFS partitions to reiserfs because of > unfixable errors. Initially I was quite impressed, but until the tools > catch up with real world problems I'll watch from the sidelines. Errors > will happen, but fixing them is important too. Which kernel was that with? Was the issue caused by a power loss or normal running? The lack of tools is why Fedora are sticking with ext4 for 16.
Re: [gentoo-user] compressed filesystem
On Thu, 2011-09-01 at 09:37 +1000, Adam Carter wrote: > > Btrfs supports on the fly compression > > Yes it supports two types, lzo and zlib, zlib compresses more densely, > and the mount option for that is compress=zlib. > Is it reliable? A month ago I returned all my BTRFS partitions to reiserfs because of unfixable errors. Initially I was quite impressed, but until the tools catch up with real world problems I'll watch from the sidelines. Errors will happen, but fixing them is important too. BillK
Re: [gentoo-user] compressed filesystem
> Btrfs supports on the fly compression Yes it supports two types, lzo and zlib, zlib compresses more densely, and the mount option for that is compress=zlib.
Re: [gentoo-user] compressed filesystem
On 08/31/2011 09:51 PM, Nilesh Govindarajan wrote: > On 08/31/2011 09:20 PM, Space Cake wrote: >> Hi, >> >> Is there any way to create some kind of "on the fly" compressed >> filesystem for backup purposes? My files are getting bigger and bigger >> but my external drive stays the same :) > > Btrfs supports on the fly compression > Another option is, you can use the squashfs trick, described here- http://forums.gentoo.org/viewtopic-t-646289-start-25.html -- Nilesh Govindarajan http://nileshgr.com
Re: [gentoo-user] compressed filesystem
On 08/31/2011 09:20 PM, Space Cake wrote: > Hi, > > Is there any way to create some kind of "on the fly" compressed > filesystem for backup purposes? My files are getting bigger and bigger > but my external drive stays the same :) Btrfs supports on the fly compression -- Nilesh Govindarajan http://nileshgr.com
[gentoo-user] compressed filesystem
Hi, Is there any way to create some kind of "on the fly" compressed filesystem for backup purposes? My files are getting bigger and bigger but my external drive stays the same :) Thanks Laszlo
Re: [gentoo-user] Compressed Filesystem
Helmut Jarausch wrote: > On 3 Jan, Enrico Weigelt wrote: >> Helmut Jarausch wrote: >>> Hi, >>> >>> I'm looking for a working and maintained compressed filesystem. >>> I'd like to use it for backing up my root and my /usr filesystems, >>> so that I can use rsync to keep it up-to-date. >> Perhaps you could try venti+fossil or git. >> > Thanks, but I haven't found venti or fossil in Gentoo's tree. > Are there any ebuilds around? plan9port > > Helmut. > -- -- Enrico Weigelt, metux IT service -- http://www.metux.de/ cellphone: +49 174 7066481 email: i...@metux.de skype: nekrad666 -- Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme --
Re: [gentoo-user] Compressed Filesystem
On Sun, 03 Jan 2010 12:53:07 +0100 (CET) Helmut Jarausch wrote: > On 3 Jan, Enrico Weigelt wrote: > > > > Perhaps you could try venti+fossil or git. > > > Thanks, but I haven't found venti or fossil in Gentoo's tree. > Are there any ebuilds around? You'd need plan9 for these ;) -- Mike Kazantsev // fraggod.net signature.asc Description: PGP signature
Re: [gentoo-user] Compressed Filesystem
On 3 Jan, Enrico Weigelt wrote: > Helmut Jarausch wrote: >> Hi, >> >> I'm looking for a working and maintained compressed filesystem. >> I'd like to use it for backing up my root and my /usr filesystems, >> so that I can use rsync to keep it up-to-date. > > Perhaps you could try venti+fossil or git. > Thanks, but I haven't found venti or fossil in Gentoo's tree. Are there any ebuilds around? Helmut. -- Helmut Jarausch Lehrstuhl fuer Numerische Mathematik RWTH - Aachen University D 52056 Aachen, Germany
Re: [gentoo-user] Compressed Filesystem
Helmut Jarausch wrote: > Hi, > > I'm looking for a working and maintained compressed filesystem. > I'd like to use it for backing up my root and my /usr filesystems, > so that I can use rsync to keep it up-to-date. Perhaps you could try venti+fossil or git. cu -- -- Enrico Weigelt, metux IT service -- http://www.metux.de/ cellphone: +49 174 7066481 email: i...@metux.de skype: nekrad666 -- Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme --
Re: [gentoo-user] Compressed Filesystem
Volker Armin Hemmann wrote: On Donnerstag 31 Dezember 2009, Dale wrote: Marcus Wanner wrote: On 12/30/2009 8:04 PM, Neil Bothwick wrote: On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: I had to hard reset the system and look at the logs. The only problem was that the logs had the wrong contents because they had been "written to" but not actually flushed to the disk, and it took me about 10 hard resets to figure that out. Another reason to you the magic sysrq keys instead of the reset button. S syncs your filesystems. sysrq syncs the filesystem? I always wondered what that key actually did... Wait, to get sysrq is Shift+printscreen, right? Marcus This is from a post by Neil a good long while back: Hold down Atl, hold down SysRq, press each of the keys in turn. The usual full sequence is R-E-I-S-U-B Reboot Even If System Utterly Broken I usually only get to the second or third key and I am back at a console. and sometimes K is all you need. Thank god for /usr/src/linux/Documentation This was posted by Volker a while back. e sends TERM to all processes (except init) i kills all processes (except init) s syncs partitions u remounts everything ro b boots a box o turns off a box k saks a box - kills all processes on that vt That tells what each key does. I'm still not sure which one took me back to a console. It may be the E key that does it. Dale :-) :-) r unraws the keyboars - takes it away from X.
Re: [gentoo-user] Compressed Filesystem
Volker Armin Hemmann wrote: On Donnerstag 31 Dezember 2009, Dale wrote: Marcus Wanner wrote: On 12/30/2009 8:04 PM, Neil Bothwick wrote: On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: I had to hard reset the system and look at the logs. The only problem was that the logs had the wrong contents because they had been "written to" but not actually flushed to the disk, and it took me about 10 hard resets to figure that out. Another reason to you the magic sysrq keys instead of the reset button. S syncs your filesystems. sysrq syncs the filesystem? I always wondered what that key actually did... Wait, to get sysrq is Shift+printscreen, right? Marcus This is from a post by Neil a good long while back: Hold down Atl, hold down SysRq, press each of the keys in turn. The usual full sequence is R-E-I-S-U-B Reboot Even If System Utterly Broken I usually only get to the second or third key and I am back at a console. and sometimes K is all you need. Thank god for /usr/src/linux/Documentation Thanks for the info! Marcus
Re: [gentoo-user] Compressed Filesystem
On Donnerstag 31 Dezember 2009, Dale wrote: > Marcus Wanner wrote: > > On 12/30/2009 8:04 PM, Neil Bothwick wrote: > >> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: > >>> I had to hard reset the > >>> system and look at the logs. The only problem was that the logs had the > >>> wrong contents because they had been "written to" but not actually > >>> flushed to the disk, and it took me about 10 hard resets to figure that > >>> out. > >> > >> Another reason to you the magic sysrq keys instead of the reset button. > >> S syncs your filesystems. > > > > sysrq syncs the filesystem? I always wondered what that key actually > > did... > > > > Wait, to get sysrq is Shift+printscreen, right? > > > > Marcus > > This is from a post by Neil a good long while back: > > Hold down Atl, hold down SysRq, press each of the keys in turn. The usual > full sequence is R-E-I-S-U-B > > Reboot > Even > If > System > Utterly > Broken > > > I usually only get to the second or third key and I am back at a console. > and sometimes K is all you need. Thank god for /usr/src/linux/Documentation
Re: [gentoo-user] Compressed Filesystem
Marcus Wanner wrote: On 12/30/2009 8:04 PM, Neil Bothwick wrote: On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: I had to hard reset the system and look at the logs. The only problem was that the logs had the wrong contents because they had been "written to" but not actually flushed to the disk, and it took me about 10 hard resets to figure that out. Another reason to you the magic sysrq keys instead of the reset button. S syncs your filesystems. sysrq syncs the filesystem? I always wondered what that key actually did... Wait, to get sysrq is Shift+printscreen, right? Marcus This is from a post by Neil a good long while back: Hold down Atl, hold down SysRq, press each of the keys in turn. The usual full sequence is R-E-I-S-U-B Reboot Even If System Utterly Broken I usually only get to the second or third key and I am back at a console. That help? Dale :-) :-)
Re: [gentoo-user] Compressed Filesystem
On 12/30/2009 8:04 PM, Neil Bothwick wrote: On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: I had to hard reset the system and look at the logs. The only problem was that the logs had the wrong contents because they had been "written to" but not actually flushed to the disk, and it took me about 10 hard resets to figure that out. Another reason to you the magic sysrq keys instead of the reset button. S syncs your filesystems. sysrq syncs the filesystem? I always wondered what that key actually did... Wait, to get sysrq is Shift+printscreen, right? Marcus
Re: [gentoo-user] Compressed Filesystem
On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote: > I had to hard reset the > system and look at the logs. The only problem was that the logs had the > wrong contents because they had been "written to" but not actually > flushed to the disk, and it took me about 10 hard resets to figure that > out. Another reason to you the magic sysrq keys instead of the reset button. S syncs your filesystems. -- Neil Bothwick Get your copy at http://www.geekthing.com/~robf/gensig/ signature.asc Description: PGP signature
Re: [gentoo-user] Compressed Filesystem
On Mittwoch 30 Dezember 2009, Marcus Wanner wrote: > On 12/29/2009 7:17 PM, Albert Hopkins wrote: > > On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote: > >> just think a moment of the tons of bug fixes constantly going into > >> ext4. That > >> crap is not stable. Pre-alpha maybe. > > > > People say this from time to time, yet I have been running ext4 on my > > root directory of my laptop since July 2008. The only problem I've had > > since then is one time it would not mount on boot. I merely had to fsck > > it from a live media an then it was ok (nothing lost or currupted). But > > that was a long time ago when it was still ext4dev. And I've had > > numerous crashes and battery depletions on the laptop without incident. > > So the pre-alpha FUD that some people are spreading is either not true > > or I just happen to be the luckiest ext4 user in the world :-). > > For my two cents, a while back I was on ext4 and was trying to get xorg > working. My problem was that the input drivers were not working (because > they had not been recompiled after an update), so once I ran startx, no > keyboard or mouse input was registered. This meant that every time I > tried something which I thought would fix it, I had to hard reset the > system and look at the logs. The only problem was that the logs had the > wrong contents because they had been "written to" but not actually > flushed to the disk, and it took me about 10 hard resets to figure that > out. Even though I was running ext4, I never lost a thing (except the > logs :p). > > For the curious, I eventually got good logs by running shutdown -h 1 in > one tty right before running startx in the other, and that shutdown the > system correctly. > > Marcus > you could have set up acpid to switch to vt1 when the power button is pressed. This is a nice safeguard against a misbehaving X.
Re: [gentoo-user] Compressed Filesystem
On 12/29/2009 7:17 PM, Albert Hopkins wrote: On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote: just think a moment of the tons of bug fixes constantly going into ext4. That crap is not stable. Pre-alpha maybe. People say this from time to time, yet I have been running ext4 on my root directory of my laptop since July 2008. The only problem I've had since then is one time it would not mount on boot. I merely had to fsck it from a live media an then it was ok (nothing lost or currupted). But that was a long time ago when it was still ext4dev. And I've had numerous crashes and battery depletions on the laptop without incident. So the pre-alpha FUD that some people are spreading is either not true or I just happen to be the luckiest ext4 user in the world :-). For my two cents, a while back I was on ext4 and was trying to get xorg working. My problem was that the input drivers were not working (because they had not been recompiled after an update), so once I ran startx, no keyboard or mouse input was registered. This meant that every time I tried something which I thought would fix it, I had to hard reset the system and look at the logs. The only problem was that the logs had the wrong contents because they had been "written to" but not actually flushed to the disk, and it took me about 10 hard resets to figure that out. Even though I was running ext4, I never lost a thing (except the logs :p). For the curious, I eventually got good logs by running shutdown -h 1 in one tty right before running startx in the other, and that shutdown the system correctly. Marcus
Re: [gentoo-user] Compressed Filesystem
On 30 Dec 2009, at 00:17, Albert Hopkins wrote: ... The only problem I've had since then is one time it would not mount on boot. I merely had to fsck it from a live media an then it was ok (nothing SEEMED lost or currupted). Fixed this for you. Stroller.
Re: [gentoo-user] Compressed Filesystem
Am 30.12.2009 00:08, schrieb Volker Armin Hemmann: >> would you recommend it over ext4 for a productive root-fs, considering >> speed and safety ? > > just think a moment of the tons of bug fixes constantly going into ext4. That > crap is not stable. Pre-alpha maybe. hmm, thanks for that thought ...
Re: [gentoo-user] Compressed Filesystem
On Mittwoch 30 Dezember 2009, Albert Hopkins wrote: > On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote: > > just think a moment of the tons of bug fixes constantly going into > > ext4. That > > crap is not stable. Pre-alpha maybe. > > People say this from time to time, yet I have been running ext4 on my > root directory of my laptop since July 2008. The only problem I've had > since then is one time it would not mount on boot. I merely had to fsck > it from a live media an then it was ok (nothing lost or currupted). But > that was a long time ago when it was still ext4dev. And I've had > numerous crashes and battery depletions on the laptop without incident. > So the pre-alpha FUD that some people are spreading is either not true > or I just happen to be the luckiest ext4 user in the world :-). > tell that to the people who got their configs zeroed because extX devs value benchmarks at default settings as more important than your data.
Re: [gentoo-user] Compressed Filesystem
On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote: > just think a moment of the tons of bug fixes constantly going into > ext4. That > crap is not stable. Pre-alpha maybe. People say this from time to time, yet I have been running ext4 on my root directory of my laptop since July 2008. The only problem I've had since then is one time it would not mount on boot. I merely had to fsck it from a live media an then it was ok (nothing lost or currupted). But that was a long time ago when it was still ext4dev. And I've had numerous crashes and battery depletions on the laptop without incident. So the pre-alpha FUD that some people are spreading is either not true or I just happen to be the luckiest ext4 user in the world :-).
Re: [gentoo-user] Compressed Filesystem
Am 29.12.2009 14:04, schrieb Volker Armin Hemmann: > I do no know btrfs. But there are two nice things about reiser4: > it takes your data seriously. It tries everything to make sure your data hit > the platter. Device does not support barriers? Reiser4 detects that and goes > into sync mode. > Second, reiser4 is really, really really fast (except mounting). thinking "ricer" here (ricer vs. reiser ;-) ): would you recommend it over ext4 for a productive root-fs, considering speed and safety ? Personally I avoided reiserfs for years after having some really bad crashes back then but sure, things developed since then. S
Re: [gentoo-user] Compressed Filesystem
On Mittwoch 30 Dezember 2009, Stefan G. Weichinger wrote: > Am 29.12.2009 14:04, schrieb Volker Armin Hemmann: > > I do no know btrfs. But there are two nice things about reiser4: > > it takes your data seriously. It tries everything to make sure your data > > hit the platter. Device does not support barriers? Reiser4 detects that > > and goes into sync mode. > > Second, reiser4 is really, really really fast (except mounting). > > thinking "ricer" here (ricer vs. reiser ;-) ): > > would you recommend it over ext4 for a productive root-fs, considering > speed and safety ? just think a moment of the tons of bug fixes constantly going into ext4. That crap is not stable. Pre-alpha maybe.
Re: [gentoo-user] Compressed Filesystem
On Dienstag 29 Dezember 2009, Helmut Jarausch wrote: > On 28 Dec, Volker Armin Hemmann wrote: > > On Montag 28 Dezember 2009, Helmut Jarausch wrote: > >> Hi, > >> > >> I'm looking for a working and maintained compressed filesystem. > >> I'd like to use it for backing up my root and my /usr filesystems, > >> so that I can use rsync to keep it up-to-date. > >> > >> I've come across CompFused which seems to be just what I'm looking for, > >> but it's buggy not maintained anymore. > >> > >> Similarly, fusecompress > >> http://bugs.gentoo.org/show_bug.cgi?id=127433 > >> doesn't build on an up-to-date Gentoo system and doesn't > >> look maintained either. > >> > >> There would be sys-fs/zfs-fuse but that sounds like overkill to me. > >> > >> Are there any other packages? > >> > >> Many thanks for a hint, > >> Helmut. > > > > reiser4. Bonus, it only tries to compress stuff that can be compressed > > (the test is quick&dirty and sometimes wrong, but most of the time good > > enough). > > Thanks! > But what's the future of reiser4 FS ? What are the advantages compared > to btrfs ? reiser4 was denied for 'layer violation'. btrfs violates those layers even more. I do no know btrfs. But there are two nice things about reiser4: it takes your data seriously. It tries everything to make sure your data hit the platter. Device does not support barriers? Reiser4 detects that and goes into sync mode. Second, reiser4 is really, really really fast (except mounting).
Re: [gentoo-user] Compressed Filesystem
On 28 Dec, Volker Armin Hemmann wrote: > On Montag 28 Dezember 2009, Helmut Jarausch wrote: >> Hi, >> >> I'm looking for a working and maintained compressed filesystem. >> I'd like to use it for backing up my root and my /usr filesystems, >> so that I can use rsync to keep it up-to-date. >> >> I've come across CompFused which seems to be just what I'm looking for, >> but it's buggy not maintained anymore. >> >> Similarly, fusecompress >> http://bugs.gentoo.org/show_bug.cgi?id=127433 >> doesn't build on an up-to-date Gentoo system and doesn't >> look maintained either. >> >> There would be sys-fs/zfs-fuse but that sounds like overkill to me. >> >> Are there any other packages? >> >> Many thanks for a hint, >> Helmut. >> > > reiser4. Bonus, it only tries to compress stuff that can be compressed (the > test is quick&dirty and sometimes wrong, but most of the time good enough). > Thanks! But what's the future of reiser4 FS ? What are the advantages compared to btrfs ? Many thanks, Helmut. -- Helmut Jarausch Lehrstuhl fuer Numerische Mathematik RWTH - Aachen University D 52056 Aachen, Germany
Re: [gentoo-user] Compressed Filesystem
On Montag 28 Dezember 2009, Helmut Jarausch wrote: > Hi, > > I'm looking for a working and maintained compressed filesystem. > I'd like to use it for backing up my root and my /usr filesystems, > so that I can use rsync to keep it up-to-date. > > I've come across CompFused which seems to be just what I'm looking for, > but it's buggy not maintained anymore. > > Similarly, fusecompress > http://bugs.gentoo.org/show_bug.cgi?id=127433 > doesn't build on an up-to-date Gentoo system and doesn't > look maintained either. > > There would be sys-fs/zfs-fuse but that sounds like overkill to me. > > Are there any other packages? > > Many thanks for a hint, > Helmut. > reiser4. Bonus, it only tries to compress stuff that can be compressed (the test is quick&dirty and sometimes wrong, but most of the time good enough).
Re: [gentoo-user] Compressed Filesystem
On Mon, 2009-12-28 at 12:58 +0100, Helmut Jarausch wrote: > Hi, > > I'm looking for a working and maintained compressed filesystem. > I'd like to use it for backing up my root and my /usr filesystems, > so that I can use rsync to keep it up-to-date. > > I've come across CompFused which seems to be just what I'm looking for, > but it's buggy not maintained anymore. > > Similarly, fusecompress > http://bugs.gentoo.org/show_bug.cgi?id=127433 > doesn't build on an up-to-date Gentoo system and doesn't > look maintained either. > > There would be sys-fs/zfs-fuse but that sounds like overkill to me. > > Are there any other packages? > > Many thanks for a hint, > Helmut. Tried a few for this and besides the unmaintained part, they dont stand up to the battering that rsync dishes out - regular corruption. If you have space, look at dirvish (its in portage) on reiserfs. Tried it on ext2 and ext3 - more corruption but reiserfs3 with data=journal is rock solid. The devs reccomend not using a journaled FS for performance, but I found it essential for my setup. Dirvish takes the full size for the first backup. Subsequent backups create hard links to existing files so only differences show up as using space. After a number of backups, total size stabilises around 2x original space unless you add some large files, or do an "emerge -ep world" :) Can be easily managed by cron and ssh keys including how many backups to keep etc. Can use on a local system, or more usually to a remote machine. Restore is as simple as copying the files back (though special files an permissions need to be maintained so a simple copy isnt viable for a full system restore.) BillK
Re: [gentoo-user] Compressed Filesystem
On Mon, 28 Dec 2009 12:58:13 +0100 (CET) Helmut Jarausch wrote: > Hi, > > I'm looking for a working and maintained compressed filesystem. > I'd like to use it for backing up my root and my /usr filesystems, > so that I can use rsync to keep it up-to-date. > > I've come across CompFused which seems to be just what I'm looking > for, but it's buggy not maintained anymore. > > Similarly, fusecompress > http://bugs.gentoo.org/show_bug.cgi?id=127433 > doesn't build on an up-to-date Gentoo system and doesn't > look maintained either. > > There would be sys-fs/zfs-fuse but that sounds like overkill to me. > > Are there any other packages? Although it might not be stable enough yet, btrfs has support for compression. -- Mike Kazantsev // fraggod.net
[gentoo-user] Compressed Filesystem
Hi, I'm looking for a working and maintained compressed filesystem. I'd like to use it for backing up my root and my /usr filesystems, so that I can use rsync to keep it up-to-date. I've come across CompFused which seems to be just what I'm looking for, but it's buggy not maintained anymore. Similarly, fusecompress http://bugs.gentoo.org/show_bug.cgi?id=127433 doesn't build on an up-to-date Gentoo system and doesn't look maintained either. There would be sys-fs/zfs-fuse but that sounds like overkill to me. Are there any other packages? Many thanks for a hint, Helmut. -- Helmut Jarausch Lehrstuhl fuer Numerische Mathematik RWTH - Aachen University D 52056 Aachen, Germany
