Re: Utilizing OSDL's STP for Reiser4 testing/benchmarks?

2006-07-21 Thread Hans Reiser
Nate Diller wrote: > On 7/21/06, Mike Benoit <[EMAIL PROTECTED]> wrote: > >> Has the Reiser4 team looked at utilizing the OSDL Scalable Test Platform >> (STP) service to benchmark and test Reiser4 patches? They seem to offer >> a wide variety of hardware to test on, and already have some file syst

Re: reiser4 status (correction)

2006-07-21 Thread Hans Reiser
David Masover wrote: > > > And it's not just databases. Consider BitTorrent. The usual > BitTorrent way of doing things is to create a sparse file, then fill > it in randomly as you receive data. Only if you decide to allocate > the whole file right away, instead of making it sparse, you gain >

Re: Utilizing OSDL's STP for Reiser4 testing/benchmarks?

2006-07-21 Thread Nate Diller
On 7/21/06, Mike Benoit <[EMAIL PROTECTED]> wrote: Has the Reiser4 team looked at utilizing the OSDL Scalable Test Platform (STP) service to benchmark and test Reiser4 patches? They seem to offer a wide variety of hardware to test on, and already have some file system benchmarks available to choo

Re: reiser4 status (correction)

2006-07-21 Thread David Masover
Mike Benoit wrote: Your detailed explanation is appreciated David and while I'm far from a file system expert, I believe you've overstated the negative effects somewhat. It sounds to me like you've gotten Reiser4's allocation process in regards to wandering logs correct, from what I've read anyw

Re: storing images thumbnails as pseudo files?

2006-07-21 Thread Hans Reiser
Pysiak Satriani wrote: >Hello, > >suppose pseudo files, file-as-directory are on my r4 partition and are usuable. > >Does namesys' vision allow things like storing image thumbnails "inside the >file >itself" ? > >Example using jpgtn (jpgtn creates thumbnails of jpg files) > >// create 150px thumb

Re: somewhat OT query on journalling

2006-07-21 Thread Hans Reiser
David Masover wrote: > Andreas Schäfer wrote: > >>> Don't get too excited -- the transactions probably aren't done yet. >>> Without those, no filesystem that claims to journal data is really >>> any better than a filesystem which only journals metadata. Even >>> once they are implemented (or even

Re: reiser4 status (correction)

2006-07-21 Thread Hans Reiser
Mike Benoit wrote: > >On top of that, I don't see how a repacker would help these work loads >much as the files usually have a high churn rate. > I think Reiserfs is used on a lot more than squid servers. For them, 80% of files don't move for long periods of time is the usual industry statistic.

Re: storing images thumbnails as pseudo files?

2006-07-21 Thread Hans Reiser
David Masover wrote: > Disclaimer: I don't speak for Namesys, and I don't work here. While > I'm pretty confident I understand their vision, the final word on > anything Reiser is always from Hans Reiser. David described my views pretty well, and saved me much typing.:)

Re: reiser4 status (correction)

2006-07-21 Thread Mike Benoit
Your detailed explanation is appreciated David and while I'm far from a file system expert, I believe you've overstated the negative effects somewhat. It sounds to me like you've gotten Reiser4's allocation process in regards to wandering logs correct, from what I've read anyways, but I think you'

Re: reiser4 status (correction)

2006-07-21 Thread Andreas Schäfer
On 17:45 Fri 21 Jul , David Masover wrote: > Question, then: Can the ext2 defrag work on a raw ext3 partition, without > having to convert it first? Dunno, but I don't think so pgp3cS9WVSQCi.pgp Description: PGP signature

Re: reiser4 status (correction)

2006-07-21 Thread David Masover
Andreas Schäfer wrote: On 14:37 Fri 21 Jul , Mike Benoit wrote: No Linux file system that I'm aware of has a defragmentor, but they DO become fragmented, just not near as bad as FAT32 used to when MS created their defragmentor. Forgotten ext2? ;-) Funny thing: If your ext3 got too fragment

Re: fsck.reiserfs --rebuild-tree out of disk space aborted

2006-07-21 Thread David Masover
Joel Heenan wrote: The filesystem contains some sensitive data so I can't really do this I'm afraid. I'm happy to run any diagnostic tools you have or provide any more information. I wonder if anything like this exists already... Maybe it would work if you could provide moderated ssh access.

Re: reiser4 status (correction)

2006-07-21 Thread David Masover
Mike Benoit wrote: On Fri, 2006-07-21 at 16:06 -0500, David Masover wrote: Mike Benoit wrote: Tuning fsync will fix the last wart on Reiser4 as far as benchmarks are concerned won't it? Right now Reiser4 looks excellent on the benchmarks that don't use fsync often (mongo?), but last I recall t

Re: fsck.reiserfs --rebuild-tree out of disk space aborted

2006-07-21 Thread Joel Heenan
On 7/22/06, Vladimir V. Saveliev <[EMAIL PROTECTED]> wrote: hello On Fri, 2006-07-21 at 10:09 +1000, Joel Heenan wrote: > Hi, > > I can home about two weeks ago and found my media box locked up. I was > able to discover that it had filled up its /dev/md2 partition (mounted > on /home) which surp

Re: reiser4 status (correction)

2006-07-21 Thread Andreas Schäfer
On 14:37 Fri 21 Jul , Mike Benoit wrote: > No Linux file system that I'm aware of has a defragmentor, but they DO > become fragmented, just not near as bad as FAT32 used to when MS created > their defragmentor. Forgotten ext2? ;-) Funny thing: If your ext3 got too fragmented: convert it back t

Re: somewhat OT query on journalling

2006-07-21 Thread David Masover
Andreas Schäfer wrote: Don't get too excited -- the transactions probably aren't done yet. Without those, no filesystem that claims to journal data is really any better than a filesystem which only journals metadata. Even once they are implemented (or even if they are already), applications have

Re: reiser4 status (correction)

2006-07-21 Thread Mike Benoit
On Fri, 2006-07-21 at 16:06 -0500, David Masover wrote: > Mike Benoit wrote: > > > Tuning fsync will fix the last wart on Reiser4 as far as benchmarks are > > concerned won't it? Right now Reiser4 looks excellent on the benchmarks > > that don't use fsync often (mongo?), but last I recall the fsyn

Re: somewhat OT query on journalling

2006-07-21 Thread Andreas Schäfer
> Don't get too excited -- the transactions probably aren't done yet. Without > those, no filesystem that claims to journal data is really any better than a > filesystem which only journals metadata. Even once > they are implemented (or even if they are already), applications have to > support

Re: reiser4 status (correction)

2006-07-21 Thread David Masover
Mike Benoit wrote: Tuning fsync will fix the last wart on Reiser4 as far as benchmarks are concerned won't it? Right now Reiser4 looks excellent on the benchmarks that don't use fsync often (mongo?), but last I recall the fsync performance was so poor it overshadows the rest of the performance.

Re: reiser4 status (correction)

2006-07-21 Thread Mike Benoit
On Fri, 2006-07-21 at 02:44 -0600, Hans Reiser wrote: > fix fsync performance (est. 1 week of time to make post-commit writes > asynchronous, maybe 3 weeks to create fixed-reserve for write twice > blocks, and make all fsync blocks write twice) > > write repacker (12 weeks). > > I am not sure tha

Re: storing images thumbnails as pseudo files?

2006-07-21 Thread David Masover
Pysiak Satriani wrote: Hello, suppose pseudo files, file-as-directory are on my r4 partition and are usuable. Does namesys' vision allow things like storing image thumbnails "inside the file itself" ? Ultimately, yes. Currently, I don't know. The most common use of pseudofiles, for instance

Re: Utilizing OSDL's STP for Reiser4 testing/benchmarks?

2006-07-21 Thread Hans Reiser
Elena, on Monday can you comment on this in detail? Thanks, Hans Mike Benoit wrote: >Has the Reiser4 team looked at utilizing the OSDL Scalable Test Platform >(STP) service to benchmark and test Reiser4 patches? They seem to offer >a wide variety of hardware to test on, and already have some fi

storing images thumbnails as pseudo files?

2006-07-21 Thread Pysiak Satriani
Hello, suppose pseudo files, file-as-directory are on my r4 partition and are usuable. Does namesys' vision allow things like storing image thumbnails "inside the file itself" ? Example using jpgtn (jpgtn creates thumbnails of jpg files) // create 150px thumbnail $ jpgtn -s 150 -H test.jpg //

Re: reiser4 status (correction)

2006-07-21 Thread David Masover
Hans Reiser wrote: I am not sure that putting the repacker after fsync is the right choice Does the repacker use fsync? I wouldn't expect it to. Does fsync benefit from a properly packed FS? Probably. Also, while I don't expect anyone else to be so bold, there is a way around fsync pe

Re: somewhat OT query on journalling

2006-07-21 Thread David Masover
Payal Rathod wrote: On Wed, Jul 19, 2006 at 01:28:38PM -0700, Hans Reiser wrote: V3 defaults to metadata only, V4 does data also because we can do it without performance loss. wwow!!! Don't get too excited -- the transactions probably aren't done yet. Without those, no filesystem t

Re: 2.6.17 patch is in testing now

2006-07-21 Thread Ingo Bormuth
On 2006-07-18 13:43, Hans Reiser wrote: > If testing goes well we will release it tomorrow. Hmm, so what would you say - should it be regarded as released ? -- Ingo Bormuth, voicebox & telefax: +49-12125-10226517 '(~o-o~)' public key 86326EC9, http://ibormuth.efil.de/contact --ooO--(.)

Utilizing OSDL's STP for Reiser4 testing/benchmarks?

2006-07-21 Thread Mike Benoit
Has the Reiser4 team looked at utilizing the OSDL Scalable Test Platform (STP) service to benchmark and test Reiser4 patches? They seem to offer a wide variety of hardware to test on, and already have some file system benchmarks available to choose from. I noticed the Namesys benchmark page hasn'

Re: create very large file system

2006-07-21 Thread Stephen Tweedie
Hi, On Wed, Jul 19, 2006 at 07:10:56AM -0500, Mark F wrote: > Suse Linux Enterprise Server 9 SP3 > > I've tried to create a large 5TB file system using both reiserfs and ext3 > and both have failed. > > I end up with only a 1.5TB file system. Does anyone know why this doesn't > work, what to

Re: fsck.reiserfs --rebuild-tree out of disk space aborted

2006-07-21 Thread Vladimir V. Saveliev
hello On Fri, 2006-07-21 at 10:09 +1000, Joel Heenan wrote: > Hi, > > I can home about two weeks ago and found my media box locked up. I was > able to discover that it had filled up its /dev/md2 partition (mounted > on /home) which surprised me because it is 550 gigs. Perhaps mythtv > went nuts a

Re: somewhat OT query on journalling

2006-07-21 Thread Payal Rathod
On Wed, Jul 19, 2006 at 01:28:38PM -0700, Hans Reiser wrote: > V3 defaults to metadata only, V4 does data also because we can do it > without performance loss. wwow!!! > > >Also, is it true that now-a-days there is no such thing as inode "block" > >since for faster access the inodes ar

Re: reiser4 status (correction)

2006-07-21 Thread Sarath Menon
> Sigh, no, the repacker will probably be after 4.1 > The list of tasks for zam looks something like: > fix bugs that arise > debug read optimization code (CPU reduction only, has no effect on IO), > 1 week est. (would be nice if it was less) > review compression code 1 day per week until it

Re: reiser4 status (correction)

2006-07-21 Thread Hans Reiser
David Masover wrote: > Hans Reiser wrote: > >> On a more positive note, Reiser4.1 is getting closer to release > > > Good news! But it's been awhile since I've followed development, and > the homepage seems out of date (as usual). Where can I find a list of > changes since v4? > > By "out of

Re: fsck.reiserfs --rebuild-tree out of disk space aborted

2006-07-21 Thread Hans Reiser
vs will try to help you Did Jeff fix the mythtv performance problem yet? If not, vs, please rip out the "optimization" which goes looking for the perfect length spot for files, and send both joel and akpm the patch. It is really not such a bad algorithm to just use the spots that are free in

Re: other system with datacorruption (2.425 + datalogging patches)

2006-07-21 Thread Francisco Javier Cabello
Hello, The rebuild tree succeed. I send you the output. Regards, Paco On Thursday, 20 de July de 2006 14:52, Francisco Javier Cabello wrote: > Hello, > I have other system with data corruption. > I send you the output of 'reiserfsck --check' > > Regards, > > Paco -- One of my most productive d