On Sun, 30 Jan 2005 12:52:45 +0200, Karolis Dautartas <[EMAIL PROTECTED]> wrote:
> SP> The performance impact from large directories will have a lot to do
> SP> with the type of file system you are using. File systems like
> SP> reiserfs, xfs, and other btree based file systems handle very large
> SP> directories very well, other like ext2/ext3 that use linked lists for
> SP> the directory lists can start to slow down when you get more then 10k
> SP> entries (though linux 2.6 includes the htree patch to do hashed
> SP> directories indexes which should make accessing it better though I
> SP> have not tested it personally).
> 
> SP> What operating system and file system are you using to store the 
> mailboxes on?
> 
> I am using Fedora Core 2 and EXT3 filesystem.
> 
> 10k entries is not bad though.

FC2 ships with the htree indexed directory patch. You can confirm if
you directory is indexed by doing lsattr -d <yourdir>. If you see the
I flag listed then the directory is indexed. I just ran some tests to
test it's responsiveness, and a directory with 10k files, or 10k
directories in it is VERY snappy when listing it's contents.

Just make sure to stay under 30k sub-directories, I tried doing a test
of 100k directories, and ran into a problem. Apparently nlink_t is
only an unsigned 16bit integer, my test failed in the same manner as
this problem reported in redhats bugzilla. Here's the link for more
info https://www.redhat.com/archives/taroon-list/2003-November/msg00060.html
.

-- 
Sean

Reply via email to