Quoth Amos Shapira: > Hi, > > Our servers have to deal with huge amounts of small files (tens, > sometimes hundreds of thousands of files IN ONE DIRECTORY). > > Currently they use ext3 but I wonder wether this is the prefered FS.
Ext3 is - last I chaecked (about two years ago) possibly the worst filesystem for dealing with LOTS of files in a single directory. Reiser 3 was very good (did not try reiser 4). However, I am very wary of reiser now - what with poor (or, maybe, not so poor) Hans being in jail, reiserfs may be going the way of the dodo. I'd run bonnie (just the creation/deletion tests) for JFS, XFS and Ext4 (which is starting to make an appearance here and there). IIRC - XFS is ALSO not very good with lots of small files. > I'm also thinking about better ways to handle the files (e.g. putting every > few thousands of them in a .zip file to transfer, spreading them across a > two-level directory tree etc) but I'd rathertry to keep the changes to the > existing software and scripts the the minimum which is required to speed > things up. B-sort em? Switch the back-end to database (assuming the blobs are small)? -- ---MAV Marc A. Volovic [EMAIL PROTECTED] Swiftouch, LTD +972-544-676764 ================================================================= To unsubscribe, send mail to [EMAIL PROTECTED] with the word "unsubscribe" in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
