I wouldn't expect 1500 files in a dir to be slow (from the file system
POV, the ftp server is doing who knows what).
slow would probably start to kick in ~10-30k files (and in general that
should still be fairly quick, opening the file would probably take on
the order of half a second).
Look at all the maildir based email systems out there, with 60k+ emails
in a folder.
On 04/05/2012 12:50 PM, Marghanita da Cruz wrote:
Michael Fox wrote:
Subsequent access yes, but the first access no. In addition, I still
think having 1000 directories (each with so many files under each of
those directories) is vastly better compared to 1 million files in a
single directory.
Good point, I just checked I am at 1406 files in the directory, so
probably
time to start spreading files across multiple directories. The ftp ls was
slow and it probably also slows writing (uploading replacing files).
At some time in the past, there was a suggestion about keeping files of
particular types together in separate directories. Does anyone have any
comments on this?
Very easy choice for managing using the first example.. web proxy or
not :)
On Thu, Apr 5, 2012 at 9:40 AM, Marghanita da Cruz
<[email protected] <mailto:[email protected]>> wrote:
When I downloaded the players in a single directory on my
computer after download the directory management took it toll on
my application, following the same directory structure had a
massive improvement on performance, a simple divide gave me the
directory.
It would be worth noting, that caching would make the situation
slightly different on a webserver.
Marghanita
-- Marghanita da Cruz
Ramin Communications (Sydney)
Website: http://ramin.com.au
Phone:(+612) 0414-869202
-- SLUG - Sydney Linux User's Group Mailing List -
http://slug.org.au/
Subscription info and FAQs:
http://slug.org.au/faq/__mailinglists.html
<http://slug.org.au/faq/mailinglists.html>
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
