I've experienced problems with directories that have as few as 10k files in them. This usually manifests itself first as problems browsing the directory with explorer.exe.
Once you have problems with explorer hanging, I've found that it's time to start dividing the files into smaller directories. Kurt On Fri, Aug 5, 2011 at 10:53, Webster <[email protected]> wrote: > I did some work for a bank processing company one time where they processed > all the checks, deposits, etc for numerous banks. The software they used > put everything nice and neat in a very organized folder system with files > for everything processed for that day in a separate folder. After 2 months > the system was begging for mercy. When they scanned in an item, the item > was turned into a front and back GIF and JPG and PNG and BMP and then a PDF > of all the above. Process a small bank’s daily intake of say 5,000 items > and each folder would contain around 45,000 files. Multiply that by 6 work > days a week, 4 (or so) weeks month times 2 months and then all this for > around 50 banks. The file servers was begging for mercy. > > > > After the first week on the new software it was taking 30+ hours to do a > daily backup so they went to a weekly backup. The backup started at 10PM > Friday night and was not finished by 8AM the following Monday. > > > > As a former app dev guy, I always wondered why they didn’t just use SQL, > only the PNG image type and build a PDF on an as needed basis. The > processing company was sold after 4 months to a company that moved them to > an AS/400 system where everything was scanned in and stored in a database. > > > > With a lot of files, and especially a lot of small files, Windows is VERY > inefficient. Move into the millions of files and the Windows file system is > not where I would want to store stuff. > > > > > > Carl Webster > > Consultant and Citrix Technology Professional > > http://www.CarlWebster.com > > > > > > From: Roger Wright [mailto:[email protected]] > Sent: Friday, August 05, 2011 12:38 PM > To: NT System Admin Issues > Subject: SQL for File Storage? > > > > We have a company pitching a project management solution that stores all > project data, including photos, docs, etc. in SQL. I'm leary because most > of our projects have about 200 MB of related files and I'm envisioning huge > databases. > > > > Should I be, or is SQL more ideal for this type of application than I > suspect? > > Roger Wright > ___ > > Bozone (n.): The substance surrounding stupid people that stops bright ideas > from penetrating. > > > > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ > ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ > > --- > To manage subscriptions click here: > http://lyris.sunbelt-software.com/read/my_forums/ > or send an email to [email protected] > with the body: unsubscribe ntsysadmin > > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ > ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ > > --- > To manage subscriptions click here: > http://lyris.sunbelt-software.com/read/my_forums/ > or send an email to [email protected] > with the body: unsubscribe ntsysadmin ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ --- To manage subscriptions click here: http://lyris.sunbelt-software.com/read/my_forums/ or send an email to [email protected] with the body: unsubscribe ntsysadmin
