I played with a file management system a long time ago (4D v2 or v3) I did not do the hash thing -- sounds like an excellent idea! but ... running though a disk, and storing file paths (only) took a long time. now the hardware was a LOT slower then today's, but the drives were also much much SMALLER. --- There are utilities out there for discovering duplicate files, I believe these utilities access the file system directories directly rather then walking the directory structure, touching every file.
Depending on the OS, and exactly what is backed up - there could easily (OS X) be millions of files (the OSX system is more then a hundred of thousand by itself). > I need a utility that can scan a backup drive (or index) and identify > what’s unique to the backup volume without expecting identical > pathnames on the other drives... So, the routine would have to query > (effectively a Finder Search for each file) all specified drives > looking for each file and reporting those that are missing... > Basically, I need to know which data on this given backup drive is > truly unique and therefore potentially valuable. > > Might there be a 4D solution? Have you dealt with large directories > or many directories from the file system? If there is a utility > already built I’m open to that as well. > > Thanks, > > Robert > ********************************************************************** > 4D Internet Users Group (4D iNUG) > FAQ: http://lists.4d.com/faqnug.html > Archive: http://lists.4d.com/archives.html > Options: http://lists.4d.com/mailman/options/4d_tech > Unsub: mailto:[email protected] > ********************************************************************** ------------ Hell is other people Jean-Paul Sartre ********************************************************************** 4D Internet Users Group (4D iNUG) FAQ: http://lists.4d.com/faqnug.html Archive: http://lists.4d.com/archives.html Options: http://lists.4d.com/mailman/options/4d_tech Unsub: mailto:[email protected] **********************************************************************
