Chuck: At each site we stored terabytes of files (PDFs, pictures, etc therefore hundreds of thousands of documents) outside the data file for 24 years at a few hundred sites. As you know medical so many regulations on security and logging of changes to the files.
1. We automatically created new folders each month and within the month each day. 2. The backup was adjusted each month to only backup the current months files and the rest of the year (usually empty). 3. All backups encrypted appropriately. 4. Multiple backups kept of all previous years of data. 5. If a document was modified, it would be moved to the current month’s folder. Doing the above greatly reduced the size of the backup required each night. Security 1. No on the network had access to the server where the files were stored. The backup device was attached directly to it. Only 4D had access to manipulate the files in anyway. 2. All access to the files was audited (even a view) both within our application, and the log files of the server they were stored on. 3. When the files were delivered to 4D Client for viewing they were encrypted and decrypted upon viewing. This provided security over the network of the documents. This is how we set things up to keep the data file size down within 4D. This greatly speeded up the maintenance of the 4D Data file which got done each quarter - more or less depending on the site. By creating new directories the speed of the storage Server was faster in delivering the documents. Also faster in working on that server directly and going into a folder. If ever we needed to have programatic access to run through the files to manipulate for some reason we could easily keep track of where we where in the process. Of course you may already have thought of all of this and there is some other reason this would not work for you. Jody Bevan > On 02/15/2017, at 11:59 AM, Charles Miller via 4D_Tech <[email protected]> > wrote: > > On Wed, Feb 15, 2017 at 9:43 AM, Randy Engle via 4D_Tech < > [email protected]> wrote: > >> However, we found that storing blobs in external file had detrimental >> effects in certain cases. >> If you've got 1000s and 1000s of blobs, these are all stored as individual >> files on disk. >> When copying these files (e.g. doing a manual backup), it takes vastly >> longer than if the blobs are stored in the data file. >> > > Did you let 4D decide where to place these files or did you control them. > Could you not in either case add a folder for 4D to include in backups. > > I have one customer where there are more than 500,000 pictures and drawings > stored in data file. It would be great to store them outside, but for > security reasons (outside access) and moving files between different > locations make this impossible > > Right now we have two copies of data file running on two different servers > and data gets moved between when changes are made. We also have another 5 > servers as well as many single user versions. > > Regards > > Chuck > ********************************************************************** 4D Internet Users Group (4D iNUG) FAQ: http://lists.4d.com/faqnug.html Archive: http://lists.4d.com/archives.html Options: http://lists.4d.com/mailman/options/4d_tech Unsub: mailto:[email protected] **********************************************************************
