Re: Using md5 sum of file contents as key

2008-04-19 Thread Jeff Fisher

Ian Sherratt wrote:
Cheers everybody for their thoughts - it looks like its a good call for us, 
and its very reassuring to know we're not the first to either have the idea, 
or try it :)


Good reading: http://en.wikipedia.org/wiki/Venti

Jeff






Re: Using md5 sum of file contents as key

2008-04-18 Thread Justin Azoff
On Tue, 2008-04-15 at 12:30 +0100, Ian Sherratt wrote:
 Heya,
 
[...]
 We're considering using mogilefs as a storage solution, using a md5 sum (or 
 SHA-xx) of the file's contents as the key.  This key would be stored by each 
 application in their own databases along with all the metainformation which 
 is application dependent.
[...]
 Has any body used a function of the file contents as the key before?  Good 
 idea/bad idea?

Storing the checksum of the file also lets you verify the files
contents.

If mogilefs did this automatically, it could easily have a 'scrub'
feature in addition to fsck.

-- 
-- Justin Azoff
-- Network Performance Analyst