Re: Random number generators for NDFS block numbers

2005-09-26 Thread Doug Cutting
Paul Baclace wrote: Doug Cutting expressed a concern to me about using util.Random to generate random 64 bit block numbers for NDFS. The following is my analysis. Nice stuff, Paul. Thanks. It just occurred to me that perhaps we could simply use sequential block numbering. All block ids

Re: Random number generators for NDFS block numbers

2005-09-26 Thread Paul Baclace
Doug Cutting wrote: It just occurred to me that perhaps we could simply use sequential block numbering. All block ids are generated centrally on the namenode. I'm not sure what the advantage of sequential block numbers would be since long period PRNG block numbering does not even need to

Random number generators for NDFS block numbers

2005-09-23 Thread Paul Baclace
Doug Cutting expressed a concern to me about using util.Random to generate random 64 bit block numbers for NDFS. The following is my analysis. Random number generators for NDFS block numbers Requirements capable of billions of block numbers 64 bit block numbers deterministic

Re: Random number generators for NDFS block numbers

2005-09-23 Thread Paul Baclace
Thanks to archive.org, I found this additional reference: http://www.math.sci.hiroshima-u.ac.jp/~m-mat/eindex.html which is the English home page of Matsumoto san, co-originator of Mersenne Twister. There is a faq and the original C source. Paul Paul Baclace wrote: [...] Alternative