On Fri, 21 Nov 2003 22:47:21 +0000, Toad wrote: > On Fri, Nov 21, 2003 at 03:20:58PM -0500, Ed Tomlinson wrote: >> On November 21, 2003 01:45 pm, Toad wrote: >> > On Fri, Nov 21, 2003 at 12:01:27PM -0500, Ed Tomlinson wrote: >> > > On November 21, 2003 06:41 am, Ian Clarke wrote: >> > > > It seems that we aren't seeing the hoped-for specialization in NGR. >> > > > Rather than futzing about with all sorts of ideas while trying to test >> > > > them in the chaotic real network, we need a simple simulator to help us >> > > > test these ideas. >> > > >> > > One idea to test on that simulator is are we specializing by key or >> > > for fast connections. It seems to me that, by far, the largest chunks >> > > of the NG estimator are from transmission time... When I did the >> > > first stabs at NG I was only basing it on search times and, if >> > > memory serves, it was getting much better numbers. >> > > >> > > Maybe we should be normallizing to a size that does not give >> > > a number much greater than transmission time? >> > >> > Why? >> >> The search time is usually a number averaging around 15,000 ms >> The time to recieve a normalized file is over 150,000 ms. This >> means the 15000 (or 2000 or 30000) gets lost in the noise and NGR >> just looks for the fastest node. > > Those are not the only factors involved. The transfer time is multiplied > by the probability of a transfer occurring.
I must ask... Doesn't this mean that the worse the node's chances of finding a given key, the better (lower) the estimate ? Shouldn't you multiply by the (1 - probability of transfer occurring) ? Unfortunately, I was unable to find the formula of estimate in the CVS source, so I couldn't check... Anyway, if this is true, it would explain the despecialization. Anyway, here's my datastore and inbound request stats. I think they have started getting a little less flat in the past hours, so maybe the pessimistic initial estimators are working... Running 6348. BTW. There seems to be something wrong with uploads (very very slow), but it's hard to say if it's a Frost or Freenet problem... ******** Histogram of keys in in fred's data store These are the keys to the data in your node's local cache (DataStore) Nov 22, 2003 6:20:47 PM keys: 3278 scale factor: 0.28828829526901245 (This is used to keep lines < 64 characters) 0 |================================================================ 1 |============================================================== 2 |================================================== 3 |============================================================= 4 |============================================================ 5 |=========================================================== 6 |============================================================= 7 |============================================================== 8 |=========================================================== 9 |====================================================== a |============================================================== b |========================================================== c |========================================================= d |======================================================== e |=========================================================== f |===================================================== peaks (count/mean) 0 --> (1.0835875) 3 --> (1.0347773) 7 --> (1.0640634) a --> (1.0640634) e --> (1.0152532) ********* Histogram of successful externally requested keys. This count has nothing to do with keys in your datastore Nov 22, 2003 6:20:55 PM keys: 302 scale factor: 1.0 (This is used to keep lines < 64 characters) 0 |========== 1 |======================= 2 |=============== 3 |=========== 4 |================ 5 |============== 6 |============================= 7 |==================== 8 |================== 9 |=============================== a |==================== b |==================== c |=================== d |========================== e |================ f |============== peaks (count/mean) 1 --> (1.218543) 4 --> (0.8476821) 6 --> (1.5364238) 9 --> (1.642384) d --> (1.3774835) ************* Histogram of requested keys. This count has nothing to do with keys in your datastore Nov 22, 2003 6:20:59 PM keys: 27183 scale factor: 0.03528114780783653 (This is used to keep lines < 64 characters) 0 |=========================================================== 1 |========================================================== 2 |========================================================= 3 |============================================================= 4 |============================================================= 5 |========================================================== 6 |================================================================ 7 |============================================================ 8 |============================================================ 9 |========================================================== a |============================================================= b |============================================================ c |============================================================= d |============================================================ e |========================================================== f |========================================================== peaks (count/mean) 0 --> (0.98885334) 4 --> (1.0194607) 6 --> (1.0677261) a --> (1.026524) c --> (1.0247581) f --> (0.9717838) _______________________________________________ Devl mailing list [EMAIL PROTECTED] http://dodo.freenetproject.org/cgi-bin/mailman/listinfo/devl
