in an old message Walter Underwood wrote : ------------------------ "You'd get much more mileage out of implementing If-modified-since and Allow correctly. A robot can get big speedups if the web server will just answer the questions "has this URL changed since date X?" and "is this URL one of the following content-types?".
In an informal test, an If-modified-since check was ten times faster than fetching the doc and getting a 200 OK. Ten times is serious speedup." wunder -- Walter R. Underwood Senior Staff Engineer Infoseek Software GO Network, part of The Walt Disney Company [EMAIL PROTECTED] http://software.infoseek.com/cce/ (my product) http://www.best.com/~wunder/ 1-408-543-6946 ---------------------- I'd like to know which web servers don't implement If-modified-since and Allow correctly, and can we expect this problem will be solved one day so that each robots can use these features efficiently ? Michel PLU