On Tue, 4 Apr 2000, PLU Michel FTRD/DMI/LAN wrote: > I'd like to know which web servers don't implement If-modified-since > and Allow correctly, and can we expect this problem will be solved one day > so that each robots can use these features efficiently ?
I don't recollect anyone using Allow, but I'm not sure it's of so much use since it refers to alternate Methods, e.g. PUT, while most (static) webserving uses GET. As I recall. If-Modified-Since requires a defined Last-Modified date for the page. Most CGI scripts, .shtml without Xbithack, and, I believe, Active Server Pages do not generate an appropriate Last-Modified header and so will give a 200 response with GET If-Modified-Since. Myself, I use HEAD then check the modification time and MIME type. There seem to be a few servers out there which do not support HEAD, or treat it as GET. I think the original poster perhaps meant "Accept" not "Allow" - which if set to "text/html" and if working properly would reject pages of other types such as audio/mp3 or application/msword. Andrew Daviel TRIUMF, Vancouver Webpages etc.
