At 17.02 20/10/2003 -0500, Gilles Detillieux wrote:
wrong, I think it would be helpful if the code automatically did the right thing in most circumstances, and if the documentation for this attribute made it clear in which circumstances it would make sense to turn it off.
Yep. I think so too. Anyway, I modified the defaults.cc by putting the attribute in a 'true' default state and by explaining that:
- during an incremental dig, the value is overridden; - in general, it is recommended to leave this value on.
I did not specify cases in which the attribute should be turned off as I thought I would have generated more confusion in the user.
However, I would pick these general cases, where the user should disable the attribute (please revise it):
Case A - Persistent connections on
1) the majority of documents are HTML (this means we "always" want to GET them)
2) the server does not support HEAD (I have seen cases like this unfortunately)
3) cases where the persistent communication between htdig and the server does not work at 100%: there can be some problems with persistent connections and HEAD calls (I experience this kind of problems sometimes with ht://Check and some NT servers)
Case B - Persistent connection off
1) same as case A
2) same as case A
3) I have never experienced any problem as in case A.3 with persistent connections disabled
Well, it seems to me that there are actually two different cases where htdig does an initial dig. The obvious one is when the user specifies -i, which sets the initial flag. The less obvious one is when htdig is run without -i, but with no existing database, or with an empty one. What matters is whether there are URLs in the database or not. If there are none, then you'll never reject a document as "not changed".
OK. Good point. I think I changed the Retriever class in order to perform this check as well. Also, during an incremental dig, if debug > 1 I show a notice message, saying that any head before get attribute configuration is overridden and that HEAD is always enabled.
Sounds good?
Ciao and thanks,
-Gabriele
--
Gabriele Bartolini: Web Programmer, ht://Dig & IWA/HWG Member, ht://Check maintainer
Current Location: Melbourne, Victoria, Australia
[EMAIL PROTECTED] | http://www.prato.linux.it/~gbartolini | ICQ#129221447
> "Leave every hope, ye who enter!", Dante Alighieri, Divine Comedy, The Inferno
------------------------------------------------------- This SF.net email is sponsored by OSDN developer relations Here's your chance to show off your extensive product knowledge We want to know what you know. Tell us and you have a chance to win $100 http://www.zoomerang.com/survey.zgi?HRPT1X3RYQNC5V4MLNSV3E54 _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev