According to Torsten Neuer:
> On Sam, 10 Apr 1999, Gunther Stammwitz wrote:
> >I'm running htdig to index several pages.
> >One of these pages is www.fundus.org.
> >On the fundus-webpage most of the pages are generated by a cgi-script for
> >example ref_such.cgi?Biologie or something like that.
> >The harvest-log-file tells me, that these Pages have been indexex, but if I
> >try to search a word from a cgi-generated-page harvest doesn't return a hit.
>
> Err.. "harvest"? I remember harvest.. it is something completely different.
>
> >I REMOVED the cgi-exclude in my htdig.conf
>
> You removed it from your htdig.conf.. only to get the *default* setting which
> is "exclude_urls: cgi-bin .cgi" (see online docs at http://www.htdig.org).
> The correct way of leaving cgi in there would be to leave the exclude_urls
> tag blank in the htdig.conf - but I'm not sure if ht://Dig does not barf
> on blank tags. Better set some foo value to be safe ,-)
Yes, with all releases of htdig up to and including 3.1.1, there was a
problem with an empty exclude_urls list. As Geoff put it a few weeks
ago... (One caveat... Currently, if you make exclude_urls empty,
it will ignore *all* URLs. So instead, set it to something that cannot
occur, like !-no-url-! and it won't exclude anything on the servers it
indexes.)
This has been fixed for the next release (3.1.2) and will soon be merged
into the 3.2 development version. ht://Dig does not generally barf on
blank tags, though. This was one exception.
--
Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]>
Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil
Dept. Physiology, U. of Manitoba Phone: (204)789-3766
Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
