Unfortunately this "?" will also exclude "active server pages" for as much as we feel about it a lot of people are now using the NT server. > -----Original Message----- > From: Geoff Hutchison [SMTP:[EMAIL PROTECTED]] > Sent: 24 February 1999 18:38 > To: [EMAIL PROTECTED] > Cc: [EMAIL PROTECTED] > Subject: Re: [htdig] htdig-3.1.1; stopping it from indexing scripts > > > >Finally got it to compile (don't know why, it just did). Now I noticed > that > >it seems to index CGI script data (with ?:s and &:s in the path) by > default. > >How do I stop this? I tried to add the path to the script to the > >exclude-urls configuration option, and restart htdig, but it continued to > >index it, which isn't too good, since the script has about 216^5 > >combinations... :-/ > > You don't say what you set exclude_urls to. Here's mine: > > exclude_urls: cgi-bin .cgi ? .pl > > This excludes any URLs in our cgi-bin directory, as well as Apache's > directory sorting features and every URL with a ? character, which > indicates the start of a query. > > Cheers, > > -Geoff Hutchison > Williams Students Online > http://wso.williams.edu/ > > > ------------------------------------ > To unsubscribe from the htdig mailing list, send a message to > [EMAIL PROTECTED] containing the single word "unsubscribe" in > the SUBJECT of the message. ------------------------------------ To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] containing the single word "unsubscribe" in the SUBJECT of the message.
