Bernard Higonnet's bits of Sat, 23 Feb 2002 translated to: >I have a site with a directory which does not have a static index.html >and the (Apache) server does NOT have "Option Indexes". Htdig apparently >does not accept stuff like "/htdocs/*.html" in start_url so the only way >I have been able to index the files is to turn on server indexing for >duration of the dig and then turn it off again. > >Is there a better way to do this?
Perhaps it isn't a realistic solution for your particular case, but you might consider writing a little script that recurses through the directories, finds the files of interest, and adds a URI for each one to a file. You could then pass that file to ht://Dig using start_url: `name_of_url_file` If the file contains the complete list of URI's, you can set max_hop_count to 0 so that ht://Dig doesn't try to follow any of the links it finds in the indexed pages. Jim _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
