According to SoloCDM: > Gilles Detillieux stated the following: > > If your files don't have the right > > suffixes, or if they're not there, it'll tend to stop htdig dead in > > its tracks. That includes the index.html file, which must be there > > because htdig won't read directories itself. When local_urls_only is > > false, htdig will fall back to HTTP whenever a local fetch fails. > > What have others done to collectively put all the directory paths > together for htdig? Do they make one index.html that points to all > the other index.html files, do they list every path in htdig.conf, or > what?
There isn't a single correct way to do this which everyone must follow. There are many ways of feeding URLs into htdig, and which is best depends a lot on the circumstances on your own server. In the simple case, where you index a site that has good HTML navigation links in it, you can just use the site's main URL as start_url, and htdig should find everything. Things get trickier when not all documents on your site are linked to each other in that way. See http://www.htdig.org/FAQ.html#q5.25 The problem you seem to be running into is that you want automatically generated directory indexes, as most web servers are able to generate, but you want to bypass the web server using local_urls_only. You can't have it both ways, because htdig won't read directories itself. If you don't want to index through the web server, you need to generate a file that has all the URLs, either as a simple URL list for your start_url attribute, or as an HTML page of links to the documents to index. -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
