> I want htdig to index my site, but am not sure of how to set up the config
> file to accomplish it.
> The structure is as follows:
> Under the main url, there are 20+ (category) directories, and under each
> of these directories are the user directories (many thousands).
> Within the user directories are the html files I want to index.
> 
> I've tried putting the url with the category directories in the conf file
> for the start_url, but the indexing does not work. I believe because the
> html files are not directly under the category directories. 
> I want the indexing to go thru each user directory within its category
> directory for all categories. 
> Can htdig do that? I certainly can't put all 30,000+ sites into my config
> file.
> 
> Thanks for your help.
> 
> Roger Weiss
> 
> 

------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.

Reply via email to