I hi all! Prompt, please, that to me to do. I using HTDIG 3.1.5
On my site there are no links with the tags <a href = "somelink">. All links in menus it is made on JavaScript. That HTDIG indexed my site i have made a map of a site (URL http://domain/sitemap/) with use tags <a href = "somelink">. In file htdig.conf i have added lines: start_url: http://domain/sitemap/ limit_urls_to: http://domain/ All indexing is good. A problem that a file, which gives out a server on URL http://domain/sitemap/ (the map of a site) consists of hundreds links. And these links frequently get in results of inquiry as in URL, too there are correct words!!! How I can forbid distribution of words from a file http://domain/sitemap/ not having broken correct work HTDIG? This file is the unique list of all links of a site! By the way addition in htdig.conf lines: exclude_urls: /cgi-bin/ .cgi /sitemap/ /sitemap has not solved a problem - the file of honey agarics has got in index base. _____________________ Yours faithfully, Art _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
