Hanno Mueller wrote:
> >>The author of such a page's HTML code could, however, add a list of
> >>meta-information with links "hidden" in the document. When creating the
> >>index, htdig would add these links to its list of pages to crawl:
> >>
> >><META NAME="htdig-follow" CONTENT="/home.html">
> >><META NAME="htdig-follow" CONTENT="/news/overview.html">
> >><META NAME="htdig-follow" CONTENT="/contact/mail.html">
..
> The jobs in web agencies have always been very specialized. By experience,
> I can tell you that most screen designers and people doing HTML will
> _never_ touch a configuration file. They don't feel comfortable doing that
> - as soon as something looks like "programming", their instincts tell them
> not to touch it... :-) But with this feature, they could maintain these
> data without needing to understand the configuration file.
I think under the DTD, the best solution is the <LINK> tag. A few
browsers are starting to add support for it (iCab on the Macintosh, for
example). Since it's already there and doesn't require a non-standard
tag, this is probably my preferred route for this.
> (Btw, is "htcheck" a good name? Or should this feature be added to htnotify?)
I'll speak for Gabriele and say that this name is good (that's what he's
using) and development is already underway. Anyone interested should
contact Gabriele Bartolini <[EMAIL PROTECTED]>
Besides htcheck, there's also a contributed script which formats the
broken link report spit up by ht://Dig at the end of a dig.
<http://www.htdig.org/files/contrib/scripts/report_missing_pages.pl>
> Most crawlers do not mention their referer. They do not have to, but I
> always think it's kind of inpolite.
Besides the URLs in start_url, ht://Dig uses the refererring URL. It
would be easy to add one for the start_url's, but what would that be?
:-)
> Sitemap generation is something that is much more complex and not very useful
> at all if you want your very special nifty little map with graphics and table
> formatting etc.
>
> It is fairly easy to have a nested list generated with the additions you
> mention above, but most people won't be happy with that.
>
> If there's no way to have the digger working with a nifty template in order
> to generate the map, then the implementation would IMO not be worth the effort.
Colin Viebrock, the author of the DevShed article on ht://Dig and PHP
mentioned that he was asked to work on a sitemap tool. Anyone interested
should contact him (he's currently on vacation) <[EMAIL PROTECTED]>
-Geoff
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
