CAN HTDIG PULL LINKS OF A URL AND BUILD A WEB PAGE WITH THE LINKS IT GRABBED?
I have a question. I run a portal web site. I monitor over 100 web sites
that have the same type of links I have. What I do is manually grab the
links and add them to my page.
What I am looking for is a robot to automatically grab these links, plus
verify certain files exist at these links (Like video files .mpg) and the
remove duplicates and put each file in a category, then builds a page.
Does htdig have any of these features?
I can be more detailed in what I need it to do if required.
Please respond via e-mail: [EMAIL PROTECTED]
Thanks in advance for any assitance.
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
