Does anybody have any thoughts or recommendations on which of the various
www robot's modules that are around which would allow 'realtime saving of
state'. i.e. if the perl script crashes, and I start it over it'll start
from the same point it died from. I need to populate a database with the
given 'link' information, i.e. 'from link' to 'to link', so that I can then
run a reporting tool on the database.
Basically I need to create a database map of which links go to which page
for every page on an individual internet site. Speed is important, so whilst
the robot must be 'nice' it doesn't have to have the manners of a prince!
Also multiple robots can be operating on the site at any given time. for
example one robot would stay within XXX.domain.com and another might map
YYY.domain.com however I may want more than one robot to work on
www.domain.com.
I have a linux box and database access at my desposal.
Regards
Marty
---
You are currently subscribed to perl-win32-users as: [archive@jab.org]
To unsubscribe, forward this message to
[EMAIL PROTECTED]
For non-automated Mailing List support, send email to
[EMAIL PROTECTED]
