This is what I want:
I want to be able to be able to hand over every internal unique URL to 
another program, and have that program to get information from the HTML in 
the URL.

I just looked at linbot (http://starship.python.net/crew/marduk/linbot/) , 
and I believe it is correct for the use I want it for. Do any of you know 
how good it is? I.E., can it handle ~10,000 pages without slowing down too 
much?

thanks,
gil
________________________________________________________________________
Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com


------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.

Reply via email to