wget can do pretty much anything relating to web crawling, it's got a ton of options. it might be kind of annoying, but there should be some tutorials out there to simplify what you want to do... it's pretty much the swiss-army-knife of web crawling tools.
-Phil
On 4/3/06, Rob <[EMAIL PROTECTED]> wrote:
Anyone have any experience with web crawling software s.t. they could
recommend something? The stuff I got from googling seemed annoying at
first pass :-(
- Rob
