On Mon, 13 May 2002, Robert Mena wrote:
> Hi, I'd like to know if anyone has good references
> (links, ps, pdf etc) about building a crawler and tips
> regarding doing that with PHP.
> This would be mostly for learning purposes.

I'll just give you one tip:

Keep track of your stack size! It's easy to follow looping links into 
accursed recursive oblivion.

Other than that, not much to it. Global array of links. Recursive function 
to fetch all the links on a page, add them to the global array (if not 
already present), and then call itself on each one.


PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Reply via email to