You most certainly can use PHP to do this.

And if i'm not wrong I think there are allready scripts which do this (which
wouldn't be too hard to hack up for yourself)

Check out

----- Original Message -----
From: "Ryan Govostes" <[EMAIL PROTECTED]>
Sent: Monday, April 15, 2002 8:42 PM
Subject: [PHP] web spider?

i was wondering if it would be possible to make a web spider in PHP.
they work by download a website, then following all the links on the
website to other pages, and then following the links on that page...

is this possible in PHP without a whole lot of work? i just want to keep
a counter of how many links (not e-mail addresses or file downloads) it
finds. if someone has the time, could you write up a quick recursive
script that i could use as a basis of my project?


PHP General Mailing List (
To unsubscribe, visit:

PHP General Mailing List (
To unsubscribe, visit:

Reply via email to