On Mon, 15 Apr 2002, Ryan Govostes wrote: >i was wondering if it would be possible to make a web spider in PHP. >they work by download a website, then following all the links on the >website to other pages, and then following the links on that page... > >is this possible in PHP without a whole lot of work? i just want to keep >a counter of how many links (not e-mail addresses or file downloads) it >finds. if someone has the time, could you write up a quick recursive >script that i could use as a basis of my project?
Well, I love PHP, but this sounds more like a job for C/C++. The reason being is the socket support in C/C++ is way better than that found in PHP. Harder to code mind you, but better in the end. Also, you might want to check out some exisiting applications that already do this sort of thing, there's no need in re-inventing the wheel. I use htdig and it works swell for small projects where you need to index a small to medium sized website for later searching. -- ----------------------------------------------------------------------- Greg Donald - http://destiney.com/ http://phprated.com/ | http://phplinks.org/ | http://phptopsites.com/ ----------------------------------------------------------------------- -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
