lol - am working on a similar system at the moment. Nothing set in stone, just mucking about. Its more for validating code, checking for 404s & 500s and spell checking, but it also occurred to me that you could use it to for compiling CFMX pages.
Various spiders I've looked at: Lynx - will run fine if you do it manually (at the cmd line), but I can't get it to log properly when called from cfexecute in CFMX. Jobo - is java & free but I don't like a few things about how it stores dynamic pages locally. Can also fill out forms & stuff. Libwww - the best so far, does everything I initially wanted but also has an ability to log directly into a mysql db, however this is not compiled into the binaries by default and I am still struggling with the building of of it from source. NetSpider - something my little bro is building in Java, will be a fully featured spider with gui, api & cmd line access. Expected to be released in around June 2029. Wget - needs winsock :( If you just want to run it manually yourself & not do anything fancy with logging - use lynx with the -traversal -crawl switches. Its super easy to get up & running. Cheers Mark ______________ Mark Stanton Web Production Gruden Pty Ltd Tel: 9956 6388 Mob: 0410 458 201 Fax: 9956 8433 www.gruden.com --- You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] MX Downunder AsiaPac DevCon - http://mxdu.com/
