Hi. Been playing with analog for a little while now, and last night decided to take a look at the ancrawl spider.
Assuming it was taking a gental perusal of my site, I left it to run overnight. Ha! This afternoon, as it was STILL running, I killed it, and decided to actually read the code. Not surprising it had got lost. There is no support for either the /robots.txt file, or the robots meta tag. It had got lost in an endless loop of dynamically generated pages! Question: Has anyone addressed this, or am I going to have to start from scratch? Cheers, -- Phil. +------------------------------------------------------------------------ | This is the analog-help mailing list. To unsubscribe from this | mailing list, go to | http://lists.isite.net/listgate/analog-help/unsubscribe.html | | List archives are available at | http://www.mail-archive.com/[email protected]/ | http://lists.isite.net/listgate/analog-help/archives/ | http://www.tallylist.com/archives/index.cfm/mlist.7 +------------------------------------------------------------------------
