This is what I do :
1º have a robots.txt file in the root containg:
User-agent: *
Disallow: /noBots.cfm

Any well behave robot should ignore file /noBots.cfm

2º hide a link to noBots.cfm somewhere in all pages like in div having 
style set to "display:none"
ie : <DIV STYLE="display: none;"><A href="\noBot.cfm">Site Map</A></DIV>

Only robots can see this page, and if they open it, then they are not 
compliant and BAD robots.

3º in the noBot.cfm page, you can register all charasteristics about the 
IP address, and HTTP_USER_AGENT value.

 From now on, you can return any insult you want page directly from the 
application.cfm any time the crap is identified.

-- 
_______________________________________
REUSE CODE! Use custom tags;
See http://www.contentbox.com/claude/customtags/tagstore.cfm
(Please send any spam to this address: [EMAIL PROTECTED])
Thanks.



~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Message: http://www.houseoffusion.com/lists.cfm/link=i:4:243489
Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4
Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Donations & Support: http://www.houseoffusion.com/tiny.cfm/54

Reply via email to