We found this post from Ben Nadel to be extremely helpful in detecting bot traffic. We have a highly customized statistical tracking system in place for our web traffic, and wanted to accomplish two primary objectives: a) not record page views of bots, and b) not maintain a separate session on every page view (this is accomplished by identifying the visit as a bot and setting the session timeout to 2 sec). We have found Ben's work here to be highly effective.
http://www.bennadel.com/blog/1083-ColdFusion-Session-Management-And-Spiders-Bots.htm Steve "Cutter" Blades Adobe Certified Professional Advanced Macromedia ColdFusion MX 7 Developer Co-Author of "Learning Ext JS" http://www.packtpub.com/learning-ext-js/book _____________________________ http://blog.cutterscrossing.com Jim McAtee wrote: > We keep our own page view stats in a database and want to avoid counting > page views by visiting spyders. What's a good method for recognizing > spyders without throwing away valid visitor page views? > > Something using cgi.user_agent, no doubt, but how can we keep a fairly > comprehensive list up to date, and do we try to do exact string matches, > partial matches, or what? > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:318047 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
