Hi Andrew,

I'm not attempting to stop bots from indexing my site, I am just 
trying to identify them and log their activity seperately to 'real' 
visitors to the site. And the code snippet appears to me to do an OK 
job as far as that goes.

What you do with session.botsession=true is up to you...

Brett
B)


> ----- Original Message -----
> From: "Andrew Scott" <[EMAIL PROTECTED]>
> "Andrew Scott" <[EMAIL PROTECTED]>

> Sent: Fri, 15 Jul 2005 11:26:31 +1000
> Subject: [cfaussie] RE: Search Engines
>
>
> Not a browser but my own logs that I am capturing.
> 
> Found over 300 entries for this.
> 
> Mozilla/5.0 (compatible; Yahoo! Slurp;
> http://help.yahoo.com/help/us/ysearch/slurp)
> 
> It's a search engine spider/crawler/bot if you go to the website 
you will
> see that there is info about why they are crawling your site.
> 
> 
> Regards
> Andrew Scott
> Analyst Programmer
> 
> CMS Transport Systems
> Level 2/33 Bank Street
> South Melbourne, Victoria, 3205
> 
> Phone: 03 9699 7988  -  Fax: 03 9699 7976
> 
> -----Original Message-----
> From: [EMAIL PROTECTED]
> [mailto:[EMAIL PROTECTED] On Behalf Of
> [EMAIL PROTECTED]
> Sent: Friday, 15 July 2005 11:14 AM
> To: CFAussie Mailing List
> Subject: [cfaussie] RE: Search Engines
> 
> 
> Hi Andrew,
> 
> That's odd. What browsers are you seeing that suggest this?
> 
> Fourth on my list of search engines is "Mozilla/5.0 (compatible; 
> Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" and I 
> don't see anything in my 'browsers' report that suggests it is a 
> yahoo search engine.
> 
> Thanks,
> 
> Brett
> B)
> 
> 
> > ----- Original Message -----
> > From: "Andrew Scott" <[EMAIL PROTECTED]>
> > "Andrew Scott" <[EMAIL PROTECTED]>
> 
> > Sent: Fri, 15 Jul 2005 11:11:47 +1000
> > Subject: [cfaussie] RE: Search Engines
> >
> >
> > Brett,
> > 
> > Thought I would let you know that yahoo search engines slip 
> through. After
> > implementing your little snippet it actually captures about 45% 
of 
> search
> > engines.
> > 
> > 
> > Regards
> > Andrew Scott
> > Analyst Programmer
> > 
> > CMS Transport Systems
> > Level 2/33 Bank Street
> > South Melbourne, Victoria, 3205
> > 
> > Phone: 03 9699 7988  -  Fax: 03 9699 7976
> > -----Original Message-----
> > From: [EMAIL PROTECTED]
> > [mailto:[EMAIL PROTECTED] On Behalf Of 
> Brett
> > Payne-Rhodes
> > Sent: Wednesday, 13 July 2005 1:16 PM
> > To: CFAussie Mailing List
> > Subject: [cfaussie] RE: Search Engines
> > 
> > I usually monitor the browser reporting to see what bots might be 
> slipping
> > through, but I haven't checked for a while and in looking you may 
> like to
> > add "spider" to that list. There are also a lot of hits from 
> > 
> > "Mozilla/2.0 (compatible; Ask Jeeves/Teoma;
> > +http://sp.ask.com/docs/about/tech_crawling.html)"
> > 
> > so maybe change "crawler" to simply "crawl".
> > 
> > The short answer is that it is good enough for what I need. And 
in 
> looking
> > at the browser and bot reports it is catching at least 98%.
> > 
> > B)
> > 
> > 
> > 
> > 
> > 
> > ---
> > You are currently subscribed to cfaussie as: [EMAIL PROTECTED]
> > To unsubscribe send a blank email to 
> [EMAIL PROTECTED]
> > Aussie Macromedia Developers: http://lists.daemon.com.au/
> 
> ---
> You are currently subscribed to cfaussie as: 
[EMAIL PROTECTED]
> To unsubscribe send a blank email to
> [EMAIL PROTECTED]
> Aussie Macromedia Developers: http://lists.daemon.com.au/
> 
> 
> 
> 
> ---
> You are currently subscribed to cfaussie as: [EMAIL PROTECTED]
> To unsubscribe send a blank email to 
[EMAIL PROTECTED]
> Aussie Macromedia Developers: http://lists.daemon.com.au/

---
You are currently subscribed to cfaussie as: [email protected]
To unsubscribe send a blank email to [EMAIL PROTECTED]
Aussie Macromedia Developers: http://lists.daemon.com.au/

Reply via email to