On Thu, May 20, 2004 at 02:23:09PM -0700, worcester wrote: > Still looking for an answer. > > > --- worcester <[EMAIL PROTECTED]> wrote: > > Has anyone else here noticed a recent HUGE HUGE HUGE > > jump in msnbot activity. In fact, I don't even > > remember seeing it before, but now it is over 90% of > > our browser traffic. > > > > Is this indicative of the recent virus activity on > > the > > internet? > > > > Thanks.
Not a virus, just microsoft releasing a beta version of their spider on the web. We had it bring a site to a crawl. It's hitting a java-based app that created a new java session every time msnbot hit it. Fortunately the resources freed themselves quickly, but having a hundred instances running was not good. I added msnbot to the robots.txt file and it stopped spidering the site within a few minutes. Once the spider is out of beta I'll remove them from robots.txt. -ken +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +------------------------------------------------------------------------
