On Wed, 26 Jan 2005 08:59:52 +1300 (NZDT) John Carter <[EMAIL PROTECTED]> wrote:
> On Tue, 25 Jan 2005, Hadley Rich wrote: > > > On Tue, 25 Jan 2005 17:19, John Carter wrote: > >> Has anyone been spidered by Google recently, if so, can you have a > >> look in your /var/log/apache/access.log to see what the google > >> spider reports its useragent as? > > > > Mozilla/5.0 (compatible; Googlebot/2.1+http://www.google.com/bot.html) > > Ooo. I _like_ that! So all those snooty sites that hide their content > behind "You need IE to view this site" are not getting googled. Yet > another reason to love Google! I'm not so sure that such silliness prevents spidering > > I had wondered why I was seeing so few of that class of idiocy of late, I > thought people had become more intelligent. > > > > > John Carter Phone : (64)(3) 358 6639 > Tait Electronics Fax : (64)(3) 359 4632 > PO Box 1645 Christchurch Email : [EMAIL PROTECTED] > New Zealand > > "The notes I handle no better than many pianists. But the pauses > between the notes - > ah, that is where the art resides!' - Artur Schnabel -- Nick Rout <[EMAIL PROTECTED]>
