Phil Payne wrote:
IBM already has search technology which it uses internally - you never see a 
hit from an IBM
machine other than the Almaden spider.  It's a very polite little IBM bot - it 
even obeys
robots.txt:

66.147.154.3 - - [03/Apr/2006:01:39:13 +0100] "GET /robots.txt HTTP/1.0" 200 1911 
"-"
"http://www.almaden.ibm.com/cs/crawler   [fc14]"


Hmmm. I get page not found on that.

Kind regards,

-Steve Comstock

----------------------------------------------------------------------
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO
Search the archives at http://bama.ua.edu/archives/ibm-main.html

Reply via email to