I'm sure googling for robots.txt will give you the answer. At least you can leave the ones that you *do* want google to index working.
On Wed, 08 Oct 2008 13:22:26 +1300 [EMAIL PROTECTED] wrote: > 66.249.71.108 - - [08/Oct/2008:12:50:49 +1300] "GET > /ben/set002/pages/IMG_4491.html HTTP/1.1" 200 1515 "-" "Mozilla/5.0 > (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" > > Google and other search engines are running through my home web server > and now using up my data cap a bit fast. > > What's the best way to make apache look at the refer(?) and send it packing? > > Cheers Don > > -- > Don Gould > 31 Acheson Ave, Mairehau, Christchurch, NZ > Ph +64 3 348 7235 or + 64 21 114 0699 > www.thinkdesignprint.co.nz -- Steve Holdoway <[EMAIL PROTECTED]>
