> -----Original Message----- > Message: 3 > Date: Wed, 8 Sep 2010 10:24:38 +0000 > From: Nathan Eisenberg <[email protected]> > Subject: RE: yahoo crawlers hammering us > To: "[email protected]" <[email protected]> > Message-ID: > <8c26a4fdae599041a13eb499117d3c28164ac...@ex-mb- > 1.corp.atlasnetworks.us> >
> Customers don't want to deliver their content to search engines? That > seems silly. I have a private website; I don't want the site to be listed or content found via a search engine. I want to be able to give the URL out to friends etc. but I don't want all of the world hotlink or whatever - sure, I can password protect the site, but for now I have a ton of rewrite conditions in place. #m
