RE: How to stop bots indexing my dev sites

2008-02-13 Thread Brad Wood
I'm half joking, but it would probably work... Associate .txt files with CF and make your robots.txt dynamic. :) A more plausible solution might be to protect the entire folder the dev site is in with .htaccess or something so someone out there can't just hit it with out a token login. ~Brad

RE: How to stop bots indexing my dev sites

2008-02-13 Thread Will Swain
Do you put it up in the client's webspace, under their domain? I just put all clients dev work under a single folder in my domain, and use the robots.txt file to exclude that folder. Will -Original Message- From: Rick Faircloth [mailto:[EMAIL PROTECTED] Sent: 13 February 2008 15:57

RE: How to stop bots indexing my dev sites

2008-02-13 Thread Rick Faircloth
for files, but not folders/directories. Rick -Original Message- From: Will Swain [mailto:[EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 11:59 AM To: CF-Talk Subject: RE: How to stop bots indexing my dev sites Do you put it up in the client's webspace, under their domain? I