At 11:57 AM 5/9/2007, you wrote:
Robots.txt file. Google it it's a spec most search engines follow but
they don't have to. There are also other techniques like writing the
page with javascript instead of having it written when served. I can go
into details depending on if that robots.txt is sufficient.
Thanks,
------------------------------------------
Ali Mesdaq
Security Researcher II
Websense Security Labs
http://www.WebsenseSecurityLabs.com
------------------------------------------
Yes this is all I need, thanks. In fact, it is a personal site and it
would be fine just to do the whole site. So if I just create a
robot.txt file with
User-agent: *
Disallow: /
in it and put it in the root directory.... will that be enough to
prevent Google and most other sites from indexing me?
