Reading the archived discussions on meta tags, I couldn't find the
answer to this question, but I
did see people saying the tags should appear on every page that differs
in any way from other pages at a site.
If I have the following on my index page, do I need to repeat it on
every page at my
Greetings from Northeast ;)
At 03:14 PM 12/13/2004 -0500, you wrote:
If I have the following on my index page, do I need to repeat it on every
page at my site? Doesn't this tag appearing once
send the robots forward to all the other pages?
meta name=robots content=index, follow /
Per se
Good afternoon;
At 01:11 PM 12/13/2004 -0800, you wrote:
I know I should read about Robots from the Robot FAQ web site. However, I am
a little pressed for time right now. What do I need to web sites to stop
Robots reading my web sites I maintain? Thank you.
If I get your question right you want
The Man With His Guide Dog At The Tent Store wrote:
I know I should read about Robots from the Robot FAQ web site. However, I am
a little pressed for time right now. What do I need to web sites to stop
Robots reading my web sites I maintain? Thank you.
in robots.txt
User-agent: *
Disallow:
AFIAK it's safe to assume that robots will index and follow by default,
so this tag may be redundant.
Read more about robots here: http://www.robotstxt.org/wc/faq.html
Terrence Wood.
On 2004-12-14 9:14 AM, Barry Cranmer wrote:
If I have the following on my index page, do I need to repeat it on
If I have the following on my index page, do I need to repeat it on
every page at my site? Doesn't this tag appearing once
send the robots forward to all the other pages?
meta name=robots content=index, follow /
A robots.txt file is a better option for controlling site-wide search
engine
If I have the following on my index page, do I need to repeat it on
every page at my site? Doesn't this tag appearing once
send the robots forward to all the other pages?
meta name=robots content=index, follow /
You don't need that at all. Index, follow is default behaviour and won't
I know I should read about Robots from the Robot FAQ web site. However, I am
a little pressed for time right now. What do I need to web sites to stop
Robots reading my web sites I maintain? Thank you.
Create a text file and name it 'robots.txt'
Paste the following code, save and upload to the root
