Re: [htdig] META name="robots"

1999-11-09 Thread Torsten Neuer


David Adams wrote:
> 
> I am using ht://Dig version 3.1.2 and I have been trying to prevent
> some sets of pages from being indexed by inserting in the head of
> certain index pages:
> 
> 
> 
> This only seemed to work in one case and not in others.  In the one case
> where it _did_ work I found I had written:
> 
> 
> 
> Can anyone independently confirm or deny this?  I would be happy
> to learn I am mistaken and that ht://Dig does conform to the HTML
> standard for META.

This is a known problem in Ht://Dig < 3.1.3 - upgrading to the recent
version should fix it.


hth,
  Torsten

-- 
InWise - Wirtschaftlich-Wissenschaftlicher Internet Service GmbH
Waldhofstraße 14Tel: +49-4101-403605
D-25474 EllerbekFax: +49-4101-403606
E-Mail: [EMAIL PROTECTED]Internet: http://www.inwise.de


To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.



[htdig] META name="robots"

1999-11-09 Thread David Adams


I am using ht://Dig version 3.1.2 and I have been trying to prevent
some sets of pages from being indexed by inserting in the head of
certain index pages:



This only seemed to work in one case and not in others.  In the one case
where it _did_ work I found I had written:



Can anyone independently confirm or deny this?  I would be happy
to learn I am mistaken and that ht://Dig does conform to the HTML
standard for META.

-- 
 
David J Adams
<[EMAIL PROTECTED]>
Computing Services
University of Southampton


To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.



Re: [htdig] META NAME="robots" ignored.

1999-02-22 Thread Geoff Hutchison


On Mon, 22 Feb 1999, Martin Pohl wrote:

> As far as I know, your Meta-tag is only supported by very few robots.
> Obviously not by ht://Dig. Another method would be to create a file

Baloney! This has been supported by ht://Dig since 3.1.0b1...

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.



Re: [htdig] META NAME="robots" ignored.

1999-02-22 Thread Martin Pohl


Yann Doussot wrote:

> I've just installed htdig 3.1.1 on a Linux server. Works fine
> except the META TAGS. I've added  to
> several pages, rebuilt database but these are still returned by a search.
> Ideas ? May be I missunderstand the meaning of the tag (I want links in
> the page to be followed but I don't want to index it).

As far as I know, your Meta-tag is only supported by very few robots.
Obviously not by ht://Dig. Another method would be to create a file
'robot.txt' in the root directory of the WWW server, which contains

User-agent: | "*"
[Allow: /path/[file.html] ]
Disallow: /path/[file.html] 

All lines can appear more than once. If you use the asterisk in the
first line, all robots should regard the exclusions.

Let me know, if it had worked.

Martin

-- 
_
Dr. Martin Pohl 
Institute for Orthopaedic Research and Biomechanics
Helmholtzstr. 14
89081 ULM, Germany, EU
phone: +49-(0)731-50-23494 / FAX: +49-(0)731-50-23498
WWW:http://pollux.medizin.uni-ulm.de 
e-mail: mailto:[EMAIL PROTECTED]
_

To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.



Re: [htdig] META NAME="robots" ignored.

1999-02-22 Thread Yann Doussot


On Mon, 22 Feb 1999, Geoff Hutchison wrote:

> This is incorrect syntax. Meta tags are of the form:
> 
> 

Grrr, I'm stupid. Anyway, thanks a lot it works fine now.

---
Yann Doussot <[EMAIL PROTECTED]>
Grey Interactive - France - http://www.gifrance.com/
Cell: +33 6 12 71 70 03   Work: + 33 1 46 84 85 00


To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.



Re: [htdig] META NAME="robots" ignored.

1999-02-22 Thread Geoff Hutchison


>except the META TAGS. I've added  to
>several pages, rebuilt database but these are still returned by a search.
>Ideas ? May be I missunderstand the meaning of the tag (I want links in
>the page to be followed but I don't want to index it).

This is incorrect syntax. Meta tags are of the form:



Cheers,

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/



To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.



[htdig] META NAME="robots" ignored.

1999-02-22 Thread Yann Doussot



Hello,

I've just installed htdig 3.1.1 on a Linux server. Works fine
except the META TAGS. I've added  to
several pages, rebuilt database but these are still returned by a search.
Ideas ? May be I missunderstand the meaning of the tag (I want links in
the page to be followed but I don't want to index it).

Thanks.

---
Yann Doussot <[EMAIL PROTECTED]>
Grey Interactive - France - http://www.gifrance.com/
Cell: +33 6 12 71 70 03   Work: + 33 1 46 84 85 00


To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.