According to Jure ZAKRAJSEK:
> > For that, you should look into the suggestions in the "new ask" thread
> > from this past September, at
> > http://www.htdig.org/mail/2000/09/index.html#111
> Thx for the advice!
> I have try this
> <META NAME="robots" CONTENT="noindex,follow">
> I have added the above line to the header.html
> But it still get such results
> Index of /ado_slo/obrazci
> ... -Mar-2000 14:27 4k [DIR] brno/ 13-Apr-2000 18:26 - [TXT]
> brno_karte.html 16-Mar-2000 14:27 2k [TXT] deep-sky.html 21-May-2000 19:50
> 4k [TXT] dvojne_zvezde.html 21-May-2000 19:50 4k [DIR] gif/ 16-Feb-2000
> 10:54 - [TXT] index_meteorji.html 27-Dec-2000 22:00 2k [TXT]
> index_saturn.html 27-Dec-2000 21:59 ...
> http://www.orion-drustvo.si/ado_slo/obrazci/?D=A , 9818 bytes
> And it lists the directory perfectly! :-((
OK, let's just make sure these points are clear...
1) The meta robots tag will not prevent Apache from listing the directory,
but should prevent htdig from indexing it. htdig will follow links in
the directory, but not index the text generated by Apache.
2) You're not confusing the Apache directory header with htsearch's
header.html file, are you? These are two very distinct files, and one
has absolutely no bearing on the other.
3) You must add the HeaderName and IndexOptions directives to your
.htaccess file, as Torsten pointed out. E.g.:
HeaderName .htrobots
IndexOptions FancyIndexing SuppressHTMLPreamble
if .htrobots is the name of your header file. If you called your
Apache directory header file "header.html", then use that name instead
of .htrobots in the example above.
You can test your changes by pointing your web browser to the directory
in question, and doing a "View -> Source", or whatever your browser
requires to show you the HTML source of the page you're viewing. If the
meta robots tag doesn't show up, you didn't set things up correctly.
--
Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]>
Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil
Dept. Physiology, U. of Manitoba Phone: (204)789-3766
Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
