Author: Alexander Barkov
> And to be more precise, i finally want to index only html pages and not all 
> other types of data (css/js/pictures/pdf/rss/...) .

Something like this should do the trick:

NoIndexIf NoMatch Content-Type text/html*

Additionally, try to use the Disallow command to reduce the number of URLs that 
indexer has actually to download.
See here for details:

> Fabien.

Reply: <>

General mailing list

Reply via email to