Author: mickw Date: 2006-04-06 21:09:24 +0200 (Thu, 06 Apr 2006) New Revision: 2741
Modified: trunk/src/webapp/robots.txt Log: avoid crawling our dtds directory Modified: trunk/src/webapp/robots.txt =================================================================== --- trunk/src/webapp/robots.txt 2006-04-06 19:02:29 UTC (rev 2740) +++ trunk/src/webapp/robots.txt 2006-04-06 19:09:24 UTC (rev 2741) @@ -2,3 +2,4 @@ User-agent: * Disallow: /search Disallow: /tilbakemelding +Disallow: /dtds \ No newline at end of file _______________________________________________ Kernel-commits mailing list [email protected] http://sesat.no/mailman/listinfo/kernel-commits
