Webboard: indexer inserts unwanted url into database

2001-03-01 Thread Alexander Barkov
Author: Alexander Barkov Email: [EMAIL PROTECTED] Message: Use either robots.txt file or allow/disallow commands. > I don't want to index full server,only some directories ,so i am giving commands >like: > > Server http://www.raaga.ch/de/dienst/ > Server http://www.raaga.ch/de/kontakt/ > Serv

Webboard: indexer inserts unwanted url into database

2001-03-01 Thread john
Author: john Email: [EMAIL PROTECTED] Message: I don't want to index full server,only some directories ,so i am giving commands like: Server http://www.raaga.ch/de/dienst/ Server http://www.raaga.ch/de/kontakt/ Server http://www.raaga.ch/de/ueberuns/ inside these directories i have other dire