As no objection was seen, I have removed robots.txt on our Wiki host.
Please speak out if anyone still found an problem that we should keep it.
On 2012/10/22 17:33, Rory O'Farrell said:
On Mon, 22 Oct 2012 11:29:18 +0200
Herbert Duerr h...@apache.org wrote:
On 21.10.2012 15:13, imacat wrote:
On 21.10.2012 15:13, imacat wrote:
I found the following rule in the robots.txt of our wiki:
User-Agent: *
Disallow: /
Does any know if there is any special reason why it is set so? Does
any have any reason to keep it? I'm thinking of removing this rule.
+1, blocking all search
On Mon, 22 Oct 2012 11:29:18 +0200
Herbert Duerr h...@apache.org wrote:
On 21.10.2012 15:13, imacat wrote:
I found the following rule in the robots.txt of our wiki:
User-Agent: *
Disallow: /
Does any know if there is any special reason why it is set so? Does
any have any
Dear all,
I found the following rule in the robots.txt of our wiki:
User-Agent: *
Disallow: /
Does any know if there is any special reason why it is set so? Does
any have any reason to keep it? I'm thinking of removing this rule.
This prevents legal search engines from indexing our
