https://bugzilla.wikimedia.org/show_bug.cgi?id=62468

--- Comment #5 from Nemo <federicol...@tiscali.it> ---
IA doesn't crawl on request.
On what "Allow" directives and other directives do or should take precedence,
please see (and reply) on
https://archive.org/post/1004436/googles-robotstxt-rules-interpreted-too-strictly-by-wayback-machine

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to