https://bugzilla.wikimedia.org/show_bug.cgi?id=58758
Web browser: ---
Bug ID: 58758
Summary: Prevent mirrors of Wikipedia from including NOINDEXED
pages
Product: Wikimedia
Version: wmf-deployment
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: Unprioritized
Component: Site requests
Assignee: [email protected]
Reporter: [email protected]
CC: [email protected],
[email protected],
[email protected], [email protected],
[email protected], [email protected]
Classification: Unclassified
Mobile Platform: ---
This may be actually impossible, but I'm filing a bug to discuss strategies for
preventing mirrors of Wikipedia from including pages we NOINDEX. A good example
of this is user pages or user talk pages, and the new Draft namespace on
English Wikipedia.
Technically speaking these pages are free content just like anything else on
Wikipedia (with the exception of fair use images, etc.). However, there are
good reasons for us to not want content to be indexed by search engines and
found by readers.
Numerous times, I've had Wikipedians bring up the valid point that mirrors
erode our ability to control search indexing, because they mirror content we
NOINDEX, but do not replicate the contents of our robots.txt.
There may practically be no way to prevent this. Even if that's the case, we
should record why that is and WONTFIX this, as a point of reference.
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l