Bug ID: 62494
           Summary: Add exception in robots.txt to allow the Internet
                    Archiver to index action=raw
           Product: Wikimedia
           Version: wmf-deployment
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: Unprioritized
         Component: Site requests
       Web browser: ---
   Mobile Platform: ---

Presently, robots.txt has Disallow: /w/ Thus, the raw wikitext of pages isn't
accessible via the Internet Archive; see e.g.

This is in contrast to sites like WikiIndex, which allow it:

We should allow the Internet Archiver to index these pages so that the raw
wikitext will be available for future generations, even if the page goes away.

You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
Wikibugs-l mailing list

Reply via email to