Hello, during the weekend I've done cleanup and organization of dumps stored in /mnt/user-store.
What's new: All available latest dumps are currently accessible in /mnt/user-store/dumps/<wiki>-latest-<dumptype>.xml However, it is probably not the very final place of their storage. Latest versions of dumps are being (semi)automatically downloaded an unpacked. If you need .bz2, you can get it by bz2file=`readlink --canonicalize-existing /mnt/user-store/dumps/<xmldumpfile>`.bz2 where xmldumpfile is eg. foowiki-latest-pages-articles.xml All available (= latest & historical) dumps are physically stored in /mnt/user-store/dumps/store/<wiki>. If you need to download any dump which is not present in /mnt/user-store/dumps, please use /mnt/user-store/dumps/tmp directory, which is the only with write access. It will be added to the list of downloaded dumps and moved to proper place then. If you had any files stored in /mnt/user-store/dump (emijrp, hippietrail) or had some non-dump files stored in dumps directories (kudu [enwiki], la2 [svwiki], ryuch [kowiki]), you can find it now in /mnt/user-store/dumps/_to_clean - please remove it from there to your personal direcotries, thank you. Members of enwikt MMP (conrad, daveross, hippietrail) - please fix your script to not download enwiktionary dumps to /mnt/user-store, but get them from /mnt/user-store/dumps/enwiktionary-latest-pages-articles.xml or /mnt/user-store/dumps/store/enwiktionary. As said above, it is being periodically checked and downloaded, so you don't have to care about downloading. What is coming next: Fully automatical check'n'download (this will happen after we're back to Debian) Comfortable API to get different types of dumps without having to know where exactly they are stored Some system how to automatize adding of new requested wikis/dumps to autodownload batch (suggestions welcome) Final stable directory structure Anything else? Suggestions welcome... Kind regards Danny B. _______________________________________________ Toolserver-l mailing list (Toolserver-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/toolserver-l Posting guidelines for this list: https://wiki.toolserver.org/view/Mailing_list_etiquette
