Re: [Wikitech-l] Important news about the November dumps run!

There are no problems that I see. We did get started a couple days late for this run due to the move to an internal server, but I see all jobs running fine. The frwiki page-articles dumps have not yet run; enwiki and wikidatawiki are in progress; eswiki, itwiki, jawiki, and zhwiki are busy

Re: [Wikitech-l] Important news about the November dumps run!

Hi, Are there problems with some dumps like frwiki with the new system ? On your.org mirror, important files like page-articles are still missing from the 20171103 dump directory, when usually it only takes a day... Nico On Mon, Nov 6, 2017 at 8:01 PM, Ariel Glenn WMF

Re: [Wikitech-l] Important news about the November dumps run!

Rsync of xml/sql dumps to the web server is now running on a rolling basis via a script, so you should see updates regularly rather than "every $random hours". There's more to be done on that front, see https://phabricator.wikimedia.org/T179857 for what's next. Ariel

Re: [Wikitech-l] Important news about the November dumps run!

The first set of dumps is running there and looks like it's working ok. I've done a manual rsync of files produced up to this point, so those are now available on the web server. As before, you can follow work on this at https://phabricator.wikimedia.org/T178893 Note that it is possible that

[Wikitech-l] Important news about the November dumps run!

As was previously announced on the xmldatadumps-l list, the sql/xml dumps generated twice a month will be written to an internal server, starting with the November run. This is in part to reduce load on the web/rsync/nfs server which has been doing this work also until now. We want separation of