That's really big. :-) 2018-03-05 13:10 GMT+01:00 Ariel Glenn WMF <[email protected]>:
> We'll probably start at 20GB, which means that WIkidata will be the only > wiki affected for now. > > Ariel > > On Mon, Mar 5, 2018 at 1:40 PM, Bináris <[email protected]> wrote: > > > Could you please translate "too large" to megabytes? > > > > 2018-03-05 12:10 GMT+01:00 Ariel Glenn WMF <[email protected]>: > > > > > Please forward wherever you think appropriate. > > > > > > For some time we have provided multiple numbered pages-articles bz2 > file > > > for large wikis, as well as a single file with all of the contents > > combined > > > into one. This is consuming enough time for Wikidata that it is no > > longer > > > sustainable. For wikis where the sizes of these files to recombine is > > "too > > > large", we will skip this recombine step. This means that downloader > > > scripts relying on this file will need to check its existence, and if > > it's > > > not there, fall back to downloading the multiple numbered files. > > > > > > I expect to get this done and deployed by the March 20th dumps run. > You > > > can follow along here: https://phabricator.wikimedia.org/T179059 > > > > > > Thanks! > > > > > > Ariel > > > _______________________________________________ > > > Wikitech-l mailing list > > > [email protected] > > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > > > > > > > > > > -- > > Bináris > > _______________________________________________ > > Wikitech-l mailing list > > [email protected] > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > _______________________________________________ > Wikitech-l mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > -- Bináris _______________________________________________ Wikitech-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikitech-l
