ArielGlenn added a comment.
Old revisions are re-read from previous dumps. But even that takes plenty of time to decompress the old file, and recompress the already existing content so that it can be written out to the new file. Dumps are done by page, so the likelihood of a batch of pages having no new revisions is pretty small for our batch size. And having people download tens of thousands of files so that our batch sizes are small enough to get lucky here and there, is pretty unsavory as a solution. TASK DETAIL https://phabricator.wikimedia.org/T221504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: ArielGlenn Cc: Addshore, Smalyshev, Gehel, Mahir256, ArielGlenn, E.S.A-Sheild, darthmon_wmde, alaa_wmde, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, gnosygnu, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
