ArielGlenn added a comment.

ariel@snapshot1008:/mnt/dumpsdata/otherdumps/wikibase/wikidatawiki/20181015$ date; zcat wikidata-20181015-all-BETA.ttl.gz | lbzip2 -n 4 > /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2; date 
Wed Oct 17 12:11:32 UTC 2018
Wed Oct 17 13:25:23 UTC 2018
ariel@snapshot1008:/mnt/dumpsdata/otherdumps/wikibase/wikidatawiki/20181015$ ls -lh wikidata-20181015-all-BETA.ttl.gz /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2
-rw-rw-r-- 1 ariel    wikidev  37G Oct 17 13:25 /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2
-rw-r--r-- 1 dumpsgen dumpsgen 44G Oct 16 15:05 wikidata-20181015-all-BETA.ttl.gz

That was run on the same host and same filesystem while other parts of the wikidataweeklies are currently running, so the estimate of 75 minutes for compression of 44GB to 37GB is likely pretty good.


TASK DETAIL
https://phabricator.wikimedia.org/T206535

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: hoo, Smalyshev, ArielGlenn, Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, gnosygnu, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to