| ArielGlenn added a comment. |
ariel@snapshot1008:/mnt/dumpsdata/otherdumps/wikibase/wikidatawiki/20181015$ date; zcat wikidata-20181015-all-BETA.ttl.gz | lbzip2 -n 4 > /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2; date Wed Oct 17 12:11:32 UTC 2018 Wed Oct 17 13:25:23 UTC 2018 ariel@snapshot1008:/mnt/dumpsdata/otherdumps/wikibase/wikidatawiki/20181015$ ls -lh wikidata-20181015-all-BETA.ttl.gz /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2 -rw-rw-r-- 1 ariel wikidev 37G Oct 17 13:25 /mnt/dumpsdata/temp/ariel/wikidata-20181015-all-BETA.ttl.bz2 -rw-r--r-- 1 dumpsgen dumpsgen 44G Oct 16 15:05 wikidata-20181015-all-BETA.ttl.gz
That was run on the same host and same filesystem while other parts of the wikidataweeklies are currently running, so the estimate of 75 minutes for compression of 44GB to 37GB is likely pretty good.
TASK DETAIL
EMAIL PREFERENCES
To: ArielGlenn
Cc: hoo, Smalyshev, ArielGlenn, Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, gnosygnu, Wikidata-bugs, aude, Mbch331
Cc: hoo, Smalyshev, ArielGlenn, Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, gnosygnu, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
