bennofs added a comment.
So I tried lbzip2, here's the result (on a VM sever with 2 cores, 2.1GHz, the
decompression is CPU bound):
$ time lbzip2 -n2 -v -d -c wikidata-20190506-all.json.bz2 | cat > /dev/null
lbzip2: decompressing "wikidata-20190506-all.json.bz2" to stdout
lbzip2: "wikidata-20190506-all.json.bz2": compression ratio is 1:20.790,
space savings is 95.19%
real 228m12.850s
user 444m36.440s
sys 10m48.860s
I will rerun the same test with zstd on the same machine.
TASK DETAIL
https://phabricator.wikimedia.org/T222985
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bennofs
Cc: ArielGlenn, Liuxinyu970226, bennofs, darthmon_wmde, alaa_wmde, Nandana,
Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, _jensen,
rosalieper, gnosygnu, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
