| Smalyshev added a comment. |
I tried compressing a dump with zstd, the result is:
-rw-r--r-- 1 smalyshev wikidev 9.0G Jan 12 02:58 wikidata.ttl.zstd
Original sizes:
-rw-rw-r-- 1 abcdefg icinga 9.0G Jan 11 00:47 /public/dumps/public/wikidatawiki/entities/20170109/wikidata-20170109-all-BETA.ttl.bz2 -rw-rw-r-- 1 abcdefg icinga 12G Jan 10 21:55 /public/dumps/public/wikidatawiki/entities/20170109/wikidata-20170109-all-BETA.ttl.gzLooks like not much advantage over bz2. Command line used was:
gunzip -c /public/dumps/public/wikidatawiki/entities/20170109/wikidata-20170109-all-BETA.ttl.gz | ./zstd -15 -o /data/scratch/wdqs/wikidata.ttl.zstd
TASK DETAIL
EMAIL PREFERENCES
To: Smalyshev
Cc: Lydia_Pintscher, thalhamm, Hydriz, Lokal_Profil, Sylvain_WMFr, ArielGlenn, Jonas, hoo, aude, daniel, -jem-, Aklapper, Smalyshev, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331
Cc: Lydia_Pintscher, thalhamm, Hydriz, Lokal_Profil, Sylvain_WMFr, ArielGlenn, Jonas, hoo, aude, daniel, -jem-, Aklapper, Smalyshev, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
