| hoo added a comment. |
I played with this a bit: Converting the dump using rapper doesn't work (it tries to load the whole dump into memory before converting). I was able to convert it using serdi, though (I didn't verify the result, but it looks good at a glance).
I generated the following ntriples dumps:
-rwxrwxrwx. 1 hoch_m hoch_m 20000518472 30. Dez 03:47 wikidata-20161226-all-BETA.nt.gz -rwxrwxrwx. 1 hoch_m hoch_m 14465063185 5. Jan 14:58 wikidata-20161226-all-BETA.nt.zst
As you can see, the one compressed with zst is quite small (and can be unpacked very fast). I compressed it using
TASK DETAIL
EMAIL PREFERENCES
To: hoo
Cc: Lydia_Pintscher, thalhamm, Hydriz, Lokal_Profil, Sylvain_WMFr, ArielGlenn, Jonas, hoo, aude, daniel, -jem-, Aklapper, Smalyshev, EBjune, mschwarzer, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331
Cc: Lydia_Pintscher, thalhamm, Hydriz, Lokal_Profil, Sylvain_WMFr, ArielGlenn, Jonas, hoo, aude, daniel, -jem-, Aklapper, Smalyshev, EBjune, mschwarzer, Avner, debt, Gehel, D3r1ck01, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
