hoo added a comment.

I looked at this a little bit and the problem here is that both Zend and HHVM 
use the zlib-like bzip2 functions 
(http://www.bzip.org/1.0.3/html/zlib-compat.html) which only handle a single 
bzip2 stream, but out pbzip2 compressed dumps consist of several streams 
(that's how pbzip2 manages to parallelize).

In order to fix this, both upstreams (Zend and HHVM) would need to change to 
using the "native" bz2 interface 
(http://www.bzip.org/1.0.3/html/hl-interface.html). Other hacks might be 
possible, I didn't look into that though.


TASK DETAIL
  https://phabricator.wikimedia.org/T118379

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: Addshore, daniel, hoo, Aklapper, JeroenDeDauw, StudiesWorld, Wikidata-bugs, 
aude, Mbch331



_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to