Re: [Wikidata] Critical JSON bugs back in production; all dumps broken now

2015-08-04 Thread Markus Krötzsch
On 04.08.2015 12:33, Addshore wrote: Please see https://gerrit.wikimedia.org/r/#/c/229099/ and https://gerrit.wikimedia.org/r/#/c/229100/ for the change to master and the currently deployed branch. This will be merged and back ported today and a new dump created I'm also going to follow this up

Re: [Wikidata] Critical JSON bugs back in production; all dumps broken now

2015-08-04 Thread Addshore
Please see https://gerrit.wikimedia.org/r/#/c/229099/ and https://gerrit.wikimedia.org/r/#/c/229100/ for the change to master and the currently deployed branch. This will be merged and back ported today and a new dump created I'm also going to follow this up by writing some more integration tests

Re: [Wikidata] Critical JSON bugs back in production; all dumps broken now

2015-08-04 Thread Lydia Pintscher
On Tue, Aug 4, 2015 at 12:20 PM, Markus Krötzsch wrote: > Hi, > > The recent Wikidata JSON dumps again contain huge amounts of broken JSON > where empty maps are serialized as [] instead of using {}. Just grep for > > "claims":[] > or > "aliases":[] > or > any other key that requires a map > > to

[Wikidata] Critical JSON bugs back in production; all dumps broken now

2015-08-04 Thread Markus Krötzsch
Hi, The recent Wikidata JSON dumps again contain huge amounts of broken JSON where empty maps are serialized as [] instead of using {}. Just grep for "claims":[] or "aliases":[] or any other key that requires a map to find many examples. The scope of the problem is massive. Basically all ent