[Wikidata-tech] Wikidata JSON Dump Reader 2.0

2018-08-14 Thread Jeroen De Dauw
#jsondumpreader Cheers -- Jeroen De Dauw | https://entropywins.wtf | https://keybase.io/jeroendedauw Software Crafter | Speaker | Student | Strategist | Contributor to Wikimedia and Open Source ~=[,,_,,]:3 ___ Wikidata-tech mailing list Wikidata-tech

[Wikidata-tech] Wikidata JSON Dump Reader

2015-11-09 Thread Jeroen De Dauw
Hey all, I've created a small PHP library for reading from the JSON dumps. http://www.bn2vs.com/blog/2015/11/08/wikidata-wikibase-json-dump-reader/ https://github.com/JeroenDeDauw/JsonDumpReader Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate ~=[,,_,,]:3

Re: [Wikidata-tech] Need to support PHP 5.3?

2015-03-23 Thread Jeroen De Dauw
Hey, Has any progress been made on the mentioned blockers? Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Developer at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org

Re: [Wikidata-tech] Reconciling with Wikidata (was Freebase)

2015-01-02 Thread Jeroen De Dauw
API). Given the size of entities, I'm not sure this is what you'd want though. Can you provide more details on how you want to specify for which entities you want info, and what info you want to get from them? Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil

[Wikidata-tech] Usage of instanceof StatementListProvider

2014-11-09 Thread Jeroen De Dauw
probably need to do something like what I outlined here: https://lists.wikimedia.org/pipermail/wikidata-tech/2014-August/000546.html Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3

[Wikidata-tech] PHP library for the JSON dump

2014-10-22 Thread Jeroen De Dauw
Hey, I've just created two tiny PHP components for reading Wikibase JSON dumps. * https://github.com/JeroenDeDauw/JsonDumpReader * https://github.com/JeroenDeDauw/JsonDumpData Hope this is of use to others :) Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil

[Wikidata-tech] Parsing Entity IDs

2014-10-16 Thread Jeroen De Dauw
this also means that no new code that introduces such occurrences should be allowed through review, even if it contains a fix this later TODO (for new code there is no excuse to do it wrong). [0] https://gerrit.wikimedia.org/r/#/c/167136/ Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software

[Wikidata-tech] Wikibase changesAsJson

2014-10-12 Thread Jeroen De Dauw
the PHP serialization. Has such a migration happened? Can we get rid of the setting an the old PHP serialize code? Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3

Re: [Wikidata-tech] Are statements ordered?

2014-10-11 Thread Jeroen De Dauw
of statement groups in the PHP DataModel, that it'd be ordered. Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech mailing list Wikidata-tech

Re: [Wikidata-tech] alternatives to memcached for caching entity objects across projects

2014-10-02 Thread Jeroen De Dauw
a single decorator for caching, which writes to a caching interface. Then this caching interface can have an implementation what uses multiple caches, and perhaps have a decorator on that level. Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect

[Wikidata-tech] Video: running the DataModel tests

2014-09-27 Thread Jeroen De Dauw
Hey all, I've made little video demonstrating how you can get a clone of Wikibase DataModel, set it up, and run it's tests. It's only 30 seconds long, yet includes all you need to know. https://asciinema.org/a/12530 Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate

Re: [Wikidata-tech] Removing 3rd party dependencies from WikibaseQueryEngine

2014-09-04 Thread Jeroen De Dauw
Hey, I'm also curious to if WMF is indeed not running any CLI tools on the cluster which happen to use Symfony Console. Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3

[Wikidata-tech] assertTag will be deprecated

2014-08-17 Thread Jeroen De Dauw
Hey, PHPUnits assertTag function, which is used 32 times in Wikibase.git, will be deprecated in PHPUnit 4.2. https://github.com/sebastianbergmann/phpunit/issues/1292 Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany

Re: [Wikidata-tech] External Json is not so consistent

2014-06-17 Thread Jeroen De Dauw
Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo

Re: [Wikidata-tech] Constructing Entities from their serialization

2014-06-06 Thread Jeroen De Dauw
Hey, I'm moving tests away from that, though. Thanks. Any help with this is much appreciated. Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech

[Wikidata-tech] Daily

2014-04-23 Thread Jeroen De Dauw
CR and various misc things, as I did not work on WD for many hours Plans for today: survive all the evil meetings. [0] https://github.com/wmde/WikibaseDataModel/pull/62/files#diff-0 [1] https://github.com/wmde/WikibaseDataModel/blob/master/RELEASE-NOTES.md#version-074-dev Cheers -- Jeroen De

[Wikidata-tech] Diff 1.0 released

2014-04-10 Thread Jeroen De Dauw
of functionality. The primary change it brings is PSR-4 compliance. It also removes some old constructs that had been deprecated for a long time already. A detailed list of changes can be found in the release noteshttps://github.com/wmde/Diff/blob/master/RELEASE-NOTES.md . Cheers -- Jeroen De Dauw

[Wikidata-tech] Status of the new (de)serialization code

2014-03-19 Thread Jeroen De Dauw
components and an explanation of how to use them, see their README files. Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech mailing list Wikidata-tech

[Wikidata-tech] Reusable Internal serialization component

2014-03-04 Thread Jeroen De Dauw
[2] http://lists.wikimedia.org/pipermail/wikidata-tech/2013-December/000356.html Cheers -- Jeroen De Dauw - http://www.bn2vs.com Software craftsmanship advocate Evil software architect at Wikimedia Germany ~=[,,_,,]:3 ___ Wikidata-tech mailing list

Re: [Wikidata-tech] wbsetclaim

2014-02-26 Thread Jeroen De Dauw
) to spend time on. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] wbsetclaim

2014-02-26 Thread Jeroen De Dauw
. if id is not set, return an error. This is fine for me - barring naming nitpicks and whatnot. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org

Re: [Wikidata-tech] wbsetclaim

2014-02-26 Thread Jeroen De Dauw
think we can all agree on it being well worth the maintenance. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman

Re: [Wikidata-tech] Reusable serialization component

2014-02-22 Thread Jeroen De Dauw
/addwiki/wikibase-api/blob/f0403aab8c2121df25bd349fbf85e861e8d73087/src/Repos/EntityRevisionRepo.php#L36-62 Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech

[Wikidata-tech] Cleaning up Wikibase.git

2014-02-02 Thread Jeroen De Dauw
create concrete items and discuss things at later points. Sharing here so people have a rough idea of where I want this to go, and to provide them with the opportunity to start tackling something themselves already. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil

[Wikidata-tech] Adding configuration to WikibaseLib

2014-01-30 Thread Jeroen De Dauw
should not be merged. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Adding configuration to WikibaseLib

2014-01-30 Thread Jeroen De Dauw
proposal on how we could do that. Tip: you probably should not use Lib at all for this. I trust that in the meanwhile we will not continue to throw architectural principles under the buss for local convenience. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

Re: [Wikidata-tech] Programmatically check for Wikibase installation

2014-01-23 Thread Jeroen De Dauw
Yeah, see if the Wikibase_version constant is defined. Sent from my HTC one X. ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Removal of manual classmaps and PHPUnit

2014-01-21 Thread Jeroen De Dauw
/Wikibase/phpunit.xml.dist Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

[Wikidata-tech] Removal of manual classmaps and PHPUnit

2014-01-20 Thread Jeroen De Dauw
to deal with any classmap hassle. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

[Wikidata-tech] Versioning of components

2014-01-16 Thread Jeroen De Dauw
is also linked from this blog post, is the semver site: http://semver.org/ Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org

Re: [Wikidata-tech] Wikibase data exchange format

2014-01-16 Thread Jeroen De Dauw
and deserialization code for our DataModel into a Wikibase-independent component. This is in very early stages at this point and is likely not going to be done any time soon. https://github.com/wmde/WikibaseDataModelSerialization Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't

[Wikidata-tech] DataModel namespace change

2014-01-09 Thread Jeroen De Dauw
replace usage of the old FQNs with the new ones. When writing new code using DataModel classes, please make sure you are not referring to a legacy alias. If it is not in Wikibase\DataModel, it is a legacy alias. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

Re: [Wikidata-tech] Improving leaky test cases

2013-12-19 Thread Jeroen De Dauw
Hey, Branch has been reviewed merged into master. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo

Re: [Wikidata-tech] Reusable serialization component

2013-12-16 Thread Jeroen De Dauw
, though if anyone prefers that worklow, feel free to set the things up and point me to your commits once submitted for review. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 - ___ Wikidata-tech mailing list Wikidata-tech

Re: [Wikidata-tech] Reusable serialization component

2013-12-16 Thread Jeroen De Dauw
incorrect wiring up of the serializes will be found. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo

Re: [Wikidata-tech] RFC: How to Implement Entity Redirects?

2013-12-03 Thread Jeroen De Dauw
this is the case for EntityContent, though I suspect it is wrong for Entity. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https

Re: [Wikidata-tech] New name for ApiWikibase class

2013-10-21 Thread Jeroen De Dauw
in the future can be seen here: https://github.com/wikimedia/mediawiki-extensions-WikibaseQuery/blob/master/src/Wikibase/Query/Api/EntitiesByPropertyValue.php So the naming problem in question ought to not actually occur. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil

Re: [Wikidata-tech] New name for ApiWikibase class

2013-10-21 Thread Jeroen De Dauw
will not happen. Sharing code via inheritance is generally wrong, and the issue you are seeing is one of the problems it tends to cause. The solution is not to add more base classes and blow up the christmas tree of classes more, it is to not abuse inheritance in the first place. Cheers -- Jeroen De

[Wikidata-tech] The next problem with EntityId

2013-09-15 Thread Jeroen De Dauw
rebuilding code for a (few) Wikidata.org table(s). It'd be good to have this decision sooner then later, as code touching places where such assumptions are located needs to oddly hold both possible decisions into account, while both typically suggest a quit different approach. Cheers -- Jeroen De Dauw

Re: [Wikidata-tech] DataValues component naming

2013-09-07 Thread Jeroen De Dauw
(it does not contain all implementations, just the common ones), and is probably easier to understand when you've not come across it before. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing

Re: [Wikidata-tech] DataValues component naming

2013-09-06 Thread Jeroen De Dauw
off topic: as you can see there, I also requested a Wikidata git repo, which seems the most obvious name for the one in which be put a Wikidata specific build. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

Re: [Wikidata-tech] DataValues component naming

2013-09-05 Thread Jeroen De Dauw
be preferred. Still have not seen any better suggestions though. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo

Re: [Wikidata-tech] DataValues and related components reorganization

2013-08-30 Thread Jeroen De Dauw
here. Going with DataValuesImplementations for now, though hoping someone finds a better name. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https

Re: [Wikidata-tech] DataValues and related components reorganization

2013-08-30 Thread Jeroen De Dauw
though. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Improvements to the implementation of Entity

2013-08-30 Thread Jeroen De Dauw
) - Reference (16) Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Improvements to the implementation of Entity

2013-08-30 Thread Jeroen De Dauw
of WikibaseDataModel and clicking dashboard on the generated index.html page: phpunit --coverage-html /some/path [0] http://googletesting.blogspot.de/2011/02/this-code-is-crap.html Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

Re: [Wikidata-tech] EntityId changes

2013-08-24 Thread Jeroen De Dauw
of the remaining errors. If anyone has a suggestion on how to find where the 255 is coming from, that'd be even better. [0] https://gerrit.wikimedia.org/r/#/c/80506/ Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata

Re: [Wikidata-tech] EntityId changes

2013-08-23 Thread Jeroen De Dauw
with the current legacy serializations? Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] site identifiers table

2013-07-23 Thread Jeroen De Dauw
to this config? Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Tagging policies

2013-07-22 Thread Jeroen De Dauw
? Or will this cause problems of some sort? Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Tagging policies

2013-07-22 Thread Jeroen De Dauw
process that I can think of. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] DataValues components rethinking

2013-07-17 Thread Jeroen De Dauw
-- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] DataValues components rethinking

2013-07-17 Thread Jeroen De Dauw
DataValues.git can be found at https://gerrit.wikimedia.org/r/#/c/74288/ I'm going to assume it is also clear no one should go make modifications to the DataTypes code that is now temporary back there :) Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

[Wikidata-tech] Master is broken!

2013-07-12 Thread Jeroen De Dauw
Hey, Something broke Wikibase master recently. See https://gerrit.wikimedia.org/r/#/c/73439/ ( https://integration.wikimedia.org/ci/job/mwext-Wikibase-repo-tests/1986/console) Anyone an idea what caused this? Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil

[Wikidata-tech] Search plugins for Firefox and Chrome

2013-07-11 Thread Jeroen De Dauw
/addon/wikidata-search/ Chrome extension: https://chrome.google.com/webstore/detail/wikidata-search/ingjkjibhnkhomomlmlabndfmiaejkpn A more verbose version of this email: http://www.bn2vs.com/blog/2013/07/12/wikidata-search-plugins/ Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic

[Wikidata-tech] New Serialization component

2013-07-10 Thread Jeroen De Dauw
is the Ask library. It'll need to be included for deployment as soon as we deploy the WikibaseQuery extension. Or as soon as we decide to load Ask for some other reason. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3

Re: [Wikidata-tech] One component per repository

2013-07-08 Thread Jeroen De Dauw
the confusion we had last time :) Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

[Wikidata-tech] Wikibase tests now running on TravisCI

2013-06-17 Thread Jeroen De Dauw
sqlite. And 2 for each of PHP 5.3, 5.4 and 5.5. https://travis-ci.org/wikimedia/mediawiki-extensions-Wikibase/builds/8155338 Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata

Re: [Wikidata-tech] Getting the property (data) type of a PropertyValueSnak.

2013-06-17 Thread Jeroen De Dauw
. With your approach, we would take this *flexibility*. That's what I've been afraid of in the first place. flexibility probably should be something else. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech

[Wikidata-tech] TravisCI integration with Gerrit

2013-06-13 Thread Jeroen De Dauw
already have. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech

Re: [Wikidata-tech] Improving the ValueValidator interface

2013-06-11 Thread Jeroen De Dauw
is limited anyway, I thus certainly do not object to a fresh start approach either. Cheers -- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 -- ___ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https