[Wikidata-bugs] [Maniphest] [Commented On] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381371 had a related patch set uploaded (by Aude; owner: Aude):
[operations/mediawiki-config@master] Stop using $wgWikibaseSharedCacheKeyPrefix from Wikidata build

https://gerrit.wikimedia.org/r/381371TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176515: More flexible user experience for monitoring Wikidata changes from client, using new filters

2017-09-28 Thread eranroz 
eranroz added a comment.

In T176515#3634546, @Mattflaschen-WMF wrote:
Perhaps this could be implemented by adding more rc_source possibilities (e.g. 'wb.description', 'wb.sitelinks').  However, this may have implications for T171027: "2062 Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis.

We would need backwards compatibility, but the recentchanges table only lasts 30 days (configurable) anyway, so this is very temporary.


I think one edit in Wikidata can change both description, label and sitelink (at least the API expose edit entity), so assuming it is one to many connection, I would stick to  tag_summary.TASK DETAILhttps://phabricator.wikimedia.org/T176515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranrozCc: hoo, Trizek-WMF, Lea_Lacroix_WMDE, Elitre, RP88, Catrope, SBisson, Mattflaschen-WMF, Aklapper, eranroz, GoranSMilovanovic, QZanden, Iniquity, jmatazzoni, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T113468: [Task] Use compact representation of diffs in EntityChange.

2017-09-28 Thread hoo 
hoo added a comment.

In T113468#3643791, @daniel wrote:
The proposed structure looks good to me. Documentation should make clear that the fields in the structure correspond to usage aspects, and are thus independent of Entity structure.


They aren't equivalent to client usage aspects (they can contain more information, also EntityUsage::TITLE_USAGE is not wiki agnostic), but it should be easy to lay out the relationship.

Note that we have to make sure that we have enough information on the client side to not only determine affected pages, but to also generate the appropriate edit summary (yes, in some cases, we look at the diff to generate a summary on the client side).

This currently only uses ItemChange::getSiteLinkDiff (passed to SiteLinkCommentCreator::getEditComment). I'll probably see what is needed to create this diff from the new structure instead of trying to invent something new.
Depending on their size it might just be ok to use the actual sitelink Diff objects indexed by site id instead of coming up with our own structure, I'll check that.

Also note that the client will currently re-calculate the diff when coalescing consecutive changes. With the new structure, it should be a lot easier to simply merge the diffs. That should be a significant performance gain for the case of coalesced changes. Not sure how much impact that has overall.

This currently loads the full revisions on the client… I'll see what data is needed to do this w/o loading, but this is probably for another time.

It's not clear to me why both representations of the diff should be present in the object if we only include one in the serialization. How would that even work with deserialization? The deserialized version would then have only one diff representation anyway. It seems to me we want to only include the kind of diff that we later want to actually use. Am I missing something?

This was meant for the migration period only, after that is done, only the aspect/ flat diff should be included.TASK DETAILhttps://phabricator.wikimedia.org/T113468EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, hoo, gerritbot, aude, Aklapper, daniel, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T177005: Allow MediaInfo pages to be accessed via associated file name

2017-09-28 Thread MarkTraceur 
MarkTraceur removed MarkTraceur as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T177005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aklapper, Ramsey-WMF, MBinder_WMF, Cparle, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T177005: Allow MediaInfo pages to be accessed via associated file name

2017-09-28 Thread MarkTraceur 
MarkTraceur created subtask T177023: Add a page_props entry to new file pages linking to the associated MediaInfo entity.
TASK DETAILhttps://phabricator.wikimedia.org/T177005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aklapper, Ramsey-WMF, MBinder_WMF, Cparle, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177023: Add a page_props entry to new file pages linking to the associated MediaInfo entity

2017-09-28 Thread MarkTraceur 
MarkTraceur created this task.MarkTraceur added projects: Wikidata, Structured-Data-Commons, Multimedia-Team-Working-Board, Multimedia.
TASK DESCRIPTIONWhen a new file is uploaded, in order to make it clearer in the page info where the media metadata is stored, add an entry to page_props, similar to wikibase_item for current Wikibase clients (like Wikipedia), that points to the MediaInfo page. Something like mediainfo_item = M13, though I'm open to suggestions on what we want to call it.TASK DETAILhttps://phabricator.wikimedia.org/T177023EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T177005: Allow MediaInfo pages to be accessed via associated file name

2017-09-28 Thread MarkTraceur 
MarkTraceur created subtask T177022: Add an API module for querying MediaInfo entities by file page title.
TASK DETAILhttps://phabricator.wikimedia.org/T177005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aklapper, Ramsey-WMF, MBinder_WMF, Cparle, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177022: Add an API module for querying MediaInfo entities by file page title

2017-09-28 Thread MarkTraceur 
MarkTraceur created this task.MarkTraceur added projects: Wikidata, Structured-Data-Commons, Multimedia-Team-Working-Board, Multimedia.
TASK DESCRIPTIONThis should be a new API module, since the existing systems for getting Wikibase entities won't be sufficient, and there are specialized needs for this particular type of entity. However, it should basically be wbgetentities except with only titles instead of the current ids|site system.

Rough draft of an example API query:

action="">TASK DETAILhttps://phabricator.wikimedia.org/T177022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177005: Allow MediaInfo pages to be accessed via associated file name

2017-09-28 Thread MarkTraceur 
MarkTraceur added a comment.
OK, just going to write down some notes about what I've found out so far...

First, we decided that the key accomplishments here would be the following:


An entry in the file page's page_props that corresponds to the mediainfo page (accessible via action="" similar to wikibase_item)
An API module that allows for getting a mediainfo entity via the file page title (e.g. action="" with all other params of wbgetentities, essentially just an alias other than the ID lookup)


I have discovered several interesting things that I will document here, mostly for my own edification:


The MediaInfo id string (M13, for example) is just the ID of the file page in the MediaWiki database (and, therefore, the normal MW API results), so it would be relatively easy to use that as a temporary implementation if anyone wanted to start writing bots. This is not useful for internal code, because there are abstraction functions we should use to avoid problems later.
I thought I might be able to use action="" but it turns out the sites= param is looking at the interwiki map, so there won't be any way to get at MediaInfo entities on the same site. Oh, well.
I haven't yet determined at which point I should create a page_props entry for each file...creating them on file upload would be easiest, but would mean running a real mean maintenance script upon first deployment. That could be okay. I suppose that's what we'll do.
Furthermore, I am skeptical of skipping the database entry and relying on on-demand data for each API call. There wouldn't be a huge performance hit, but it seems wrong to represent something as being true via the API that isn't true in the database.
Some of the above should probably be further split into different tasks. I will do that now and claim the API task.
TASK DETAILhttps://phabricator.wikimedia.org/T177005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aklapper, Ramsey-WMF, MBinder_WMF, Cparle, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T176012: Complete outstanding work on MediaInfo Wikibase extension

2017-09-28 Thread MarkTraceur 
MarkTraceur removed MarkTraceur as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T176012EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: MarkTraceur, Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T176012: Complete outstanding work on MediaInfo Wikibase extension

2017-09-28 Thread MarkTraceur 
MarkTraceur created subtask T177005: Allow MediaInfo pages to be accessed via associated file name.
TASK DETAILhttps://phabricator.wikimedia.org/T176012EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177005: Allow MediaInfo pages to be accessed via associated file name

2017-09-28 Thread MarkTraceur 
MarkTraceur created this task.MarkTraceur added projects: Wikidata, Structured-Data-Commons, Multimedia-Team-Working-Board, Multimedia.
TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T177005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aklapper, Ramsey-WMF, MBinder_WMF, Cparle, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151608: Missing parameter 'badge' of api.php?action=querylist=querypage=PagesWithBadges

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381283 had a related patch set uploaded (by Matěj Suchánek; owner: Matěj Suchánek):
[mediawiki/extensions/Wikibase@master] Add PagesWithBadges special page to $wgAPIUselessQueryPages

https://gerrit.wikimedia.org/r/381283TASK DETAILhttps://phabricator.wikimedia.org/T151608EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Anomie, Cwek, Aklapper, GoranSMilovanovic, QZanden, Sethakill, dg711, Izno, Wikidata-bugs, aude, jayvdb, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151608: Missing parameter 'badge' of api.php?action=querylist=querypage=PagesWithBadges

2017-09-28 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T151608EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Anomie, Cwek, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Sethakill, Lewizho99, Maathavan, dg711, Izno, Wikidata-bugs, aude, jayvdb, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T151608: Missing parameter 'badge' of api.php?action=querylist=querypage=PagesWithBadges

2017-09-28 Thread matej_suchanek 
matej_suchanek claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T151608EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: gerritbot, Anomie, Cwek, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Sethakill, Lewizho99, Maathavan, dg711, Izno, Wikidata-bugs, aude, jayvdb, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176192: WDQS clone keeps freezing up on GC

2017-09-28 Thread Yurik 
Yurik added a comment.
I saw the issue again, and filed a bug with the stacktraces - https://jira.blazegraph.com/browse/BLZG-9058

Seems like there is a lock contention of sorts.TASK DETAILhttps://phabricator.wikimedia.org/T176192EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Yurik, Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T167432: Run Wikibase daily browser tests on Jenkins

2017-09-28 Thread zeljkofilipin 
zeljkofilipin added a comment.
I have recreated selenium-Wikibase-T167432 job following instuctions from T167432#3477666 and T167432#3478230.

The main change is that instead of running on BrowserTests slaves, the job now runs on DebianJessie && contintLabsSlave.

It fails with

unknown error: Chrome failed to start: exited abnormally
(Driver info: chromedriver=2.27 (undefined),platform=Linux 4.9.0-0.bpo.3-amd64 x86_64) (Selenium::WebDriver::Error::UnknownError)TASK DETAILhttps://phabricator.wikimedia.org/T167432EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zeljkofilipinCc: gerritbot, PokestarFan, Tobi_WMDE_SW, Jonas, thiemowmde, WMDE-leszek, zeljkofilipin, hashar, Aleksey_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, thcipriani, Wikidata-bugs, aude, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T167432: Run Wikibase daily browser tests on Jenkins

2017-09-28 Thread zeljkofilipin 
zeljkofilipin added a comment.
This is what we have at the moment (from Selenium/Ruby/Selenium_Jenkins_job):

F9877418: Selenium_Jenkins_job.png

Sauce Labs proved not to be robust enough.

Alternatives are to run everything on a Jenkins slave (from Selenium/Ruby/mwext-mw-selenium_Jenkins_job):

F9877478: Mwext-mw-selenium_Jenkins_job.png

or to run Selenium and browser on a Jenkins slave, targeting Beta cluster (from Selenium/Ruby/Target_beta_cluster):

F9877496: Target_beta_cluster.pngTASK DETAILhttps://phabricator.wikimedia.org/T167432EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zeljkofilipinCc: gerritbot, PokestarFan, Tobi_WMDE_SW, Jonas, thiemowmde, WMDE-leszek, zeljkofilipin, hashar, Aleksey_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, thcipriani, Wikidata-bugs, aude, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T176844: Look into truthy nt dump performance

2017-09-28 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T176844EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T167759: Reference hash is not stable

2017-09-28 Thread thiemowmde 
thiemowmde added a comment.
I agree this would be cool, and I was thinking about this multiple times. I was not able to come up with something obvious. I mean, it's quite trivial to say "the hash of a StringValue is just the SHA1 of the string". But how would you document this for every slightly more complex data structure? Where would this documentation live, if not in the code?

I think consistency is key. For example we could say that the hash is always the SHA1 of the JSON representation of the data structure in question. We need to specify a few additional details, like spacing and indention of the JSON (because this influences the string representation and the calculated SHA1), and most importantly the order of attributes, as well as the presence or absence of optional attributes.

Oh dear. Even this approach is not that obvious, and not that easy to reproduce in an other language. What if we add a new attribute? This must change existing hashes, even if the value does not change. How to deal with that? How to ever update external hash calculation algorithms? What if one user tries to calculate a hash based on a JSON encoding that adds spaces in "key": "value", and an other one that doesn't?

What's your suggestion?TASK DETAILhttps://phabricator.wikimedia.org/T167759EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: thiemowmde, daniel, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T113468: [Task] Use compact representation of diffs in EntityChange.

2017-09-28 Thread daniel 
daniel added a comment.
The proposed structure looks good to me. Documentation should make clear that the fields in the structure correspond to usage aspects, and are thus independent of Entity structure.

Note that we have to make sure that we have enough information on the client side to not only determine affected pages, but to also generate the appropriate edit summary (yes, in some cases, we look at the diff to generate a summary on the client side).

Also note that the client will currently re-calculate the diff when coalescing consecutive changes. With the new structure, it should be a lot easier to simply merge the diffs. That should be a significant performance gain for the case of coalesced changes. Not sure how much impact that has overall.

It's not clear to me why both representations of the diff should be present in the object if we only include one in the serialization. How would that even work with deserialization? The deserialized version would then have only one diff representation anyway. It seems to me we want to only include the kind of diff that we later want to actually use. Am I missing something?TASK DETAILhttps://phabricator.wikimedia.org/T113468EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: PokestarFan, hoo, gerritbot, aude, Aklapper, daniel, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-28 Thread Smalyshev 
Smalyshev added a comment.
No I don't think 3G is nearly enough. We had 8G and I had to bump it because some queries killed the server. Also, in my experience, one of the failure modes specifically on low memory is not clean OOME but rather progressive performance degradation where the memory does not technically get to 0 but management starts taking more time and the server is essentially stuck and unable to serve the regular load.

I am not sure why having more memory leads to longer GC btw - if that memory is unallocated, what GC is doing with it? What the time is spent on?TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-28 Thread ReleaseTaggerBot 
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-03 (1.31.0-wmf.2)).
TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Izno, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T112893: [Task] Investigate how and where data model objects are instanciated in our code base

2017-09-28 Thread thiemowmde 
thiemowmde closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T112893EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Tobi_WMDE_SW, daniel, Lydia_Pintscher, Aklapper, JanZerebecki, aude, Bene, JeroenDeDauw, thiemowmde, Jonas, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T54843: Improve display of API error messages in the UI

2017-09-28 Thread thiemowmde 
thiemowmde added a comment.
The comments T54843#540706 by @Lydia_Pintscher as well as T54843#2515169 by myself list acceptance criteria, which are all met by now. Therefor I'm going to close this ticket as resolved.

This does not mark the end of possible improvements for the "display of API error messages in the UI". For example, we want to make error messages addressable and pop up at the exact field/widget in the UI where the error happened. But this is for an other ticket, see T138748: [Solution] Value checking and saving: Error messages, no silent fails.TASK DETAILhttps://phabricator.wikimedia.org/T54843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Charlie_WMDE, Jan_Dittrich, Jonas, Wikidata-bugs, thiemowmde, adrianheine, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, Zoranzoki21, Izno, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381140 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Add EntityUsage::DESCRIPTION_USAGE for descriptions

https://gerrit.wikimedia.org/r/381140TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Izno, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")

2017-09-28 Thread thiemowmde 
thiemowmde removed a project: Patch-For-Review.thiemowmde moved this task from Review to Doing on the Wikidata-Sprint board.
TASK DETAILhttps://phabricator.wikimedia.org/T106287WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, thiemowmdeCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Izno, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T54843: Improve display of API error messages in the UI

2017-09-28 Thread thiemowmde 
thiemowmde closed this task as "Resolved".thiemowmde claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T54843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Charlie_WMDE, Jan_Dittrich, Jonas, Wikidata-bugs, thiemowmde, adrianheine, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, Zoranzoki21, Izno, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T112550: [RFC] How to represent derived values in the data model, and allow for deferred deserialization

2017-09-28 Thread thiemowmde 
thiemowmde closed subtask T112893: [Task] Investigate how and where data model objects are instanciated in our code base as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T112550EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, thiemowmdeCc: adrianheine, hoo, Tobi_WMDE_SW, Jonas, thiemowmde, JeroenDeDauw, Bene, aude, JanZerebecki, Aklapper, Lydia_Pintscher, daniel, GoranSMilovanovic, QZanden, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176844: Look into truthy nt dump performance

2017-09-28 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-09-28T15:22:48Z]  Ran scap pull on mwdebug1001 after experiments with T176844TASK DETAILhttps://phabricator.wikimedia.org/T176844EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, gerritbot, Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Assigned] T176844: Look into truthy nt dump performance

2017-09-28 Thread thiemowmde 
thiemowmde added a project: Wikidata-Sprint.thiemowmde assigned this task to hoo.thiemowmde moved this task from incoming to in current sprint on the Wikidata board.
TASK DETAILhttps://phabricator.wikimedia.org/T176844WORKBOARDhttps://phabricator.wikimedia.org/project/board/71/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, thiemowmdeCc: thiemowmde, Stashbot, gerritbot, Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T174028: Finalize database schema for MCR content meta-data

2017-09-28 Thread daniel 
daniel renamed this task from "Finalize DB schema for content meta-data " to "Finalize database schema for MCR content meta-data ".
TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: cicalese, Abit, brion, Anomie, jcrespo, gerritbot, Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, Lewizho99, Maathavan, Susannaanas, Izno, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread Sjoerddebruin 
Sjoerddebruin added a comment.
And the graph is indeed interesting: I saw that scientific articles were listed as a event for some reason, so fixed the family tree.TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, SjoerddebruinCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T164742: [Story] Add Form to list of Forms (persistent)

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 376704 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Add form API module

https://gerrit.wikimedia.org/r/376704TASK DETAILhttps://phabricator.wikimedia.org/T164742EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lydia_Pintscher, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 376838 had a related patch set uploaded (by Thiemo Mättig (WMDE); owner: Thiemo Mättig (WMDE)):
[mediawiki/extensions/Wikibase@master] [WIP] Add a mw.wikibase.getAllStatements Lua function

https://gerrit.wikimedia.org/r/376838TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T138312: [Usability] restricted value input for items fails silently

2017-09-28 Thread thiemowmde 
thiemowmde closed this task as "Resolved".thiemowmde claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T138312EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Lydia_Pintscher, Charlie_WMDE, thiemowmde, Jonas, Aklapper, Zppix, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T170531: Semantics: Make recognized property and value look different than unrecognized input

2017-09-28 Thread thiemowmde 
thiemowmde added a parent task: T138312: [Usability] restricted value input for items fails silently.
TASK DETAILhttps://phabricator.wikimedia.org/T170531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, thiemowmdeCc: abian, gerritbot, Sjoerddebruin, Jonas, PokestarFan, James_Budday, Charlie_WMDE, thiemowmde, Lydia_Pintscher, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T138312: [Usability] restricted value input for items fails silently

2017-09-28 Thread thiemowmde 
thiemowmde added a comment.
@Jan_Dittrich, I believe this is mostly solved with the addition of the "No match was found" message as well as T170531: Semantics: Make recognized property and value look different than unrecognized input. Feel free to reopen if you disagree.TASK DETAILhttps://phabricator.wikimedia.org/T138312EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Lydia_Pintscher, Charlie_WMDE, thiemowmde, Jonas, Aklapper, Zppix, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T138312: [Usability] restricted value input for items fails silently

2017-09-28 Thread thiemowmde 
thiemowmde added a subtask: T170531: Semantics: Make recognized property and value look different than unrecognized input.
TASK DETAILhttps://phabricator.wikimedia.org/T138312EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Lydia_Pintscher, Charlie_WMDE, thiemowmde, Jonas, Aklapper, Zppix, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T153858: Atomization and matching messages send back to clients

2017-09-28 Thread thiemowmde 
thiemowmde triaged this task as "Normal" priority.thiemowmde moved this task from incoming to needs discussion or investigation on the Wikidata board.thiemowmde added subscribers: Lydia_Pintscher, Aleksey_WMDE, WMDE-leszek.thiemowmde added projects: MediaWiki-extensions-WikibaseRepository, Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T153858WORKBOARDhttps://phabricator.wikimedia.org/project/board/71/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: WMDE-leszek, Aleksey_WMDE, Lydia_Pintscher, daniel, Jonas, thiemowmde, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176844: Look into truthy nt dump performance

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381229 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[purtle@master] Skip simple strings in N3Quoter::escapeLiteral

https://gerrit.wikimedia.org/r/381229TASK DETAILhttps://phabricator.wikimedia.org/T176844EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176839: Module:Time calculates wrongly ages (huWiki problem)

2017-09-28 Thread matej_suchanek 
matej_suchanek added a comment.
You can try this piece of code (p.yearDifference).TASK DETAILhttps://phabricator.wikimedia.org/T176839EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, Bencemac, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-09-28 Thread matej_suchanek 
matej_suchanek updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONThe work done phab:T172905 resulted in the availability of the mw.wikibase.getBestStatements function that helps makes tracking Wikidata more efficient. At rowiki, this has helped us drastically reduce the tracking of entire entities and made queries more efficientOne example is our [[ https://ro.wikipedia.org/wiki/Modul:HistoricalCountries | HistoricalCountries ]] module which lists all the countries in which a city (or anything for that matter) was throughout history. In this case, P17`P17` (country) for the entity will have one 'preferred' statement (with the current country), as well as more 'normal' statements, with `P580` and `P582` qualifiers for the historic ones. We also do a lot more magic with these 'normal' statements hidden beneath one or more 'preferred' ones: we extract the country and official name of a town for a specific date in time - for instance, to show that when [[ https://ro.wikipedia.org/wiki/Max_Born | Max Born ]] was born (pun not intended) in 1882, he was born in Breslau, German Empire, not Wrocław, Poland (as it is today). We do similar stuff with flags for countries that changed their flag throughout their existence.

So, we still have a lot of code that loads an entire entity just to cycle through the claims associated with only one property, and the usage tracking of these entities could be helped a lot by something similar to `mw.wikibase.getBestStatements`, only with the 'best' part left out.TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, matej_suchanekCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T70567: Make EntityView UI aware of redirects

2017-09-28 Thread Lydia_Pintscher 
Lydia_Pintscher added a comment.
Button to resolve the redirect: only as a gadget
Allowing linking to redirects: No there should be no reason to do thatTASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanek, Lydia_PintscherCc: matej_suchanek, gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T70567: Make EntityView UI aware of redirects

2017-09-28 Thread matej_suchanek 
matej_suchanek added a comment.

In T70567#3642537, @thiemowmde wrote:
@matej_suchanek, feel free to jump in and tell us what you think. :-)


Ok, gladly.

We may also want a "resolve redirect" button, though the implementation of that button would have to be quite different for the main snak, qualifiers, and references.

Something for #wikidata-gadgets maybe?

We also need to decide whether the entity selector should allow redirects to be entered, and if yes, how they could be marked in the autocompletion list.

On Wikipedia, you may want to link to a redirect when it's a placeholder for topic that is close to the linked one. However, redirects on Wikidata are created when the topics are same (. So the only reason for linking to a redirect is that it's incorrect and should be undone.TASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia

2017-09-28 Thread IKhitron 
IKhitron added a comment.

In T174794#3643025, @matej_suchanek wrote:
I think #notifications (Echo) preferences are not relevant here. What about "Email me when a page or a file on my watchlist is changed" and "Email me also for minor edits of pages and files"?


Of cource, both.TASK DETAILhttps://phabricator.wikimedia.org/T174794EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, IKhitronCc: jeremyb, Noella94, IKhitron, matej_suchanek, Aklapper, Lydia_Pintscher, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia

2017-09-28 Thread matej_suchanek 
matej_suchanek added a comment.
I think #notifications (Echo) preferences are not relevant here. What about "Email me when a page or a file on my watchlist is changed" and "Email me also for minor edits of pages and files"?TASK DETAILhttps://phabricator.wikimedia.org/T174794EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, matej_suchanekCc: jeremyb, Noella94, IKhitron, matej_suchanek, Aklapper, Lydia_Pintscher, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T168300: UI for editing a Lexeme's lexical category

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381000 had a related patch set uploaded (by Jakob; owner: Jakob):
[mediawiki/extensions/WikibaseLexeme@master] [WIP] Make lexeme language and lexical category editable.

https://gerrit.wikimedia.org/r/381000TASK DETAILhttps://phabricator.wikimedia.org/T168300EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jakob_WMDE, WMDE-leszek, Jan_Dittrich, Aklapper, daniel, Cinemantique, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T168300: UI for editing a Lexeme's lexical category

2017-09-28 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T168300EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jakob_WMDE, WMDE-leszek, Jan_Dittrich, Aklapper, daniel, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, JGirault, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T176844: Look into truthy nt dump performance

2017-09-28 Thread hoo 
hoo added a comment.
Profile: P6055TASK DETAILhttps://phabricator.wikimedia.org/T176844EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T70567: Make EntityView UI aware of redirects

2017-09-28 Thread thiemowmde 
thiemowmde added a comment.
I'm afraid the acceptance criteria of this ticket are not clear. @daniel mentioned so many things in the task description. To me this even sounds like it's talking about three or four different tickets. @daniel, can you please specify the description and make the acceptance criteria much more obvious? Thanks a lot.

One possible set of acceptance criteria I can see is:


Add the mw-redirect CSS class to links that point to redirects. This is what the two current patches do.
Make the tooltip consistent to what core does.


@matej_suchanek, feel free to jump in and tell us what you think. :-)TASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanek, thiemowmdeCc: matej_suchanek, gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T70567: Make EntityView UI aware of redirects

2017-09-28 Thread thiemowmde 
thiemowmde added a subscriber: matej_suchanek.thiemowmde updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...We also need to decide whether the entity selector should allow redirects to be entered, and if yes, how they could be marked in the autocompletion list.

#patch-for-review:
[x] https://gerrit.wikimedia.org/r/379545
[] https://gerrit.wikimedia.org/r/379703TASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanek, thiemowmdeCc: matej_suchanek, gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381208 merged by jenkins-bot:
[analytics/wmde/scripts@production] instanceof.php short sleep to avoid rate limit

https://gerrit.wikimedia.org/r/381208TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381207 merged by jenkins-bot:
[analytics/wmde/scripts@master] instanceof.php short sleep to avoid rate limit

https://gerrit.wikimedia.org/r/381207TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381207 had a related patch set uploaded (by Addshore; owner: Addshore):
[analytics/wmde/scripts@master] instanceof.php short sleep to avoid rate limit

https://gerrit.wikimedia.org/r/381207TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381208 had a related patch set uploaded (by Addshore; owner: Addshore):
[analytics/wmde/scripts@production] instanceof.php short sleep to avoid rate limit

https://gerrit.wikimedia.org/r/381208TASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176577: Some values of "Instance of counts" are not updating anymore

2017-09-28 Thread Addshore 
Addshore added a comment.
So, looking at the dashboard, the query for the count of events is working again, but some other queries failed in the past day.

Looking at the logs:

2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q811979} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q13406463} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q4167410} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q11424} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q83620} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q6999} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof WikidataInstanceOf::doSparqlQuery: PREFIX wd: PREFIX wdt: SELECT (count(distinct(?s)) AS ?scount) WHERE {?s wdt:P31/wdt:P279* wd:Q16686448} [{"http_code":"HTTP\/1.1 429 ","Server":"nginx\/1.11.6","Date":"Thu, 28 Sep 2017 03:07:40 GMT","Content-Type":"application\/octet-stream","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"no-cache"},"Rate limit exceeded\n"]
2017-09-28 03:07:40 wikidata-sparql-instanceof Script Finished!

Looks like it is hitting the new rate limit, so we probably want to put some sleeps in there! :DTASK DETAILhttps://phabricator.wikimedia.org/T176577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Lydia_Pintscher, gerritbot, Addshore, Sjoerddebruin, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Assigned] T174922: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code

2017-09-28 Thread Addshore 
Addshore assigned this task to WMDE-leszek.
TASK DETAILhttps://phabricator.wikimedia.org/T174922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, AddshoreCc: JeroenDeDauw, Krinkle, Aklapper, Addshore, Legoktm, greg, Lydia_Pintscher, daniel, thiemowmde, Aleksey_WMDE, Jonas, hoo, aude, demon, WMDE-leszek, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T173940: Add all wikidata build extensions to make-wmf-branch script

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 378771 merged by jenkins-bot:
[mediawiki/tools/release@master] Add all wikidata build exts to make-wmf-branch

https://gerrit.wikimedia.org/r/378771TASK DETAILhttps://phabricator.wikimedia.org/T173940EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: gerritbot, Aklapper, Addshore, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T173940: Add all wikidata build extensions to make-wmf-branch script

2017-09-28 Thread Addshore 
Addshore closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T173940EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: gerritbot, Aklapper, Addshore, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T173818: [Epic] Kill the Wikidata build step

2017-09-28 Thread Addshore 
Addshore closed subtask T173940: Add all wikidata build extensions to make-wmf-branch script as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T173818: [Epic] Kill the Wikidata build step

2017-09-28 Thread Addshore 
Addshore updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[ x] T173940 Add extensions to make-wmf-branch script...TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381199 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] Load wikibase build from mediawiki-config for beta wikidataclient

https://gerrit.wikimedia.org/r/381199TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176793: Deploy Capiunto to all Wikimedia Wikis

2017-09-28 Thread Johan 
Johan added a comment.
When would you expect this to happen?TASK DETAILhttps://phabricator.wikimedia.org/T176793EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JohanCc: Johan, greg, Aklapper, Lydia_Pintscher, Lucie, Deskana, hoo, GoranSMilovanovic, QZanden, Izno, Luke081515, Wikidata-bugs, aude, TheDJ, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread Addshore 
Addshore claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381196 had a related patch set uploaded (by Addshore; owner: Addshore):
[wikidata/build-resources@master] Add WARNING re killing the build to Wikidata.php

https://gerrit.wikimedia.org/r/381196TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381195 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] Load wikibase build from mediawiki-config for beta

https://gerrit.wikimedia.org/r/381195TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Addshore, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 381194 had a related patch set uploaded (by Addshore; owner: Addshore):
[operations/mediawiki-config@master] WIP DNM: Add loading of wikibase extensions from build

https://gerrit.wikimedia.org/r/381194TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T173818: [Epic] Kill the Wikidata build step

2017-09-28 Thread Addshore 
Addshore updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[ ] T175026 Deploy extensions as normal MW extensions (CommonSettings.php, etc.) and remove them from the build (note that we might need to set up manual classmaps for AutoloadClasses temporarily until {T99865} is resolved.6948 Move loading of extensions from build into mediawiki-config
[ ] T174922 Decide what to do with the remaining _javascript_ only stuff & do it...  [ ] wikibase/serialization-_javascript_
[ ] T175026 Deploy extensions as normal MW extensions (CommonSettings.php, etc.) and remove them from the build (note that we might need to set up manual classmaps for AutoloadClasses temporarily until {T99865} is resolved.
[ ] Undeploy the Wikidata extension / the build...TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T173818: [Epic] Kill the Wikidata build step

2017-09-28 Thread Addshore 
Addshore created subtask T176948: Move config & loading logic out of Wikidata build and into mediawiki-config.
TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T176948: Move config & loading logic out of Wikidata build and into mediawiki-config

2017-09-28 Thread Addshore 
Addshore created this task.Addshore added projects: Wikidata, Release-Engineering-Team, User-Addshore.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONRight now the logic of what extensions get loaded when is in the Wikidata build.
This should be moved to mediawiki-config.

This blocks any moving of extensions out of the build!TASK DETAILhttps://phabricator.wikimedia.org/T176948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: aude, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T173749: QuickStatements to RDF converter

2017-09-28 Thread Hjfocs 
Hjfocs added a comment.
@Pintoch I think that Wikidata RDF for data imports should be as concise as possible to facilitate data providers. I'm trying to reduce the RDF verbosity to a maximum, avoiding reified nodes where possible.
Of course, QuickStatements is much more compact, but totally non-standard, which is likely to mean no parsers, serializers, validators, etc. This was the main "community" rationale for choosing RDF.
Technically speaking, RDF also enables fine-grained filtering of suggested statements via SPARQL queries, which are very useful to improve things like this: M218/691.

Talking about specs, I've come up with what I think should be the relevant Wikidata RDF subset for data providers. I'm working with the WikiFactMine (ping @tarro) guys  probably test it with folksTASK DETAILhttps://phabricator.wikimedia.org/T173749EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Pintoch, Aklapper, Hjfocs, Tpt, Lydia_Pintscher, Smalyshev, GoranSMilovanovic, Kiailandi, QZanden, dachary, Izno, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T176841: Create wikibase/wikiba.se-deploy repo

2017-09-28 Thread ema 
ema removed a project: Traffic.
TASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: emaCc: hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-09-28 Thread Gehel 
Gehel added a comment.
Yes, we should be careful, but at the moment the logs indicate that a heap size of 3GB should be OK (looking at heap after GC). That's an oversizing by a factor of 3. Worst case, we have -XX:+ExitOnOutOfMemoryError configured, so we should exit and restart cleanly in most cases (yes, there are a few cases where we might run into crazy GC overhead without throwing OOME, but mostly in case of oversized heap, not undersized).TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176473: [Task] Split Lexeme serializer into ExternalSerializer and StorageSerializer

2017-09-28 Thread gerritbot 
gerritbot added a comment.
Change 376720 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Add a lexeme serializer for the external output

https://gerrit.wikimedia.org/r/376720TASK DETAILhttps://phabricator.wikimedia.org/T176473EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Aleksey_WMDE, gerritbotCc: gerritbot, daniel, Lydia_Pintscher, Aklapper, Liuxinyu970226, Jan_Dittrich, Jonas, Addshore, Aleksey_WMDE, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174922: Decide what to do with Wikibase JS-only libraries regarding the build/deployment of Wikidata code

2017-09-28 Thread WMDE-leszek 
WMDE-leszek added a comment.
Just got back from some days off and regarding what @Krinkle said in his last comment: I completely agree those libs should not depend on MW, and should take care of running their tests themselves not relying on MW's QUnit runner, no matter how they're included in the build step. I've actually been changing them that in such manner some weeks ago and most are already made indepedent. Still some work left though, but hopefully will be ready soon!TASK DETAILhttps://phabricator.wikimedia.org/T174922EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: JeroenDeDauw, Krinkle, Aklapper, Addshore, Legoktm, greg, Lydia_Pintscher, daniel, thiemowmde, Aleksey_WMDE, Jonas, hoo, aude, demon, WMDE-leszek, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs