[Wikidata-bugs] [Maniphest] [Commented On] T154869: Removing qualifier/reference using the keyboard (by pressing enter) saves the statement too

2017-10-19 Thread Yair_rand
Yair_rand added a comment.
This is now also the case for the "add" buttons, making it impossible to add more than one qualifier in an edit using the keyboard, and making adding references require a sequence of several edits to add a single reference.TASK DETAILhttps://phabricator.wikimedia.org/T154869EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Yair_randCc: Yair_rand, Lydia_Pintscher, thiemowmde, Jonas, Liuxinyu970226, Aklapper, Nikki, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread kaldari
kaldari added a comment.
So in other words, we should change it to $1 century, and eventually pass $nunberFormatter->format( $number ) as the parameter (instead of just $number).TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: kaldariCc: TheDJ, Lydia_Pintscher, kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread kaldari
kaldari added a comment.
CLDR has mappings for ordinal numbers in at least 85 languages. I'm pretty sure that's what the PHP intl library is using.TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: kaldariCc: TheDJ, Lydia_Pintscher, kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T174025: Implement MCR revision retrieval legacy version

2017-10-19 Thread CCicalese_WMF
CCicalese_WMF moved this task from MWPT-Q1-Jul-Sep-2017 to MWPT-Q2-Oct-Dec-2017 on the MediaWiki-Platform-Team board.CCicalese_WMF edited projects, added MediaWiki-Platform-Team (MWPT-Q2-Oct-Dec-2017); removed MediaWiki-Platform-Team (MWPT-Q1-Jul-Sep-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T174025WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, CCicalese_WMFCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T174039: Implement MCR page update legacy version

2017-10-19 Thread CCicalese_WMF
CCicalese_WMF moved this task from MWPT-Q1-Jul-Sep-2017 to MWPT-Q2-Oct-Dec-2017 on the MediaWiki-Platform-Team board.CCicalese_WMF edited projects, added MediaWiki-Platform-Team (MWPT-Q2-Oct-Dec-2017); removed MediaWiki-Platform-Team (MWPT-Q1-Jul-Sep-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T174039WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, CCicalese_WMFCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T174022: Implement multi-content revisions

2017-10-19 Thread CCicalese_WMF
CCicalese_WMF moved this task from MWPT-Q1-Jul-Sep-2017 to Long Term/Epic Tasks on the MediaWiki-Platform-Team board.CCicalese_WMF edited projects, added MediaWiki-Platform-Team; removed MediaWiki-Platform-Team (MWPT-Q1-Jul-Sep-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T174022WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CCicalese_WMFCc: Lokal_Profil, -jem-, Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T174023: Implement MCR storage layer

2017-10-19 Thread CCicalese_WMF
CCicalese_WMF moved this task from MWPT-Q2-Oct-Dec-2017 to Long Term/Epic Tasks on the MediaWiki-Platform-Team board.CCicalese_WMF edited projects, added MediaWiki-Platform-Team; removed MediaWiki-Platform-Team (MWPT-Q2-Oct-Dec-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T174023WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, CCicalese_WMFCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178624: enwiki dispatch lag is 8 hours

2017-10-19 Thread Ladsgroup
Ladsgroup created this task.Ladsgroup added a project: Wikidata-Sprint.Herald added a subscriber: Aklapper.Herald added a project: User-Ladsgroup.
TASK DESCRIPTIONThis is a ubn! task that needs to be resolved ASAP.  made per @Lydia_PintscherTASK DETAILhttps://phabricator.wikimedia.org/T178624WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178623: enwiki dispatch lag is 8 hours

2017-10-19 Thread Ladsgroup
Ladsgroup created this task.Ladsgroup added a project: Wikidata-Sprint.Herald added a subscriber: Aklapper.Herald added a project: User-Ladsgroup.
TASK DESCRIPTIONThis is a ubn! task that needs to be resolved ASAP.  made per @Lydia_PintscherTASK DETAILhttps://phabricator.wikimedia.org/T178623WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T159699: [Task] Add a tooltip hint to the "Query Service" toolbar button on wikidata.org

2017-10-19 Thread Smarita
Smarita added a comment.
Sorry guys got caught with some other tasks. Will work on this when I am relatively freer.TASK DETAILhttps://phabricator.wikimedia.org/T159699EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmaritaCc: Smarita, ShapeOfMatter, PokestarFan, TerraCodes, matej_suchanek, Lydia_Pintscher, Aklapper, Viveksr96, GoranSMilovanovic, Soteriaspace, RazeSoldier, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, MuhammadShuaib, Simeondahl, Wikidata-bugs, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T159699: [Task] Add a tooltip hint to the "Query Service" toolbar button on wikidata.org

2017-10-19 Thread Smarita
Smarita removed Smarita as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T159699EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmaritaCc: Smarita, ShapeOfMatter, PokestarFan, TerraCodes, matej_suchanek, Lydia_Pintscher, Aklapper, Viveksr96, GoranSMilovanovic, Soteriaspace, RazeSoldier, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, MuhammadShuaib, Simeondahl, Wikidata-bugs, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T174519: [epic] SDoC: Determine baseline for metrics

2017-10-19 Thread debt
debt closed subtask T177356: Metrics for SDoC: look at querying databases as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174519EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: Liuxinyu970226, Capt_Swing, Ramsey-WMF, SandraF_WMF, Abit, chelsyx, mpopov, debt, Aklapper, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T177356: Metrics for SDoC: look at querying databases

2017-10-19 Thread debt
debt closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopov, debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T174028: Finalize database schema for MCR content meta-data

2017-10-19 Thread daniel
daniel closed this task as "Resolved".daniel claimed this task.daniel added a comment.
Final schema version can be found at https://www.mediawiki.org/wiki/Multi-Content_Revisions/Database_Schema and https://gerrit.wikimedia.org/r/#/c/378724.

Further tweaks may be needed once we can test the new schema on a full scale database and simulated query load.TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Marostegui, Abit, brion, Anomie, jcrespo, gerritbot, Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, Lewizho99, Maathavan, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T174026: Implement MCR content meta-data storage service

2017-10-19 Thread daniel
daniel closed subtask T174028: Finalize database schema for MCR content meta-data  as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T174030: Implement DB schema migration tools for MCR

2017-10-19 Thread daniel
daniel closed subtask T174028: Finalize database schema for MCR content meta-data  as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T174045: DB schema migration for MCR

2017-10-19 Thread daniel
daniel closed subtask T174028: Finalize database schema for MCR content meta-data  as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Luke081515, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T175188: Survey GLAM stakeholders in Commons structured data program

2017-10-19 Thread Capt_Swing
Capt_Swing updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONLearn how structured data will impact GLAM stakeholders who contribute media to Wikimedia Commons by surveying them. Survey will focus on the kinds of media they donate, the tools they use, etc. Goal is to understand which tools, media, etc. are used most frequently, and to learn about unmet needs and get feedback on pain points in current processes and opportunities for improvement.

[Research report](https://meta.wikimedia.org/wiki/Research:Supporting_Commons_contribution_by_GLAM_institutions)

Steps...TASK DETAILhttps://phabricator.wikimedia.org/T175188EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Capt_SwingCc: BVershbow_WMF, SandraF_WMF, Sadads, Abit, Capt_Swing, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, QZanden, Acer, Avner, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

2017-10-19 Thread debt
debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...* [] investigate file annotations and if any tracking (logging) of them are available
** example: https://commons.wikimedia.org/wiki/File:Henley_2009_women.jpg (hover over the photo)
** future use case: structure these annotations and maybe have them enabled by default with machine learning AI
TASK DETAILhttps://phabricator.wikimedia.org/T177353EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T165809: Does wbsetdescription really need the site parameter

2017-10-19 Thread matej_suchanek
matej_suchanek closed this task as "Invalid".matej_suchanek removed a project: Wikibase-DataModel.
TASK DETAILhttps://phabricator.wikimedia.org/T165809EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: PokestarFan, aude, hoo, Aklapper, Florian, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T107595: [RFC] Multi-Content Revisions

2017-10-19 Thread CCicalese_WMF
CCicalese_WMF edited projects, added MediaWiki-Platform-Team; removed MediaWiki-Platform-Team (MWPT-Q1-Jul-Sep-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T107595EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: brion, CCicalese_WMFCc: Nirmos, CCicalese_WMF, PokestarFan, Rical, Ayack, -jem-, Deskana, SBisson, Izno, Pppery, Alsee, Florian, Liuxinyu970226, WMDE-leszek, Mholloway, Scott_WUaS, Niharika, MGChecker, LikeLifer, Elitre, Glaisher, JJMC89, RobLa-WMF, Yurik, ArielGlenn, APerson, TomT0m, Krenair, intracer, Tgr, Tobi_WMDE_SW, Lydia_Pintscher, cscott, PleaseStand, awight, Ricordisamoa, GWicke, waldyrious, Legoktm, Aklapper, Jdforrester-WMF, Ltrlg, brion, Spage, MZMcBride, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Luke081515, Wikidata-bugs, aude, jayvdb, fbstj, Anomie, santhosh, Mbch331, Rxy, Jay8g, bd808___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173696: Cache constraint check results

2017-10-19 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.
The time window is the one in the Grafana permalink. The two spikes are when I just fetched that URL with curl in a for i in {1..100} shell loop (synchronously), so it looks like those spikes are 100 requests over 2-3 minutes.TASK DETAILhttps://phabricator.wikimedia.org/T173696EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, Lucas_Werkmeister_WMDECc: Krinkle, aaron, gerritbot, Ladsgroup, daniel, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T148411: Item search for statements ranks disambiguation items too highly

2017-10-19 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)).
TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173696: Cache constraint check results

2017-10-19 Thread aaron
aaron added a comment.

In T173696#3696294, @Lucas_Werkmeister_WMDE wrote:
I did a bunch of requests against https://www.wikidata.org/w/api.php?action="">, which checks a format constraint for “title”. It’s always the same regex and only a handful of different values (17). But while I could see a sharp rise in requests in Grafana corresponding to the times when I sent those requests (permalink), most of them are still cache misses. I’m not sure how to interpret that – it seems values aren’t entering the cache map very often?


What was the request rate and time window?TASK DETAILhttps://phabricator.wikimedia.org/T173696EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, aaronCc: Krinkle, aaron, gerritbot, Ladsgroup, daniel, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-10-19 Thread debt
debt removed a project: Discovery-Search.debt added a comment.
Taking off the #discovery-search tag, as there isn't much we can do, but we'll continue to monitor using the #discovery tag.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: debt, mxn, Daimona, YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, Gehel, FloNight, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-19 Thread Thad Guidry
No connections to Opencorporates, sorry.

The good news is that the data sources in Opencorporates (the Registers)
are accessible to you...sometimes in dump format.

https://opencorporates.com/registers

Hope that helps you further in your research and needs.  I am not saying
its easy :)

-Thad
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Commented On] T148411: Item search for statements ranks disambiguation items too highly

2017-10-19 Thread gerritbot
gerritbot added a comment.
Change 384629 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Add generic term_boost function for boosting by matching terms

https://gerrit.wikimedia.org/r/384629TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T178160: Constraints gadget fails on statements with qualifier/reference results but no mainsnak results

2017-10-19 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE closed this task as "Resolved".Lucas_Werkmeister_WMDE added a comment.
Should be fixed.TASK DETAILhttps://phabricator.wikimedia.org/T178160EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: gerritbot, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178160: Constraints gadget fails on statements with qualifier/reference results but no mainsnak results

2017-10-19 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)).
TASK DETAILhttps://phabricator.wikimedia.org/T178160EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, ReleaseTaggerBotCc: gerritbot, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T164742: [Story] Add Form to list of Forms (persistent)

2017-10-19 Thread thiemowmde
thiemowmde updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/383793
[] https://gerrit.wikimedia.org/r/383799
[x] https://gerrit.wikimedia.org/r/384506TASK DETAILhttps://phabricator.wikimedia.org/T164742EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Aleksey_WMDE, Ladsgroup, Jakob_WMDE, Jonas, WMDE-leszek, gerritbot, Aklapper, Lydia_Pintscher, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178585: First test deployment of the back end

2017-10-19 Thread Hjfocs
Hjfocs created this task.Hjfocs added projects: Wikidata-primary-sources, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONTo http://tools.wmflabs.org/wikidata-primary-sourcesTASK DETAILhttps://phabricator.wikimedia.org/T178585EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-19 Thread Luigi Assom
Hi Thad,

It is a really great project, I quote some of the points of Sebastian:

>* # regarding Opencorporates *>* I have a critical opinion with
> Opencorporates. It appears to be *>* open, but you actually can not get
> the data. If somebody has a *>* data dump, please forward to me. Thanks. *
> >* More on top, I consider Opencorporates a danger to open data. It *>*
> appears to push open availability of data, but then it is limited *>* to
> open licenses. Usefulness is limited as there are no free dumps *>* and
> no possibility to duplicate it effectlively. Wikipedia and *>* Wikidata
> provide dumps and an API for exactly this reason. *>* Everytime somebody
> wants to create an open organisation dataset *>* with no barriers, the
> existence of Opencorporates is blocking this.*


I think that having the possibility to make an analysis on bulk is
important.

Some data in opencorporates are incomplete - like founders, capital raised,
investors, despite some info is fed from users.
Currently most data is about US and NZ, Id like t see EU more represented.

I would like to have possibility to visualise a network of companies and
their participations.
And build bypartite graphs between personas and companies.
I will try to reach them, about cooperation for such a project.

Do you have connections with them?




On Thu, Oct 19, 2017 at 2:17 PM, Thad Guidry  wrote:

> Hi Luigi,
>
> Have you looked at https://opencorporates.com  ?
>
> Thad
> +ThadGuidry 
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Commented On] T178160: Constraints gadget fails on statements with qualifier/reference results but no mainsnak results

2017-10-19 Thread gerritbot
gerritbot added a comment.
Change 384502 merged by jenkins-bot:
[mediawiki/extensions/WikibaseQualityConstraints@master] Add tests for T178160

https://gerrit.wikimedia.org/r/384502TASK DETAILhttps://phabricator.wikimedia.org/T178160EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, gerritbotCc: gerritbot, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178160: Constraints gadget fails on statements with qualifier/reference results but no mainsnak results

2017-10-19 Thread gerritbot
gerritbot added a comment.
Change 384066 merged by jenkins-bot:
[mediawiki/extensions/WikibaseQualityConstraints@master] Always include main snak context in API response

https://gerrit.wikimedia.org/r/384066TASK DETAILhttps://phabricator.wikimedia.org/T178160EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, gerritbotCc: gerritbot, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173194: Module:Wikidata label should use mw.wikibase.label and mw.wikibase.sitelink

2017-10-19 Thread Jarekt
Jarekt added a comment.
I am testing new code in Module:Wikidata label/sandbox. The label selection code  becomes

	userLang = mw.getCurrentFrame():callParserFunction( "int", "lang" )
	
	-- try easy way to get label (visible part of the link)
	-- call if requesting label in user's language, but skip if we already have entity
	if (userLang==lang) and (not entity) then
		label, language = mw.wikibase.getLabelWithLang( item )
	end

	-- hard way to get label
	-- used if requesting label in language different than user's, or if we already have entity
	if not label then
		entity = entity or mw.wikibase.getEntity(item) -- load entity if we do not have it yet
		for _, language in ipairs(langList) do -- loop over language fallback list
			label = entity:getLabel(language)
			if label then break end -- label found and we are done
		end
	end
	if not label then -- no labels found so just show the q-code
		label = item
	end

The language loop over getLabel() in the second block will be executed only in a rare cases when one of following things happen:


someone called the template while specifying language other than user's language. For example see Template:City Examples where name of Beijing is displayed in English, Chinese and in Arabic. That should be a rare case mostly used for template testing
We already fetched the whole entity for something else and there is no need for another call to get the label
getLabelWithLang returned nul label


Would that fix the code in your view?

If getLabelWithLang was modified to take second language input parameter we could skip if (userLang==lang) test and let getLabelWithLang handle first case as well.

I assume that the second block is more efficient if we already have entity and are just parsing it, as oppose to fetching data again from wikidata. But if it does not make much of a difference, with second parameter to getLabelWithLang we could get rid of the second block and rely only on that function.TASK DETAILhttps://phabricator.wikimedia.org/T173194EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JarektCc: Izno, daniel, Multichill, Aklapper, Ricordisamoa, JeanFred, Jarekt, ValterVB, Elitre, Jheald, Daniel_Mietchen, Nemo_bis, Aschroet, zhuyifei1999, Steinsplitter, Matanya, RP88, El_Grafo, Revent, Sjoerddebruin, Jane023, Susannaanas, Mike_Peel, Lydia_Pintscher, Micru, intracer, Poyekhali, Nizil, PokestarFan, hoo, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Vali.matei, Volker_E, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, GWicke, Fabrice_Florin, Raymond, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177707: don't dispatch changes to all affected pages for highly used items

2017-10-19 Thread daniel
daniel added a comment.
I added tracking for the number of discarded recentchanges entries to the  WikidataClient change handling  dashboard, see https://grafana.wikimedia.org/dashboard/db/wikidataclient-change-handling-wikipageupdater?orgId=1TASK DETAILhttps://phabricator.wikimedia.org/T177707EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Risker, Elitre, Mike_Peel, gerritbot, Jdforrester-WMF, brion, Mattflaschen-WMF, Strainu, TerraCodes, Jay8g, Liuxinyu970226, jcrespo, Bawolff, Aklapper, hoo, daniel, Ladsgroup, Lydia_Pintscher, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T178476: Integrate code review patch sets

2017-10-19 Thread Hjfocs
Hjfocs closed this task as "Resolved".Hjfocs moved this task from Doing to Done on the Wikidata-primary-sources board.Hjfocs added a comment.
See https://github.com/marfox/pst-backend/tree/281f0b8c3285b44cccfd5b5dcafcc135193fe987TASK DETAILhttps://phabricator.wikimedia.org/T178476WORKBOARDhttps://phabricator.wikimedia.org/project/board/2788/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178576: Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo

2017-10-19 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178576: Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo

2017-10-19 Thread gerritbot
gerritbot added a comment.
Change 384943 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/extensions/Wikibase@master] [WIP] Install value-view lib as git submodule, not as composer dependency

https://gerrit.wikimedia.org/r/384943TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T148411: Item search for statements ranks disambiguation items too highly

2017-10-19 Thread gerritbot
gerritbot added a comment.
Change 385193 had a related patch set uploaded (by Thiemo Mättig (WMDE); owner: Thiemo Mättig (WMDE)):
[mediawiki/extensions/Wikibase@master] Don't inject WikibaseRepo as dependency of StatementBoostScoreBuilder

https://gerrit.wikimedia.org/r/385193TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T177093: Make pseudo-PHP library data-values/javascript a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek removed WMDE-leszek as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T177093EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Ricordisamoa, Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T178580: Include wikibase-data-values npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek removed WMDE-leszek as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T178580EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, Ricordisamoa, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178580: Include wikibase-data-values npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added a project: Wikidata.
TASK DESCRIPTIONThe repo of the npm package should be a submodule in Wikibase git repo.
Wikibase should define ResourceLoader modules including files from the npm package, that Wikibase uses.TASK DETAILhttps://phabricator.wikimedia.org/T178580EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, Ricordisamoa, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178579: Include wikibase-api npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added a project: Wikidata.
TASK DESCRIPTIONThe repo of the npm package should be a submodule in Wikibase git repo.
Wikibase should define ResourceLoader modules including files from the npm package, that Wikibase uses.TASK DETAILhttps://phabricator.wikimedia.org/T178579EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T177093: Make pseudo-PHP library data-values/javascript a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created subtask T178580: Include wikibase-data-values npm package as a submodule of Wikibase git repo.
TASK DETAILhttps://phabricator.wikimedia.org/T177093EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Ricordisamoa, Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T177092: Make pseudo-PHP library wikibase/javascript-api a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created subtask T178579: Include wikibase-api npm package as a submodule of Wikibase git repo.
TASK DETAILhttps://phabricator.wikimedia.org/T177092EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T178577: T178576 Include wikibase-data-model npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek renamed this task from "T178576 Include wikibase-datamodel npm package as a submodule of Wikibase git repo" to "T178576 Include wikibase-data-model npm package as a submodule of Wikibase git repo".
TASK DETAILhttps://phabricator.wikimedia.org/T178577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T177091: Make pseudo-PHP library wikibase/serialization-javascript a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created subtask T178578: Include wikibase-serialization npm package as a submodule of Wikibase git repo.
TASK DETAILhttps://phabricator.wikimedia.org/T177091EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T178576: Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek renamed this task from "Include wikibase-dataq-values-value-view npm package as a submodule of Wikibase git repo" to "Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo".
TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178578: Include wikibase-serialization npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added a project: Wikidata.
TASK DESCRIPTIONThe repo of the npm package should be a submodule in Wikibase git repo.
Wikibase should define ResourceLoader modules including files from the npm package, that Wikibase uses.TASK DETAILhttps://phabricator.wikimedia.org/T178578EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T177088: Make pseudo-PHP library wikibase/data-model-javascript a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created subtask T178577: T178576 Include wikibase-datamodel npm package as a submodule of Wikibase git repo.
TASK DETAILhttps://phabricator.wikimedia.org/T177088EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178577: T178576 Include wikibase-datamodel npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added a project: Wikidata.
TASK DESCRIPTIONThe repo of the npm package should be a submodule in Wikibase git repo.
Wikibase should define ResourceLoader modules including files from the npm package, that Wikibase uses.TASK DETAILhttps://phabricator.wikimedia.org/T178577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178576: Include wikibase-dataq-values-value-view npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added a project: Wikidata.
TASK DESCRIPTIONThe repo of the npm package should be a submodule in Wikibase git repo.
Wikibase should define ResourceLoader modules including files from the npm package, that Wikibase uses.TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T178576: Include wikibase-dataq-values-value-view npm package as a submodule of Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek claimed this task.WMDE-leszek added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T177094: Make pseudo extension data-values/value-view a npm package and include it as a git submodule in Wikibase git repo

2017-10-19 Thread WMDE-leszek
WMDE-leszek created subtask T178576: Include wikibase-dataq-values-value-view npm package as a submodule of Wikibase git repo.
TASK DETAILhttps://phabricator.wikimedia.org/T177094EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Lydia_Pintscher, Addshore, Aklapper, WMDE-leszek, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T178389: Create API for updating Form descriptions

2017-10-19 Thread daniel
daniel updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...Open question: should we also have a specialized API for this? Does the specialized API come first? Would a specialized API be simpler/faster to implement than the wbeditenty one? What exactly should the specialized API look like?Should the specialized API be considered internal/unstable?

Considerations for a dedicated API module for editing a Form's "head" (that is, representations and grammatical features):
* Allow representations and grammatical features to be edited together, in a single edit.
* Interface should be consistent with the wbaddform module
* The implementation should be a thin wrapper around functionality shared with wbeditentity.
* Generate useful edit summaries for all cases (change representations, change grammatical features, change both). Question: do we need separate add/remove/update operations, so we can generate better summaries?
* Define ChangeOps for representations and for gram. features, to ensure consistent behavior with wbeditentity. Define ChangeOpDeserializer for decoding JSON representation of edits.
* If we want to treat the dedicated api module as unstable/internal, we have to offer the same functionality via wbeditentity first (or at least, very very soon).
* Ensure permission checks (and token checks, but that's done by the API framework anyway)
* Ensure proper edit conflict detection/resolution
* Re-usable logic for loading and storing a Form inside a Lexeme. Doing this transparently in EntityStore/Entity(Revision)Lookup would allow this logic to be re-used outside the API, e.g. in EntityDataRequestHandler.TASK DETAILhttps://phabricator.wikimedia.org/T178389EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Lydia_Pintscher, Aklapper, Liuxinyu970226, Jan_Dittrich, Jonas, Addshore, daniel, Cinemantique, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Yaroslav Blanter
Thanks Gillaume for clarification.

Cheers
Yaroslav

On Thu, Oct 19, 2017 at 3:06 PM, Guillaume Lederrey  wrote:

> Hello!
>
> As far as I understand, the dispatch lag is an issue between Wikidata
> and the different Wikipedias. There is no involvement of Wikidata
> Query Service in this. Sjoerd probably understand that much better
> than I do...
>
> Note that this issue also caused some replication lag on one of the
> Wikidata Query Service servers [1]. In that case, this was mitigated
> by taking that specific server out of rotation and wait for it to
> recover before sending traffic to it again. And also note that the
> Wikidata Query Service replication lag is a very different kind of lag
> than the dispatch lag you were talking about. (yes, all this is
> complicated).
>
> Thanks for your interest!
>
> [1] https://grafana.wikimedia.org/dashboard/db/wikidata-query-
> service?refresh=1m=1=now-7d=now
>
> On Thu, Oct 19, 2017 at 2:29 PM, Yaroslav Blanter 
> wrote:
> > Thanks Sjoerd. Some en-wiki users consider the delay as a (one more)
> > argument that Wikidata is junk and should be thrown down the toilet, so I
> > was curious whether the delay was handled as a part of the problem.
> >
> > Cheers
> > Yaroslav
> >
> > On Thu, Oct 19, 2017 at 12:09 PM, Sjoerd de Bruin 
> > wrote:
> >>
> >> Hi Yaoslav,
> >>
> >> No, but there has been some dispatch issues in the last few days. The
> >> current lag for enwiki is 3 hours, for example. You can see a graph of
> the
> >> dispatch lag here:
> >> https://grafana.wikimedia.org/dashboard/db/wikidata-
> dispatch?refresh=1m=1=now-7d=now
> >>
> >> Greetings,
> >>
> >> Sjoerd de Bruin
> >> sjoerddebr...@me.com
> >>
> >> Op 19 okt. 2017, om 11:30 heeft Yaroslav Blanter  het
> >> volgende geschreven:
> >>
> >> Thanks Guilaume,
> >>
> >> is this the same accident which caused an hour delay of Wikidata items
> on
> >> Wikipedia watchlists?
> >>
> >> Cheers
> >> Yaroslav
> >>
> >> On Thu, Oct 19, 2017 at 10:14 AM, Guillaume Lederrey
> >>  wrote:
> >>>
> >>> Hello all!
> >>>
> >>> As you might have seen / endured, we've had a Wikdiata Query Service
> >>> partial outage yesterday morning (central european time). The full
> >>> incident report is available [1] if you are interested in the details.
> >>> The short version:
> >>>
> >>> * a single client started to run an unusually high number of queries on
> >>> WDQS
> >>> * the overload was not prevented by our current throttling
> >>> * the failure was not detected and isolated automatically
> >>>
> >>> To prevent this from happening again, we will review our throttling
> >>> rules. Those rules were previously tuned to prevent a single client
> >>> from overloading the service with a small number of expensive
> >>> requests: we started to log a client activity only when the duration
> >>> of a request exceeded 10 seconds. Which means that a client sending
> >>> tons of short requests would never be throttled.
> >>>
> >>> We will correct that by lowering the threshold to probably 25ms. The
> >>> throttling rules are still the same:
> >>>
> >>> * 60 seconds of processing time per minute (peaking at 120 seconds)
> >>> * 30 errors per minute (peaking at 60)
> >>>
> >>> If you are using WDQS to make lots of small requests, and you are over
> >>> the throttling rates above, there is a chance that you will start
> >>> seeing throttling errors. We are not doing this to bother you, we're
> >>> just trying to keep another crash from happening...
> >>>
> >>> If you are throttled, you will receive an HTTP 429 error code. This
> >>> response include the "Retry-After" HTTP header which specify a number
> >>> of seconds you should wait before retrying.
> >>>
> >>> Thanks for your patience!
> >>>
> >>> And contact me if you want any clarification.
> >>>
> >>>   Guillaume
> >>>
> >>> [1]
> >>> https://wikitech.wikimedia.org/wiki/Incident_
> documentation/20171018-wdqs
> >>> [2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429
> >>>
> >>> --
> >>> Guillaume Lederrey
> >>> Operations Engineer, Discovery
> >>> Wikimedia Foundation
> >>> UTC+2 / CEST
> >>>
> >>> ___
> >>> Wikidata mailing list
> >>> Wikidata@lists.wikimedia.org
> >>> https://lists.wikimedia.org/mailman/listinfo/wikidata
> >>
> >>
> >> ___
> >> Wikidata mailing list
> >> Wikidata@lists.wikimedia.org
> >> https://lists.wikimedia.org/mailman/listinfo/wikidata
> >>
> >>
> >>
> >> ___
> >> Wikidata mailing list
> >> Wikidata@lists.wikimedia.org
> >> https://lists.wikimedia.org/mailman/listinfo/wikidata
> >>
> >
> >
> > ___
> > Wikidata mailing list
> > Wikidata@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikidata
> >
>
>
>
> --
> Guillaume Lederrey
> Operations Engineer, 

Re: [Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Guillaume Lederrey
Hello!

As far as I understand, the dispatch lag is an issue between Wikidata
and the different Wikipedias. There is no involvement of Wikidata
Query Service in this. Sjoerd probably understand that much better
than I do...

Note that this issue also caused some replication lag on one of the
Wikidata Query Service servers [1]. In that case, this was mitigated
by taking that specific server out of rotation and wait for it to
recover before sending traffic to it again. And also note that the
Wikidata Query Service replication lag is a very different kind of lag
than the dispatch lag you were talking about. (yes, all this is
complicated).

Thanks for your interest!

[1] 
https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?refresh=1m=1=now-7d=now

On Thu, Oct 19, 2017 at 2:29 PM, Yaroslav Blanter  wrote:
> Thanks Sjoerd. Some en-wiki users consider the delay as a (one more)
> argument that Wikidata is junk and should be thrown down the toilet, so I
> was curious whether the delay was handled as a part of the problem.
>
> Cheers
> Yaroslav
>
> On Thu, Oct 19, 2017 at 12:09 PM, Sjoerd de Bruin 
> wrote:
>>
>> Hi Yaoslav,
>>
>> No, but there has been some dispatch issues in the last few days. The
>> current lag for enwiki is 3 hours, for example. You can see a graph of the
>> dispatch lag here:
>> https://grafana.wikimedia.org/dashboard/db/wikidata-dispatch?refresh=1m=1=now-7d=now
>>
>> Greetings,
>>
>> Sjoerd de Bruin
>> sjoerddebr...@me.com
>>
>> Op 19 okt. 2017, om 11:30 heeft Yaroslav Blanter  het
>> volgende geschreven:
>>
>> Thanks Guilaume,
>>
>> is this the same accident which caused an hour delay of Wikidata items on
>> Wikipedia watchlists?
>>
>> Cheers
>> Yaroslav
>>
>> On Thu, Oct 19, 2017 at 10:14 AM, Guillaume Lederrey
>>  wrote:
>>>
>>> Hello all!
>>>
>>> As you might have seen / endured, we've had a Wikdiata Query Service
>>> partial outage yesterday morning (central european time). The full
>>> incident report is available [1] if you are interested in the details.
>>> The short version:
>>>
>>> * a single client started to run an unusually high number of queries on
>>> WDQS
>>> * the overload was not prevented by our current throttling
>>> * the failure was not detected and isolated automatically
>>>
>>> To prevent this from happening again, we will review our throttling
>>> rules. Those rules were previously tuned to prevent a single client
>>> from overloading the service with a small number of expensive
>>> requests: we started to log a client activity only when the duration
>>> of a request exceeded 10 seconds. Which means that a client sending
>>> tons of short requests would never be throttled.
>>>
>>> We will correct that by lowering the threshold to probably 25ms. The
>>> throttling rules are still the same:
>>>
>>> * 60 seconds of processing time per minute (peaking at 120 seconds)
>>> * 30 errors per minute (peaking at 60)
>>>
>>> If you are using WDQS to make lots of small requests, and you are over
>>> the throttling rates above, there is a chance that you will start
>>> seeing throttling errors. We are not doing this to bother you, we're
>>> just trying to keep another crash from happening...
>>>
>>> If you are throttled, you will receive an HTTP 429 error code. This
>>> response include the "Retry-After" HTTP header which specify a number
>>> of seconds you should wait before retrying.
>>>
>>> Thanks for your patience!
>>>
>>> And contact me if you want any clarification.
>>>
>>>   Guillaume
>>>
>>> [1]
>>> https://wikitech.wikimedia.org/wiki/Incident_documentation/20171018-wdqs
>>> [2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429
>>>
>>> --
>>> Guillaume Lederrey
>>> Operations Engineer, Discovery
>>> Wikimedia Foundation
>>> UTC+2 / CEST
>>>
>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>



-- 
Guillaume Lederrey
Operations Engineer, Discovery
Wikimedia Foundation
UTC+2 / CEST

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Yaroslav Blanter
Thanks Sjoerd. Some en-wiki users consider the delay as a (one more)
argument that Wikidata is junk and should be thrown down the toilet, so I
was curious whether the delay was handled as a part of the problem.

Cheers
Yaroslav

On Thu, Oct 19, 2017 at 12:09 PM, Sjoerd de Bruin 
wrote:

> Hi Yaoslav,
>
> No, but there has been some dispatch issues in the last few days. The
> current lag for enwiki is 3 hours, for example. You can see a graph of the
> dispatch lag here: https://grafana.wikimedia.org/dashboard/db/
> wikidata-dispatch?refresh=1m=1=now-7d=now
>
> Greetings,
>
> Sjoerd de Bruin
> sjoerddebr...@me.com
>
> Op 19 okt. 2017, om 11:30 heeft Yaroslav Blanter  het
> volgende geschreven:
>
> Thanks Guilaume,
>
> is this the same accident which caused an hour delay of Wikidata items on
> Wikipedia watchlists?
>
> Cheers
> Yaroslav
>
> On Thu, Oct 19, 2017 at 10:14 AM, Guillaume Lederrey <
> gleder...@wikimedia.org> wrote:
>
>> Hello all!
>>
>> As you might have seen / endured, we've had a Wikdiata Query Service
>> partial outage yesterday morning (central european time). The full
>> incident report is available [1] if you are interested in the details.
>> The short version:
>>
>> * a single client started to run an unusually high number of queries on
>> WDQS
>> * the overload was not prevented by our current throttling
>> * the failure was not detected and isolated automatically
>>
>> To prevent this from happening again, we will review our throttling
>> rules. Those rules were previously tuned to prevent a single client
>> from overloading the service with a small number of expensive
>> requests: we started to log a client activity only when the duration
>> of a request exceeded 10 seconds. Which means that a client sending
>> tons of short requests would never be throttled.
>>
>> We will correct that by lowering the threshold to probably 25ms. The
>> throttling rules are still the same:
>>
>> * 60 seconds of processing time per minute (peaking at 120 seconds)
>> * 30 errors per minute (peaking at 60)
>>
>> If you are using WDQS to make lots of small requests, and you are over
>> the throttling rates above, there is a chance that you will start
>> seeing throttling errors. We are not doing this to bother you, we're
>> just trying to keep another crash from happening...
>>
>> If you are throttled, you will receive an HTTP 429 error code. This
>> response include the "Retry-After" HTTP header which specify a number
>> of seconds you should wait before retrying.
>>
>> Thanks for your patience!
>>
>> And contact me if you want any clarification.
>>
>>   Guillaume
>>
>> [1] https://wikitech.wikimedia.org/wiki/Incident_documentation/
>> 20171018-wdqs
>> [2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429
>>
>> --
>> Guillaume Lederrey
>> Operations Engineer, Discovery
>> Wikimedia Foundation
>> UTC+2 / CEST
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-19 Thread Thad Guidry
Hi Luigi,

Have you looked at https://opencorporates.com  ?

Thad
+ThadGuidry 
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-19 Thread Luigi Assom
Hi,

I would like to join thread I found in the archive:
https://lists.wikimedia.org/pipermail/wikidata//2017-October/011259.html

I worked in contextual research to facilitate knowledge transfer.

One of the domain I would like to treat is visualisation of economics
networks.

I seek for an impact over governance of innovation and transparency over
economics network control, and allow also SMEs companies or private
citizens to build their analytics and prevent cases of collusions.

Information about business profiles is currently a premium service provided
by private specialised corporations, although much of the information about
companies is public, but there is lack of open data policy.

I would like to fill the gap and contribute to feed Wikidata as repository,
either in bulk either as a collective action - as a design thinker I could
contribute to design processes to fill in data, like applications that
facilitate the process.

*Is there any guidance or clearance about this initiatives?*

I am happy to read similar interest from Germany, Belgium and Italy, I
would like to connect.

I read that feeding wikidata with corporate information would significantly
increase the size - though, I think that the benefit to allow to inquire
for public governance would allow to distribute governance of economics
data.

Aside of public services like:
https://www.gov.uk/government/organisations/companies-house

I would like to allow data-visualisation researchers (as myself) to uncover
for the public results like:
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0025995

that relies on private parternships to access corporate databases, and so
findings cannot be quieried by the public.

*Is there a specific Wikidata policy to comply with to feed data from
scrapers of websites?*

As a starter, the URI of sites with good reputation could act as an
*identifier*.
I believe that scraping would be legit for information about property
"facts" (below) are public, and organisations that collated data provides
services (as professional communities or services augmented with private
data) that would be not in competition with building a repository.

In a way, I see wikidata as possibility to indexing data that can be
functional to search engines and discovery engines, and indexing data is an
activity that is daily run by such services. I believe that enabling public
transparency would enhance open-data services.


Below some properties of interest.




Properties I would be interested in are:
- TEAM (founders)
- DESCRIPTION (corporate description over products and services)
- INVESTORS (corp. and private equity)
- EMPLOYEES / INCUBATORS / ADVISORS (personal information available as
public information over the web)
- PARTICIPATED COMPANIES
- DATE of acquisition  or participation to companies
- CAPITAL (if available, or in ranges)
- VAT NUMBER (or registry number)
- ADDRESS

Other ideas to fetch the business profile of companies?
It should be, somehow, publicly available, for each corporate report to the
organisation registry and there are already private companies offering
analytics over the business profiles.



Luigi
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] Turning Lists to Wikidata

2017-10-19 Thread Thad Guidry
Hi Stas and Antonin,

Regarding triple storage of list-like data...

In fact, the primary motivation that OpenRefine was developed was as an
importer tool of list-like data to be uploaded into Freebase.
I had tons of difficulty with Freebase's earlier importer tool that did not
allow much flexibility.  And I was adamant and vocal in complaints to
Freebase staff to "give us better importing tools".
OpenRefine was born from those discussions and working with Freebase staff
to develop and design Gridworks, ala Google Refine, ala OpenRefine..

Lists are just rows of lots of individual facts or statements that need
have to be aligned against a schema..
So having a schema alignment dialog, as we had in OpenRefine against
Freebase schema, will be important for absorbing any lists and aligning and
uploading into Wikidata's triple store.
The schema alignment dialog was the core feature that the previous Freebase
importer tool lacked sufficient fluid UI/UX.

It worked fantastic with Freebase and I do not see any reason why it
couldn't be done for Wikidata and simplify the absorption of lists into
Wikidata.

Antonin, was it in your plans to eventually work on the schema alignment
dialog also for uploading data back to Wikidata to complete the circle of
life, "take and give" ?

Thad
+ThadGuidry 

>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Created] T178564: SVG Image query result downloads use incorrect encoding

2017-10-19 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: Wikidata, Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added a project: Discovery.
TASK DESCRIPTIONT165228: Query results are downloaded in wrong encoding comes back to haunt us again, this time just for the SVG download. Minimal reproducer query:

#defaultView:BubbleChart
SELECT ("Ü" as ?üLabel) (1 AS ?size) {}

link

In the resulting SVG, the “Ü” is broken in a very peculiar way that I don’t even understand – it seems it’s UTF-8 encoded, but the encoded codepoints are U+00C3 “Ô U+0092 “PRIVATE USE TWO”, not U+00DC “Ü”.TASK DETAILhttps://phabricator.wikimedia.org/T178564EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Aklapper, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T167432: Run Wikibase daily browser tests on Jenkins

2017-10-19 Thread zeljkofilipin
zeljkofilipin added a comment.
Screenshots are there:


https://integration.wikimedia.org/ci/job/selenium-Wikibase-T167432/21/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=DebianJessie%20&&%20contintLabsSlave/
https://integration.wikimedia.org/ci/job/selenium-Wikibase-T167432/21/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=DebianJessie%20&&%20contintLabsSlave/artifact/log/


I'll see how to get videos, should not be hard.TASK DETAILhttps://phabricator.wikimedia.org/T167432EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zeljkofilipinCc: hoo, Addshore, aude, gerritbot, PokestarFan, Tobi_WMDE_SW, Jonas, thiemowmde, WMDE-leszek, zeljkofilipin, hashar, Aleksey_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Luke081515, thcipriani, Wikidata-bugs, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173696: Cache constraint check results

2017-10-19 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.
I did a bunch of requests against https://www.wikidata.org/w/api.php?action="">, which checks a format constraint for “title”. It’s always the same regex and only a handful of different values (17). But while I could see a sharp rise in requests in Grafana corresponding to the times when I sent those requests (permalink), most of them are still cache misses. I’m not sure how to interpret that – it seems values aren’t entering the cache map very often?TASK DETAILhttps://phabricator.wikimedia.org/T173696EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, Lucas_Werkmeister_WMDECc: Krinkle, aaron, gerritbot, Ladsgroup, daniel, Aklapper, Jonas, Lucas_Werkmeister_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T175982: Askplatyp.us SPARQL query integration

2017-10-19 Thread Jonas
Jonas added a project: WMF-Legal.
TASK DETAILhttps://phabricator.wikimedia.org/T175982EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Tpt, gerritbot, Jonas, Aklapper, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Lewizho99, Maathavan, Xmlizer, ZhouZ, Mpaulson, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, jayvdb, Slaporte, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Sjoerd de Bruin
Hi Yaoslav,

No, but there has been some dispatch issues in the last few days. The current 
lag for enwiki is 3 hours, for example. You can see a graph of the dispatch lag 
here: 
https://grafana.wikimedia.org/dashboard/db/wikidata-dispatch?refresh=1m=1=now-7d=now
 


Greetings,

Sjoerd de Bruin
sjoerddebr...@me.com

> Op 19 okt. 2017, om 11:30 heeft Yaroslav Blanter  het 
> volgende geschreven:
> 
> Thanks Guilaume,
> 
> is this the same accident which caused an hour delay of Wikidata items on 
> Wikipedia watchlists?
> 
> Cheers
> Yaroslav
> 
> On Thu, Oct 19, 2017 at 10:14 AM, Guillaume Lederrey  > wrote:
> Hello all!
> 
> As you might have seen / endured, we've had a Wikdiata Query Service
> partial outage yesterday morning (central european time). The full
> incident report is available [1] if you are interested in the details.
> The short version:
> 
> * a single client started to run an unusually high number of queries on WDQS
> * the overload was not prevented by our current throttling
> * the failure was not detected and isolated automatically
> 
> To prevent this from happening again, we will review our throttling
> rules. Those rules were previously tuned to prevent a single client
> from overloading the service with a small number of expensive
> requests: we started to log a client activity only when the duration
> of a request exceeded 10 seconds. Which means that a client sending
> tons of short requests would never be throttled.
> 
> We will correct that by lowering the threshold to probably 25ms. The
> throttling rules are still the same:
> 
> * 60 seconds of processing time per minute (peaking at 120 seconds)
> * 30 errors per minute (peaking at 60)
> 
> If you are using WDQS to make lots of small requests, and you are over
> the throttling rates above, there is a chance that you will start
> seeing throttling errors. We are not doing this to bother you, we're
> just trying to keep another crash from happening...
> 
> If you are throttled, you will receive an HTTP 429 error code. This
> response include the "Retry-After" HTTP header which specify a number
> of seconds you should wait before retrying.
> 
> Thanks for your patience!
> 
> And contact me if you want any clarification.
> 
>   Guillaume
> 
> [1] https://wikitech.wikimedia.org/wiki/Incident_documentation/20171018-wdqs 
> 
> [2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429 
> 
> 
> --
> Guillaume Lederrey
> Operations Engineer, Discovery
> Wikimedia Foundation
> UTC+2 / CEST
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org 
> https://lists.wikimedia.org/mailman/listinfo/wikidata 
> 
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Edited] T164742: [Story] Add Form to list of Forms (persistent)

2017-10-19 Thread Jonas
Jonas updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/383793TASK DETAILhttps://phabricator.wikimedia.org/T164742EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Aleksey_WMDE, Ladsgroup, Jakob_WMDE, Jonas, WMDE-leszek, gerritbot, Aklapper, Lydia_Pintscher, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178551: clean up spam on the structured data on commons demo system and add anti-spam measures

2017-10-19 Thread Ladsgroup
Ladsgroup added a comment.
Cleaned up and also enabled the same anti-spamming protection we have for both structured commons and federated wikidata.TASK DETAILhttps://phabricator.wikimedia.org/T178551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Yaroslav Blanter
Thanks Guilaume,

is this the same accident which caused an hour delay of Wikidata items on
Wikipedia watchlists?

Cheers
Yaroslav

On Thu, Oct 19, 2017 at 10:14 AM, Guillaume Lederrey <
gleder...@wikimedia.org> wrote:

> Hello all!
>
> As you might have seen / endured, we've had a Wikdiata Query Service
> partial outage yesterday morning (central european time). The full
> incident report is available [1] if you are interested in the details.
> The short version:
>
> * a single client started to run an unusually high number of queries on
> WDQS
> * the overload was not prevented by our current throttling
> * the failure was not detected and isolated automatically
>
> To prevent this from happening again, we will review our throttling
> rules. Those rules were previously tuned to prevent a single client
> from overloading the service with a small number of expensive
> requests: we started to log a client activity only when the duration
> of a request exceeded 10 seconds. Which means that a client sending
> tons of short requests would never be throttled.
>
> We will correct that by lowering the threshold to probably 25ms. The
> throttling rules are still the same:
>
> * 60 seconds of processing time per minute (peaking at 120 seconds)
> * 30 errors per minute (peaking at 60)
>
> If you are using WDQS to make lots of small requests, and you are over
> the throttling rates above, there is a chance that you will start
> seeing throttling errors. We are not doing this to bother you, we're
> just trying to keep another crash from happening...
>
> If you are throttled, you will receive an HTTP 429 error code. This
> response include the "Retry-After" HTTP header which specify a number
> of seconds you should wait before retrying.
>
> Thanks for your patience!
>
> And contact me if you want any clarification.
>
>   Guillaume
>
> [1] https://wikitech.wikimedia.org/wiki/Incident_
> documentation/20171018-wdqs
> [2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429
>
> --
> Guillaume Lederrey
> Operations Engineer, Discovery
> Wikimedia Foundation
> UTC+2 / CEST
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Commented On] T173194: Module:Wikidata label should use mw.wikibase.label and mw.wikibase.sitelink

2017-10-19 Thread hoo
hoo added a comment.
Well, entity:getLabel should not be looped with an explicit language given if you want to get a language in the user's language. If you manually construct the fallback chain we on our end can't detect that you actually wanted the user language… also this is not needed as getLabel() already takes fallbacks into account (for the user's language only).

Also you still execute the second block, even if there's not going to be a label, this is in case langList contains just the user's language fallback chain. That might unnecessarily load the whole entity.TASK DETAILhttps://phabricator.wikimedia.org/T173194EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jarekt, hooCc: Izno, daniel, Multichill, Aklapper, Ricordisamoa, JeanFred, Jarekt, ValterVB, Elitre, Jheald, Daniel_Mietchen, Nemo_bis, Aschroet, zhuyifei1999, Steinsplitter, Matanya, RP88, El_Grafo, Revent, Sjoerddebruin, Jane023, Susannaanas, Mike_Peel, Lydia_Pintscher, Micru, intracer, Poyekhali, Nizil, PokestarFan, hoo, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Vali.matei, Volker_E, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, GWicke, Fabrice_Florin, Raymond, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178551: clean up spam on the structured data on commons demo system and add anti-spam measures

2017-10-19 Thread Ladsgroup
Ladsgroup added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T178551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T178551: clean up spam on the structured data on commons demo system and add anti-spam measures

2017-10-19 Thread Ladsgroup
Ladsgroup claimed this task.Herald added a project: User-Ladsgroup.
TASK DETAILhttps://phabricator.wikimedia.org/T178551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178551: clean up spam on the structured data on commons demo system and add anti-spam measures

2017-10-19 Thread Lydia_Pintscher
Lydia_Pintscher added a subscriber: Ladsgroup.Lydia_Pintscher added a comment.
@Ladsgroup is looking into it.TASK DETAILhttps://phabricator.wikimedia.org/T178551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Ladsgroup, Aklapper, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178551: clean up spam on the structured data on commons demo system and add anti-spam measures

2017-10-19 Thread Lydia_Pintscher
Lydia_Pintscher created this task.Lydia_Pintscher added a project: Structured-Data-Commons.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONhttp://structured-commons.wmflabs.org is being spammed. We should lock it down in a similar way as the demo system for Lexeme.TASK DETAILhttps://phabricator.wikimedia.org/T178551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Aklapper, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unassigned] T178447: Make semantic choices for clarity between Commons items and Wikidata items ("labels" vs. "captions", etc.)

2017-10-19 Thread matthiasmullie
matthiasmullie removed matthiasmullie as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T178447EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matthiasmullieCc: matthiasmullie, Aklapper, MBinder_WMF, Cparle, MarkTraceur, Ramsey-WMF, TerraCodes, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178492: Create a more controlled WDQS cluster

2017-10-19 Thread Gehel
Gehel added a subtask: Restricted Task.
TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T178547: [Regression] When you tab to "add qualifier" link when adding a statement and press "Enter", the statement is saved

2017-10-19 Thread jhsoby
jhsoby created this task.jhsoby added projects: Regression, Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONThis was mentioned in T177485 because the problem started at the same time, but it is apparently a different issue, as that bug has been fixed but this one still persists.

Steps to reproduce:


Go to any item and click "Add statement" (or "Add value" on an existing statement)
Enter a property and a value (doesn't matter what datavalue type it is)
Press Tab to get to the "Add qualifier" link
Press Enter


As you will notice if you try this, this will add the fields for adding a qualifier as expected, BUT it will simultaneously save the statement.

This did not happen until the software update ~2 weeks ago.TASK DETAILhttps://phabricator.wikimedia.org/T178547EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jhsobyCc: Aklapper, jhsoby, GoranSMilovanovic, Jrbranaa, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread TheDJ
TheDJ added a comment.
PLURAL simply can not do this

The problem is that this is an ordinal, and we have no tooling for that in our translations. PHP has:

$locale = 'en_US';
$nf = new NumberFormatter($locale, NumberFormatter::ORDINAL);
echo $nf->format($number);

Not sure if there are languages that have ordinals, that don't use ordinals for century notation. if not, then it might be good enough to use this straight from php specifically for the date messages that require this..TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TheDJCc: TheDJ, Lydia_Pintscher, kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata] Wikidata Query Service partial outage

2017-10-19 Thread Guillaume Lederrey
Hello all!

As you might have seen / endured, we've had a Wikdiata Query Service
partial outage yesterday morning (central european time). The full
incident report is available [1] if you are interested in the details.
The short version:

* a single client started to run an unusually high number of queries on WDQS
* the overload was not prevented by our current throttling
* the failure was not detected and isolated automatically

To prevent this from happening again, we will review our throttling
rules. Those rules were previously tuned to prevent a single client
from overloading the service with a small number of expensive
requests: we started to log a client activity only when the duration
of a request exceeded 10 seconds. Which means that a client sending
tons of short requests would never be throttled.

We will correct that by lowering the threshold to probably 25ms. The
throttling rules are still the same:

* 60 seconds of processing time per minute (peaking at 120 seconds)
* 30 errors per minute (peaking at 60)

If you are using WDQS to make lots of small requests, and you are over
the throttling rates above, there is a chance that you will start
seeing throttling errors. We are not doing this to bother you, we're
just trying to keep another crash from happening...

If you are throttled, you will receive an HTTP 429 error code. This
response include the "Retry-After" HTTP header which specify a number
of seconds you should wait before retrying.

Thanks for your patience!

And contact me if you want any clarification.

  Guillaume

[1] https://wikitech.wikimedia.org/wiki/Incident_documentation/20171018-wdqs
[2] https://en.wikipedia.org/wiki/List_of_HTTP_status_codes#429

-- 
Guillaume Lederrey
Operations Engineer, Discovery
Wikimedia Foundation
UTC+2 / CEST

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Unassigned] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread thiemowmde
thiemowmde removed Lydia_Pintscher as the assignee of this task.thiemowmde added a subscriber: Lydia_Pintscher.
TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Lydia_Pintscher, kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, TheDJ, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Lowered Priority] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread thiemowmde
thiemowmde lowered the priority of this task from "Normal" to "Lowest".thiemowmde added projects: MediaWiki-extensions-WikibaseRepository, Need-volunteer.thiemowmde moved this task from ready to go to needs discussion or investigation on the Wikidata board.thiemowmde added a comment.
The message for this is https://translatewiki.net/wiki/MediaWiki:Wikibase-time-precision-century/en. We could remove the dot if this makes the situation better. We can not simply change it to "$1st century" because it would say "2st century" then. We do have the PLURAL function, but we would need to list all cases (e.g. 1 and 21 and 31 and so on must end with "st", but not 11). PLURAL simply can not do this. This must be special-case code just for the English language. And what do the other 300 do then?

Please suggest a workaround we can justify in terms of resources it needs.TASK DETAILhttps://phabricator.wikimedia.org/T95553WORKBOARDhttps://phabricator.wikimedia.org/project/board/71/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, thiemowmdeCc: kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, Zoranzoki21, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, TheDJ, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178492: Create a more controlled WDQS cluster

2017-10-19 Thread mobrovac
mobrovac added a project: Services (watching).mobrovac added a comment.
The Recommendation API service depends entirely on WDQS (and partially on AQS). While in theory we could (and should) account for 429s sent by WDQS in the service, the problem described in the task description is genuine. I second the effort of splitting the service (or its access) into two logical entities - one for external, the other for internal clients.TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T95553: Full stop in messages such as Wikibase-time-precision-century is incorrect in English

2017-10-19 Thread kaldari
kaldari renamed this task from "Full stop in messages such as Wikibase-time-precision-century is not needed in English" to "Full stop in messages such as Wikibase-time-precision-century is incorrect in English".
TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, kaldariCc: kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Jayprakash12345, QZanden, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T95553: Full stop in messages such as Wikibase-time-precision-century is not needed in English

2017-10-19 Thread kaldari
kaldari removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, kaldariCc: kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, GoranSMilovanovic, Jayprakash12345, QZanden, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Reopened] T95553: Full stop in messages such as Wikibase-time-precision-century is not needed in English

2017-10-19 Thread kaldari
kaldari reopened this task as "Open".kaldari added a comment.
This bug still seems to be present on Wikidata. For example, at https://www.wikidata.org/wiki/Q28790416 I see "1. millennium", "6. century", "7. century" (with my language set to English). In English, this format doesn't make any sense and looks like an error. It should say "1st millennium", "6th century", "7th century", etc. As Daniel mentioned, "5 August" is fine in English. "5 century", however, is never correct.TASK DETAILhttps://phabricator.wikimedia.org/T95553EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, kaldariCc: kaldari, Ricordisamoa, daniel, thiemowmde, Lucie, Amire80, Aklapper, Tobi_WMDE_SW, Wikidata-bugs, JulesWinnfield-hu, Addshore, Conny, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Srdjan_m, MuhammadShuaib, LNDDYL, Psychoslave, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T87764: Bugs related to time datatype (tracking)

2017-10-19 Thread kaldari
kaldari reopened subtask T95553: Full stop in messages such as Wikibase-time-precision-century is not needed in English as "Open".
TASK DETAILhttps://phabricator.wikimedia.org/T87764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: kaldariCc: PokestarFan, T.seppelt, Agabi10, Ricordisamoa, Conny, Rical, Liuxinyu970226, JulesWinnfield-hu, Wikidata-bugs, Tobi_WMDE_SW, Aklapper, GoranSMilovanovic, QZanden, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] Turning Lists to Wikidata

2017-10-19 Thread Stas Malyshev
Hi!

> when you say "wikidata is not well  suited for lists data", you refer
> to wikibase or WDQS here?

Wikidata is not good for storing list data, or any serial data. WDQS can
produce all kinds of amazing lists via queries, but it's not a primary
data storage. In general, it could store series data, but since it's
based off Wikidata and feeds from it, that creates certain issue when
data is not very suitable for Wikidata.

> the  data:Bea.gov/GDP by state.tab above is certainly a good
> representation for efficient delivery (via json) and display of data.
> but inefficient for further data sharing without URIs.

The question of querying data like "GDB by state.tab" is an interesting
one. I'm not sure whether triple store would be a good medium, but maybe
it could be... Needs some research on the idea.

-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata