date:20180912

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-13T00:00:07Z]  Finished deploy [wdqs/wdqs@7e5e537]: Deploy Blazegraph & Updater for T202765 and T203646 handling (duration: 23m 45s)TASK DETAILhttps://phabricator.wikimedia.org/T203646EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, StashbotCc: Stashbot, Lucas_Werkmeister_WMDE, Oravrattas, Smalyshev, Aklapper, Wikidata-Query-Service, Alexsdutton, mhl20, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203646: Wikidata Query Service nodes out of sync

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-12T23:36:22Z]  Started deploy [wdqs/wdqs@7e5e537]: Deploy Blazegraph & Updater for T202765 and T203646 handlingTASK DETAILhttps://phabricator.wikimedia.org/T203646EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, StashbotCc: Stashbot, Lucas_Werkmeister_WMDE, Oravrattas, Smalyshev, Aklapper, Wikidata-Query-Service, Alexsdutton, mhl20, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Project Column] T204159: Fatal "Call getPrefixedText on a non-object" from WikibaseClient on ApiEchoNotifications

2018-09-12 Thread SBisson

SBisson moved this task from Inbox to External on the Growth-Team board.SBisson added a comment.
It's probably just a matter of checking that the event object has a title object before trying to call getPrefixedText() on it.

https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/Wikibase/+/master/client/includes/Notifications/PageConnectionPresentationModel.php#24

Moving to "Growth team/External" since I believe it should be fixed in Wikibase and not in Echo but the Growth team is happy to help if needed.TASK DETAILhttps://phabricator.wikimedia.org/T204159WORKBOARDhttps://phabricator.wikimedia.org/project/board/1114/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SBissonCc: SBisson, Krinkle, Aklapper, kostajh, MMiller_WMF, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Taiwania_Justo, Luke081515, Wikidata-bugs, aude, Catrope, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204031: Deploy regular running of wikidata constraint checks using the job queue

2018-09-12 Thread Pchelolo

Pchelolo added projects: WMF-JobQueue, Services (watching).Pchelolo added a comment.
Just to make sure - jobs now MUST be JSON-serializable, so please keep that in mind from the very beginning (no PHP classes in the job). Plus please ping #services when deploying it if the anticipated rate of the jobs will be more then 10/sTASK DETAILhttps://phabricator.wikimedia.org/T204031EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PcheloloCc: Pchelolo, Addshore, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Eevans, mobrovac, Hardikj, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

2018-09-12 Thread Jonas

Jonas added a comment.
I am afraid getting accurate numbers about size is hard.

Storing the RDF should be no problem:
https://www.wikidata.org/wiki/Q42?action="">

If we want to store the JSON to be able to completely remove memcache we should be able to store something like this:
https://www.wikidata.org/w/api.php?action="">

We should also mention that count and size of the violation reports are not really predictable, because they are derived from applying the constraint definitions to items (both are user curated).TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204162: Get a filter to surface wiki pages protected cross-wiki

2018-09-12 Thread Trizek-WMF

Trizek-WMF created this task.Trizek-WMF added projects: Edit-Review-Improvements-Integrated-Filters, Growth-Team, Wikidata.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONCopying this comment from Bovlv:

I have formed the impression that we get a flood of vandalism on Wikidata after the corresponding page is protected on another project, e.g. footballers protected on the Spanish Wikipedia during the World Cup.

This is a case of poor communication between projects that lets vandalism continue after it has already been detected and "dealt with". This wastes volunteer time unnecessarily.

Could we please have a filter for pages protected on at least one project? Ideally that would be "recently protected".

The idea would be to have a filter that checks the protection logs of all pages linked to a Wikidata item, to surface them.TASK DETAILhttps://phabricator.wikimedia.org/T204162EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Trizek-WMFCc: Aklapper, Trizek-WMF, kostajh, MMiller_WMF, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Iniquity, Taiwania_Justo, SBisson, Wikidata-bugs, aude, RandomDSdevel, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T204159: Fatal "Call getPrefixedText on a non-object" from WikibaseClient on ApiEchoNotifications

2018-09-12 Thread Krinkle

Krinkle updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...```name=stacktrace,lines=10
#0 [internal function]: Wikibase\Client\Notifications\PageConnectionPresentationModel->callbackForBundleCount(EchoEvent)...TASK DETAILhttps://phabricator.wikimedia.org/T204159EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Krinkle, Aklapper, kostajh, MMiller_WMF, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Taiwania_Justo, SBisson, Luke081515, Wikidata-bugs, aude, Catrope, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204159: Fatal "Call getPrefixedText on a non-object" from WikibaseClient on ApiEchoNotifications

2018-09-12 Thread Krinkle

Krinkle created this task.Krinkle added projects: Wikimedia-production-error, MediaWiki-extensions-WikibaseClient, Notifications.Restricted Application added a subscriber: Aklapper.Restricted Application added projects: Growth-Team, Wikidata.
TASK DESCRIPTIONError

Request ID: W5laWwrAAFAAADp8ycsO

messageBadMethodCallException: Call to a member function getPrefixedText() on a non-object (null)

stacktrace#0 [internal function]: Wikibase\Client\Notifications\PageConnectionPresentationModel->callbackForBundleCount(EchoEvent)
#1 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/formatters/EventPresentationModel.php(220): array_map(array, array)
#2 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/formatters/EventPresentationModel.php(240): EchoEventPresentationModel->getBundleCount(boolean, array)
#3 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Wikibase/client/includes/Notifications/PageConnectionPresentationModel.php(54): EchoEventPresentationModel->getNotificationCountForOutput(boolean, array)
#4 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/formatters/EventPresentationModel.php(520): Wikibase\Client\Notifications\PageConnectionPresentationModel->getHeaderMessage()
#5 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/formatters/EchoModelFormatter.php(13): EchoEventPresentationModel->jsonSerialize()
#6 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/formatters/EchoEventFormatter.php(64): EchoModelFormatter->formatModel(Wikibase\Client\Notifications\PageConnectionPresentationModel)
#7 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/DataOutputFormatter.php(181): EchoEventFormatter->format(EchoEvent)
#8 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/DataOutputFormatter.php(141): EchoDataOutputFormatter::formatNotification(EchoEvent, User, string, Language)
#9 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/api/ApiEchoNotifications.php(287): EchoDataOutputFormatter::formatOutput(EchoNotification, string, User, Language)
#10 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/api/ApiEchoNotifications.php(107): ApiEchoNotifications->getPropList(User, array, array, integer, NULL, string, NULL, boolean, boolean)
#11 /srv/mediawiki/php-1.32.0-wmf.20/extensions/Echo/includes/api/ApiEchoNotifications.php(38): ApiEchoNotifications->getLocalNotifications(array)
#12 /srv/mediawiki/php-1.32.0-wmf.20/includes/api/ApiQuery.php(249): ApiEchoNotifications->execute()
#13 /srv/mediawiki/php-1.32.0-wmf.20/includes/api/ApiMain.php(1587): ApiQuery->execute()
#14 /srv/mediawiki/php-1.32.0-wmf.20/includes/api/ApiMain.php(531): ApiMain->executeAction()
#15 /srv/mediawiki/php-1.32.0-wmf.20/includes/api/ApiMain.php(502): ApiMain->executeActionWithErrorHandling()
#16 /srv/mediawiki/php-1.32.0-wmf.20/api.php(87): ApiMain->execute()



NotesTASK DETAILhttps://phabricator.wikimedia.org/T204159EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Krinkle, Aklapper, kostajh, MMiller_WMF, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Taiwania_Justo, SBisson, Luke081515, Wikidata-bugs, aude, Catrope, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204153: Add more Wikibase extensions to gatedextensions

2018-09-12 Thread Jdforrester-WMF

Jdforrester-WMF added a comment.
Copying my comment in gerrit:

Gate is already quite slow. Ideally we'd have every production extension and skin in here, but…

TASK DETAILhttps://phabricator.wikimedia.org/T204153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, Jdforrester-WMFCc: Lucas_Werkmeister_WMDE, Aklapper, daniel, Liuxinyu970226, TerraCodes, Pablo-WMDE, WMDE-leszek, gerritbot, greg, Jdforrester-WMF, hashar, Addshore, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

Smalyshev added a comment.
There is the possibility that we will need to provide dumps of all constraint violations in order to ease the loading of data into WDQS servers that are starting from scratch

If we plan to have permanent storage for it (not like now, load-on-new-edit model which ignores ones that haven't been edited recently) then yes, we'd need to either put violations into the main dump or create a separate dump for violations only.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204153: Add more Wikibase extensions to gatedextensions

hashar added a comment.
T86930 also ask for ContentTranslation to be added and T200976 is for Scribunto.TASK DETAILhttps://phabricator.wikimedia.org/T204153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, hasharCc: Lucas_Werkmeister_WMDE, Aklapper, daniel, Liuxinyu970226, TerraCodes, Pablo-WMDE, WMDE-leszek, gerritbot, greg, Jdforrester-WMF, hashar, Addshore, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204153: Add more Wikibase extensions to gatedextensions

gerritbot added a comment.
Change 459991 had a related patch set uploaded (by Hashar; owner: Addshore):
[integration/config@master] Add more Wikibase extensions to gatedextensions

https://gerrit.wikimedia.org/r/459991TASK DETAILhttps://phabricator.wikimedia.org/T204153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Lucas_Werkmeister_WMDE, Aklapper, daniel, Liuxinyu970226, TerraCodes, Pablo-WMDE, WMDE-leszek, gerritbot, greg, Jdforrester-WMF, hashar, Addshore, A.S.Kochergin, God, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204153: Add more Wikibase extensions to gatedextensions

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T204153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Lucas_Werkmeister_WMDE, Aklapper, daniel, Liuxinyu970226, TerraCodes, Pablo-WMDE, WMDE-leszek, gerritbot, greg, Jdforrester-WMF, hashar, Addshore, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204065: WikibaseLexeme CI broken (database errors)

hashar added a comment.

In T204065#4576329, @Addshore wrote:
So, the CI is now fixed.
 As a follow up it could be a good idea to add WikibaseLexeme to the list of gated extensions for core @greg @hashar ?


Filled as T204153TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, hasharCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204153: Add more Wikibase extensions to gatedextensions

hashar created this task.hashar triaged this task as "High" priority.hashar added projects: Wikidata, Continuous-Integration-Config, User-Addshore.
TASK DESCRIPTIONFrom T204065, WikibaseLexeme got broken by a mediawiki/core change because it is not in the gate of extensions :\

@Addshore wrote:

It could be a good idea to add WikibaseLexeme to the list of gated extensions for core

TASK DETAILhttps://phabricator.wikimedia.org/T204153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, hasharCc: Lucas_Werkmeister_WMDE, Aklapper, daniel, Liuxinyu970226, TerraCodes, Pablo-WMDE, WMDE-leszek, gerritbot, greg, Jdforrester-WMF, hashar, Addshore, A.S.Kochergin, God, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204150: Embedded Wikidata Query Service timeline is not appropriately adjusted for its vertical size.

Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T204150EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Fnielsen, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T174044: Deploy MCR storage layer

daniel closed subtask T198561: Make "write both, read new" the default MCR migration stage for fresh MediaWiki installs / for CI as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Stashbot, Addshore, gerritbot, Anomie, jcrespo, Aklapper, daniel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, Marostegui, LawExplorer, Lewizho99, Minhnv-2809, JJMC89, Maathavan, Agabi10, Susannaanas, Luke081515, Aschroet, Fjalapeno, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Mbch331, Jay8g, Ltrlg, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T204065: WikibaseLexeme CI broken (database errors)

daniel closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T198561: Make "write both, read new" the default MCR migration stage for fresh MediaWiki installs / for CI

daniel closed this task as "Resolved".daniel moved this task from In Progress to Done on the Multi-Content-Revisions (MCR Deployment) board.daniel added a comment.
let's hope it stays closed this time :)TASK DETAILhttps://phabricator.wikimedia.org/T198561WORKBOARDhttps://phabricator.wikimedia.org/project/board/3443/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: gerritbot, greg, Aklapper, CCicalese_WMF, Fjalapeno, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, MGChecker, Wikidata-bugs, aude, Jdforrester-WMF, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T198308: Enable MCR migration stage "write both, read new" on live systems

daniel closed subtask T198561: Make "write both, read new" the default MCR migration stage for fresh MediaWiki installs / for CI as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T198308EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Keegan, Fjalapeno, CCicalese_WMF, Aklapper, Tgr, Anomie, Abit, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, MGChecker, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204150: Embedded Wikidata Query Service timeline is not appropriately adjusted for its vertical size.

2018-09-12 Thread Fnielsen

Fnielsen created this task.Fnielsen added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONEmbedded Wikidata Query Service timeline is not appropriately adjusted for its vertical size. This happens (at least) if there is an icon. The vertical adjustment tool is neither visible. Example: https://tools.wmflabs.org/scholia/work/Q50063106

F25789313: wdqs-timeline-vertical-bug.png

I would have expected that the vertical size would be sufficiently large so that it would be possible to read what is on the individual panels of the timeline. The sizing is correct in the non-embedded WDQS after pressing the up-down button in the interface, see this example: F25789333: wdqs-timeline-proper-vertical-size.pngTASK DETAILhttps://phabricator.wikimedia.org/T204150EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FnielsenCc: Aklapper, Fnielsen, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

Smalyshev added a comment.
it doesn't seem possible to connect to Blazegraph because the updater already runs?

The errors do indicate connection to Blazegraph fails, most likely either because Blazegraph is not listening to localhost: or something in your setup prevents Updater from connecting there. It is completely fine to run more than one instance of Updater (though in most cases not recommended) so that would not be a problem.TASK DETAILhttps://phabricator.wikimedia.org/T197658EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Tarrow, Smalyshev, tk, Aklapper, Addshore, despens, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Gstupp, merbst, LawExplorer, Avner, Gehel, Abbe98, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

2018-09-12 Thread despens

despens added a comment.
I think I need more guidance on how to run this script. I did use the --start and --init switches before.

When calling ./runUpdate.sh -- -v -s 2001010112 --init it doesn't seem possible to connect to Blazegraph because the updater already runs?

bash-4.4# ./runUpdate.sh -- -v -s 2001010112 --init
Updating via http://localhost:/bigdata/namespace/wdq/sparql
OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/wdqs/wdqs-updater_jvm_gc.pid355.log due to No such file or directory

Could not start Jolokia agent: java.net.BindException: Address in use
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg%n
18:36:01.641 [main] INFO  o.w.q.rdf.tool.options.OptionsUtils - Verbose mode activated
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg%n
18:36:02.229 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Setting last updated time to Mon Jan 01 12:00:00 GMT 2001
18:36:02.242 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Running SPARQL: DELETE {
?o .
}
WHERE {
?o .
};
INSERT DATA {
"2001-01-01T12:00:00.000Z"^^ .
}

18:36:02.277 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 1, will retry
18:36:04.280 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 2, will retry
18:36:08.283 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 3, will retry
18:36:16.286 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 4, will retry
18:36:26.289 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 5, will retry
18:36:36.291 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - HTTP request failed: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused, attempt 6, will fail
18:36:36.294 [main] ERROR org.wikidata.query.rdf.tool.Update - Error during initialization.
org.wikidata.query.rdf.tool.exception.FatalException: Error updating triple store
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.execute(RdfRepository.java:732)
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.updateLeftOffTime(RdfRepository.java:665)
	at org.wikidata.query.rdf.tool.Update.buildRecentChangePollerChangeSource(Update.java:156)
	at org.wikidata.query.rdf.tool.Update.buildChangeSource(Update.java:141)
	at org.wikidata.query.rdf.tool.Update.main(Update.java:65)
Caused by: com.github.rholder.retry.RetryException: Retrying failed to complete successfully after 6 attempts.
	at com.github.rholder.retry.Retryer.call(Retryer.java:174)
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.execute(RdfRepository.java:721)
	... 4 common frames omitted
Caused by: java.util.concurrent.ExecutionException: java.net.ConnectException: Connection refused
	at org.eclipse.jetty.client.util.FutureResponseListener.getResult(FutureResponseListener.java:118)
	at org.eclipse.jetty.client.util.FutureResponseListener.get(FutureResponseListener.java:101)
	at org.eclipse.jetty.client.HttpRequest.send(HttpRequest.java:639)
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.lambda$execute$0(RdfRepository.java:722)
	at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78)
	at com.github.rholder.retry.Retryer.call(Retryer.java:160)
	... 5 common frames omitted
Caused by: java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
	at org.eclipse.jetty.io.SelectorManager.finishConnect(SelectorManager.java:340)
	at org.eclipse.jetty.io.SelectorManager$ManagedSelector.processConnect(SelectorManager.java:671)
	at org.eclipse.jetty.io.SelectorManager$ManagedSelector.processKey(SelectorManager.java:640)
	at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:607)
	at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:545)
	at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:610)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:539)
	at java.lang.Thread.run(Thread.java:748)
Exception in thread "main" org.wikidata.query.rdf.tool.exception.FatalException: Error updating triple store
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.execute(RdfRepository.java:732)
	at org.wikidata.query.rdf.tool.rdf.RdfRepository.upd

[Wikidata-bugs] [Maniphest] [Commented On] T198561: Make "write both, read new" the default MCR migration stage for fresh MediaWiki installs / for CI

gerritbot added a comment.
Change 459830 merged by jenkins-bot:
[mediawiki/core@master] Set MCR migration stage to write-both/read-new AGAIN.

https://gerrit.wikimedia.org/r/459830TASK DETAILhttps://phabricator.wikimedia.org/T198561EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: gerritbot, greg, Aklapper, CCicalese_WMF, Fjalapeno, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, MGChecker, Wikidata-bugs, aude, Jdforrester-WMF, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204065: WikibaseLexeme CI broken (database errors)

gerritbot added a comment.
Change 459820 merged by jenkins-bot:
[mediawiki/core@master] Reset services in ParserTestTopLevelSuite.

https://gerrit.wikimedia.org/r/459820TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204065: WikibaseLexeme CI broken (database errors)

gerritbot added a comment.
Change 459821 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Add WikibaseLexemeExtensionRegistrationTest to group Database

https://gerrit.wikimedia.org/r/459821TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204136: Enable {{SHORTDESC}} Magic Word

2018-09-12 Thread Adithyak1997

Adithyak1997 added a comment.
The actual problem is: almost 70 to 80% of the templates of english are converted into malayalam as it is because only one or two are actually knowing how to create a template. When the template SHORTDESC was imported in the same way, it showed an error to create a template named SHORTDESC: which was not found in english wikipedia. When I consulted in English wikipeda, the result was: https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Template_doubt this.TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Adithyak1997Cc: Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Niharika, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Status] T204136: Enable {{SHORTDESC}} Magic Word

2018-09-12 Thread Aklapper

Aklapper changed the task status from "Open" to "Stalled".Aklapper added projects: Community-consensus-needed, Wikidata, Community-Tech.
TASK DETAILhttps://phabricator.wikimedia.org/T204136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AklapperCc: Adithyak1997, Aklapper, Akhiljaxxn, aezell, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, JJMC89, B20180, Samwilson, Luke081515, Nakon, MusikAnimal, Niharika, Fhocutt, Wikidata-bugs, Snowolf, Mooeypoo, aude, Ricordisamoa, -jem-, Shizhao, Mbch331, Rxy, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T180139: [Story] Support community/volunteer tools around Structured Commons

Keegan closed this task as "Declined".Keegan added a comment.
Too broad in scope.TASK DETAILhttps://phabricator.wikimedia.org/T180139EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Keegan, Abit, SandraF_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204141: Structured Data IRC office hour - Multilingual Captions

Keegan created this task.Keegan triaged this task as "Normal" priority.Keegan added projects: Wikidata, Structured-Data-Commons, IRC-Meetings.
TASK DESCRIPTIONIRC office hour for talking about the release of Multilingual Captions.

Thursday, 1 November 2018, 17:00-18:00 UTC.TASK DETAILhttps://phabricator.wikimedia.org/T204141EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Ramsey-WMF, Abit, Aklapper, SandraF_WMF, Keegan, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Quiddity___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197658: Provide easy script to reset Blazegraph

Smalyshev added a comment.
This error means that the timestamp stored in the database is more than 30 days behind (can be changed with wikibaseMaxDaysBack property). In this case, you can:


Load a dump that is reasonably recent
Run Updater with -s DATE --init
TASK DETAILhttps://phabricator.wikimedia.org/T197658EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Tarrow, Smalyshev, tk, Aklapper, Addshore, despens, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Gstupp, merbst, LawExplorer, Avner, Gehel, Abbe98, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T204140: Structured Data IRC office hour - Search edition

Keegan updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONIRC office hour for talking about the search prototype and "good coverage" tagging for search.

Thursday, 4 October 2018, 17:00-18:00 UTC.

There will be a community consultation around the topic published beforehand.TASK DETAILhttps://phabricator.wikimedia.org/T204140EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Ramsey-WMF, Abit, Aklapper, SandraF_WMF, Keegan, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204140: Structured Data IRC office hour - Search edition

Keegan created this task.Keegan triaged this task as "Normal" priority.Keegan added projects: Wikidata, Structured-Data-Commons, IRC-Meetings.
TASK DESCRIPTIONIRC office hour for talking about the search prototype and "good coverage" tagging for search.

There will be a community consultation around the topic published beforehand.TASK DETAILhttps://phabricator.wikimedia.org/T204140EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Ramsey-WMF, Abit, Aklapper, SandraF_WMF, Keegan, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Quiddity___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T170126: [Epic] Maintain information pages / portal about Structured Data on Commons

Keegan closed this task as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T170126EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Abit, PokestarFan, Elitre, SandraF_WMF, Aklapper, Cpaulf30, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, Ivana_Isadora, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, srodlund, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T178187: Support Javascript-based tools on Wikimedia Commons in the transition to structured data

Keegan closed this task as "Declined".Keegan added a comment.
This task is too broad in scope to really function. I'll make new tasks for tool work as they come up.TASK DETAILhttps://phabricator.wikimedia.org/T178187EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: 0x010C, Keegan, Elitre, zhuyifei1999, Jarekt, RP88, Qgil, Legoktm, Steinsplitter, SandraF_WMF, Aklapper, Mh-3110, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, QZanden, enigmaeth, rohitt, Tramullas, Acer, LawExplorer, Dixtosa, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T180197: [Epic] Support needed changes to volunteer tools for Wikimedia Commons and Wikidata that will benefit from operating with structured data on Commons

Keegan closed subtask T178187: Support _javascript_-based tools on Wikimedia Commons in the transition to structured data as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T180197EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KeeganCc: Keegan, Elitre, Hasenlaeufer, Aklapper, Abit, SandraF_WMF, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, QZanden, Orienteerix, Tramullas, Acer, LawExplorer, Puik, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Nikerabbit, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

gerritbot added a comment.
Change 460063 had a related patch set uploaded (by Pablo Grass (WMDE); owner: Pablo Grass (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] gadget: check entity and subentities

https://gerrit.wikimedia.org/r/460063TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, merbst, LawExplorer, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

gerritbot added a comment.
Change 460060 had a related patch set uploaded (by Pablo Grass (WMDE); owner: Pablo Grass (WMDE)):
[mediawiki/extensions/WikibaseLexeme@master] lexeme: serialize subentity ids

https://gerrit.wikimedia.org/r/460060TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, merbst, LawExplorer, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T114902: Remove numeric entity IDs from database schema

2018-09-12 Thread Marostegui

Marostegui removed a project: DBA.
TASK DETAILhttps://phabricator.wikimedia.org/T114902EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: thiemowmde, jcrespo, Liuxinyu970226, StudiesWorld, Ricordisamoa, aude, JanZerebecki, hoo, Aklapper, daniel, Kotchchanipa, Adrian1985, Abo00tamr, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Wikidata-bugs, Mbch331, AndyTan, Minhnv-2809, Luke081515, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204070: [Spike, 8hrs] Where should Schema property 'sameAs' live?

2018-09-12 Thread Jdlrobson

Jdlrobson set the point value for this task to "0".Jdlrobson added a comment.
(to mark we've talked about this in today's estimation meeting)TASK DETAILhttps://phabricator.wikimedia.org/T204070EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JdlrobsonCc: Deskana, Aklapper, Krenair, cscott, Imarlier, dr0ptp4kt, phuedx, Niedzielski, CKoerner_WMF, Elitre, Tbayer, Jdlrobson, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, LawExplorer, Winter, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

gerritbot added a comment.
Change 460055 had a related patch set uploaded (by Pablo Grass (WMDE); owner: Pablo Grass (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] jasmine tests: add first steps

https://gerrit.wikimedia.org/r/460055TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, gerritbotCc: gerritbot, Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, merbst, LawExplorer, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T204070: [Spike, 8hrs] Where should Schema property 'sameAs' live?

2018-09-12 Thread ovasileva

ovasileva renamed this task from "[Spike, ?hrs] Where should Schema property 'sameAs' live?" to "[Spike, 8hrs] Where should Schema property 'sameAs' live?".
TASK DETAILhttps://phabricator.wikimedia.org/T204070EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ovasilevaCc: Deskana, Aklapper, Krenair, cscott, Imarlier, dr0ptp4kt, phuedx, Niedzielski, CKoerner_WMF, Elitre, Tbayer, Jdlrobson, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, LawExplorer, Winter, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T204070: [Spike, ?hrs] Where should Schema property 'sameAs' live?

2018-09-12 Thread Jdlrobson

Jdlrobson updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...** If so does it need security review?

== Outcome
* Evaluate all the options and cast a judgement on the best
* Send a wikitech-l email (including wikimedia DE) for discussion
* Draw a conclusion


TASK DETAILhttps://phabricator.wikimedia.org/T204070EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JdlrobsonCc: Deskana, Aklapper, Krenair, cscott, Imarlier, dr0ptp4kt, phuedx, Niedzielski, CKoerner_WMF, Elitre, Tbayer, Jdlrobson, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, LawExplorer, Winter, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

Addshore added a subscriber: Smalyshev.Addshore added a comment.

In T204024#4577066, @Eevans wrote:
An opaque k/v store won't allow anything but discrete lookup by entity ID, how are violations queried? In other words, this seems to only be a small part of the larger model, what does that look like, and why are we creating this separation (i.e. what problem does this solve)?

These constraint violations will be loaded in the Wikidata Query service and queryable via SPARQL there.
The constraints results are also needed in mediawiki to expose to the user in the UI and APIs.
There is the possibility that we will need to provide dumps of all constraint violations in order to ease the loading of data into WDQS servers that are starting from scratch, but @Smalyshev would have to chime in there.

Numbers regarding total number of entities, and the size of the values will be important of course, but perhaps most important will be some idea about access patterns. How frequently will entities be (over)written? How often read? I realize the answer to this is probably a distribution, and that this may involve some educated guess work.

Some numbers I can put here right now are:

Wikidata has 50 million entities, each of which can have a violations report. Assuming we keep all of the violations for a single entity in a single blob, which would be the current plan, that would mean 50 million things to be stored.
If we wanted to store constraint data for statements individually as @daniel suggested above each of the current 544 million statements would be storing their own blob. The blob will of course be smaller than the blob for the whole entity, but the number of entries is much larger.

There are currently around 20,000 edits per hour on wikidata.org, so the number of writes to the storage should be that or less. The plan will be to have the regular running of these constraints be performed by jobs (T204031), in which case there will likely be some deduplication if an entity is edited multiple times in a short period.
Reads: I'll have to have a more careful look
Size: I'll have to look at this too

What happens if constraint definitions change? Are we able to wholesale drop the older ones? Is the constraint check inlined on a miss, and is the latency (and additional load) under such circumstances acceptable? Or will some sort of transition be needed where we fall back to the older check when that's available, and replace them gradually?

As mentioned above the constraint reports will be created post edit. The plan to use the job queue means in theroy if we purged all of the data, well, it would slowly rebuild itself, but the constraint checks can take some time, hence the request for more persistent storage than we are currently getting with memcached.

I'll probably have more questions.

I look forward to themTASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Smalyshev, Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T204070: [Spike, ?hrs] Where should Schema property 'sameAs' live?

2018-09-12 Thread Jdlrobson

Jdlrobson updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...* Should this live in [[ https://www.mediawiki.org/wiki/Extension:GoogleRichCards | the Google Rich Cards extension ]]  ?
* Should it be a gadget?
* Should it live in a Wikibase extension?...TASK DETAILhttps://phabricator.wikimedia.org/T204070EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JdlrobsonCc: Deskana, Aklapper, Krenair, cscott, Imarlier, dr0ptp4kt, phuedx, Niedzielski, CKoerner_WMF, Elitre, Tbayer, Jdlrobson, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, LawExplorer, Winter, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T196884: Track usages of TermSqlIndex reading label and description data

2018-09-12 Thread WMDE-leszek

WMDE-leszek closed this task as "Resolved".WMDE-leszek claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T196884EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: WMDE-leszek, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T120847: Use BCP 47 conform language codes for the HTML attribute lang

gerritbot added a comment.
Change 460038 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code

https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T120847EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, gerritbotCc: Jdforrester-WMF, gerritbot, cscott, Lydia_Pintscher, Aklapper, Fomafix, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T106367: Generate BCP 47 conform language codes for the HTML attribute `lang`

gerritbot added a comment.
Change 460038 had a related patch set uploaded (by C. Scott Ananian; owner: C. Scott Ananian):
[mediawiki/core@master] Ensure LanguageCode::bcp47() returns a valid BCP 47 language code

https://gerrit.wikimedia.org/r/460038TASK DETAILhttps://phabricator.wikimedia.org/T106367EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: cscott, gerritbotCc: Jdforrester-WMF, Volker_E, Phispi, Jonas, gerritbot, Aklapper, Fomafix, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, MuhammadShuaib, LNDDYL, Psychoslave, Wikidata-bugs, aude, Arrbee, KartikMistry, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T204065: WikibaseLexeme CI broken (database errors)

2018-09-12 Thread Jdforrester-WMF

Jdforrester-WMF renamed this task from "Wikibase CI broken (database errors)" to "WikibaseLexeme CI broken (database errors)".
TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, Jdforrester-WMFCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Policy] T204070: [Spike, ?hrs] Where should Schema property 'sameAs' live?

2018-09-12 Thread Niedzielski

Niedzielski changed the edit policy from "Custom Policy" to "All Users".
TASK DETAILhttps://phabricator.wikimedia.org/T204070EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NiedzielskiCc: Deskana, Aklapper, Krenair, cscott, Imarlier, dr0ptp4kt, phuedx, Niedzielski, CKoerner_WMF, Elitre, Tbayer, Jdlrobson, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, LawExplorer, Winter, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T202897: Make multi-lingual captions on the File page editable using javascript

gerritbot added a comment.
Change 458212 abandoned by Cparle:
Work in progress

Reason:
Abandoned in favour of Idd103b080d52961b9ce2100efd6d4e7b20254fe6

https://gerrit.wikimedia.org/r/458212TASK DETAILhttps://phabricator.wikimedia.org/T202897EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Cparle, gerritbotCc: PDrouin-WMF, Ramsey-WMF, Aklapper, MarkTraceur, gerritbot, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T202896: Display multi-lingual captions on File page using php

gerritbot added a comment.
Change 456404 abandoned by Cparle:
Inject multi-lingual captions into the File page

Reason:
Abandoned in favour of Idd103b080d52961b9ce2100efd6d4e7b20254fe6

https://gerrit.wikimedia.org/r/456404TASK DETAILhttps://phabricator.wikimedia.org/T202896EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Cparle, gerritbotCc: PDrouin-WMF, Ramsey-WMF, Aklapper, MarkTraceur, gerritbot, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T202287: Implement new File page design using OOUI

Cparle closed subtask T202897: Make multi-lingual captions on the File page editable using _javascript_ as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T202287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: gerritbot, MarkTraceur, Aklapper, Ramsey-WMF, PDrouin-WMF, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T202287: Implement new File page design using OOUI

Cparle closed subtask T202896: Display multi-lingual captions on File page using php as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T202287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: gerritbot, MarkTraceur, Aklapper, Ramsey-WMF, PDrouin-WMF, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T202896: Display multi-lingual captions on File page using php

Cparle closed this task as "Declined".Cparle added a comment.
Merged with the parent ticketTASK DETAILhttps://phabricator.wikimedia.org/T202896EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: PDrouin-WMF, Ramsey-WMF, Aklapper, MarkTraceur, gerritbot, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T202897: Make multi-lingual captions on the File page editable using javascript

Cparle closed this task as "Declined".Cparle added a comment.
Merged with the parent ticketTASK DETAILhttps://phabricator.wikimedia.org/T202897EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CparleCc: PDrouin-WMF, Ramsey-WMF, Aklapper, MarkTraceur, gerritbot, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T202287: Implement new File page design using OOUI

gerritbot added a comment.
Change 460025 had a related patch set uploaded (by Cparle; owner: Cparle):
[mediawiki/extensions/WikibaseMediaInfo@master] Inject multi-lingual captions into the File page

https://gerrit.wikimedia.org/r/460025TASK DETAILhttps://phabricator.wikimedia.org/T202287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Cparle, gerritbotCc: gerritbot, MarkTraceur, Aklapper, Ramsey-WMF, PDrouin-WMF, Cparle, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, E1presidente, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204122: Normalize SPARQL queries

2018-09-12 Thread abian

abian added a comment.
Great! Then we can simply add a new button to the left toolbar to parse and stringify the query with no semantic changes. I guess the helper isn't missing anything from the list, just the point "There are no blank lines (except, perhaps, the last one)" because it adds a blank line between the prefixes and the rest of the query, but that's completely consistent and reasonable. It also replaces the short notation ;, which is fantastic to get a standard query.TASK DETAILhttps://phabricator.wikimedia.org/T204122EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abianCc: Lucas_Werkmeister_WMDE, abian, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

2018-09-12 Thread Eevans

Eevans added a comment.

In T204024#4576751, @daniel wrote:
This use case seems similar to caching parsoid HTML, which is done in RESTbase and backed by Cassandra. It's similar, because it's re-generated upon edit, and accessed from clients upon view, via an API. It's also similar in that losing this data is not absolutely critical, as it can be regenerated, but having to re-generate all of it may cause a problematic spike in load on application servers (and databases and the query service).

However, in contrast to the parsoid use case, information does not need to be stored for old revisions.

As to the model: the wikidata folks will have the details, but as far as I'm aware, it's a JSON blob for each Wikidata entity (items, properties, etc). Granularity could be increased to per-statement blobs.

Puring is, as far as I known, currently only done per edit of the subject. However, use cases for bulk purges exist (in particular, when constraints definitions change), but they are just ignored at the moment, as far as I know. I could be wrong about that, though.

If I understand the above correctly, we're saying that this is strictly key/value, where the key is an entity ID, and the value an opaque JSON blob. When the subject is edited, the value is overwritten with the most recent constraint check. And when the format of constraint definitions change, we need to be able to bulk purge previous entries in the obsolete format. Is this correct?

Some additional questions...

An opaque k/v store won't allow anything but discrete lookup by entity ID, how are violations queried? In other words, this seems to only be a small part of the larger model, what does that look like, and why are we creating this separation (i.e. what problem does this solve)?

I'll probably have more questions.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EevansCc: Eevans, daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204065: Wikibase CI broken (database errors)

gerritbot added a comment.
Change 460017 had a related patch set uploaded (by Daniel Kinzler; owner: Daniel Kinzler):
[mediawiki/extensions/WikibaseLexeme@master] DNM: check that Lexeme CI passes in MCR read-new mode.

https://gerrit.wikimedia.org/r/460017TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174047: Hide deprecated/unused fields on toolforge replica [MCR]

gerritbot added a comment.
Change 460016 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wiki replicas: depool labsdb1009 to run view updates

https://gerrit.wikimedia.org/r/460016TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Stashbot, jcrespo, gerritbot, Bstorm, Tgr, bd808, Anomie, Aklapper, daniel, AndyTan, Gaboe420, Zylc, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Jdforrester-WMF, Mbch331, Ltrlg, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174047: Hide deprecated/unused fields on toolforge replica [MCR]

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-12T13:24:19Z]  Reload haproxy on dbproxy1010 to repool labsdb1010 - T174047TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, jcrespo, gerritbot, Bstorm, Tgr, bd808, Anomie, Aklapper, daniel, AndyTan, Gaboe420, Zylc, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Jdforrester-WMF, Mbch331, Ltrlg, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T163642: Index Wikidata strings in statements for fulltext search

2018-09-12 Thread Multichill

Multichill added a comment.

In T163642#4503980, @Smalyshev wrote:
@Multichill I think with new description it is clearer what this is about.


Sorry, kind of missed this comment. I think this is clearer. Thanks for picking this up :-)TASK DETAILhttps://phabricator.wikimedia.org/T163642EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, MultichillCc: dcausse, Esc3300, ArthurPSmith, Stashbot, Lea_Lacroix_WMDE, gerritbot, Liuxinyu970226, Smalyshev, debt, aude, Lydia_Pintscher, Aklapper, Multichill, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204122: Normalize SPARQL queries

2018-09-12 Thread Lucas_Werkmeister_WMDE

Lucas_Werkmeister_WMDE added a comment.
If you relax the acceptance criteria (I haven’t checked your list in detail), then there is a way to automatically reformat SPARQL queries: edit them using the query helper. Anything you do in the query helper (e. g. add a limit and then remove it again) parses and then stringifies the query, effectively normalizing it. There have also recently been efforts to improve SPARQL.js’s stringification, see #58 – we should probably update our version.TASK DETAILhttps://phabricator.wikimedia.org/T204122EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, abian, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204122: Normalize SPARQL queries

2018-09-12 Thread abian

abian created this task.abian added a project: Wikidata Query UI.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONAs a user I want to have an option to automatically transform my SPARQL queries into a standard, consistent format (upper/lowercase, indentation, cosmetic spaces, line breaks, etc.) with the Wikidata Query UI in order to share them. As a Wikidata contributor I also want to have that option in order to apply the same format to all the queries on https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples.

Problem: There are too many ways of writing the same SPARQL query and this fact makes users write their queries using different criteria and copypasted fragments from several sources and examples. This makes a single query inconsistent with itself. On the other hand, there is no way of automatically reformatting SPARQL queries from the Wikidata Query UI and it's tedious to do it manually.

Example:

Screenshots/mockups:

BDD
GIVEN a SPARQL query
AND an option to reformat queries from the Wikidata Query UI
WHEN I click that option
THEN the SPARQL query is reformatted consistently

Acceptance criteria:

All parentheses, ( and ), when they aren't part of a literal or a comment, are preceded/followed by the same combination of whitespaces/tabs/line feeds/carriage returns. Opening and closing parentheses can follow different rules.
All brackets, [ and ], when they aren't part of a literal or a comment, are preceded/followed by the same combination of whitespaces/tabs/line feeds/carriage returns. Opening and closing brackets can follow different rules.
All braces, { and }, when they aren't part of a literal or a comment, are preceded/followed by the same combination of whitespaces/tabs/line feeds/carriage returns. Opening and closing braces can follow different rules.
All symbols ;, when linking triples with a common subject, are preceded/followed by the same combination of whitespaces/tabs/line feeds/carriage returns.
All SPARQL clauses, when used as such, are uppercase.
There is no more than one whitespace between SPARQL clauses.
There are no blank lines (except, perhaps, the last one).
Each level of nesting introduces an indentation with the same number of whitespaces.
The dot symbol, ., when finishing a triple, is always followed by a line feed/carriage return.
Other possible rules to get a standard, consistent format without modifying the semantics.

Open questions:TASK DETAILhttps://phabricator.wikimedia.org/T204122EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abianCc: abian, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Salgo60, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T185481: [Bug] Unexpected order of Lexeme DataModel elements in complex diffs

2018-09-12 Thread Tarrow

Tarrow claimed this task.Tarrow added a project: Wikidata-Editor-Experience-Improvements-Iteration7.
TASK DETAILhttps://phabricator.wikimedia.org/T185481EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TarrowCc: Addshore, Liuxinyu970226, Aklapper, Ladsgroup, Jonas, WMDE-leszek, Lydia_Pintscher, thiemowmde, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174047: Hide deprecated/unused fields on toolforge replica [MCR]

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-12T12:23:05Z]  Reload haproxy on dbproxy1010 to depool labsdb1010 - https://phabricator.wikimedia.org/T174047TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, jcrespo, gerritbot, Bstorm, Tgr, bd808, Anomie, Aklapper, daniel, AndyTan, Gaboe420, Zylc, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Jdforrester-WMF, Mbch331, Ltrlg, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174047: Hide deprecated/unused fields on toolforge replica [MCR]

gerritbot added a comment.
Change 460005 merged by Marostegui:
[operations/puppet@production] wiki replicas: depool labsdb1010 for view updates

https://gerrit.wikimedia.org/r/460005TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Stashbot, jcrespo, gerritbot, Bstorm, Tgr, bd808, Anomie, Aklapper, daniel, AndyTan, Gaboe420, Zylc, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Jdforrester-WMF, Mbch331, Ltrlg, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174047: Hide deprecated/unused fields on toolforge replica [MCR]

gerritbot added a comment.
Change 460005 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wiki replicas: depool labsdb1010 for view updates

https://gerrit.wikimedia.org/r/460005TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Stashbot, jcrespo, gerritbot, Bstorm, Tgr, bd808, Anomie, Aklapper, daniel, AndyTan, Gaboe420, Zylc, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Jdforrester-WMF, Mbch331, Ltrlg, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T194750: Deploy Structured Data on Commons baseline

daniel closed subtask T174036: Diffs page should show diffs and content from multiple slots [MCR] as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T194750EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Cparle, Aklapper, Abit, Ramsey-WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, JJMC89, Agabi10, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Matanya, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T174036: Diffs page should show diffs and content from multiple slots [MCR]

daniel closed this task as "Resolved".daniel moved this task from Epic to Done on the Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2) board.
TASK DETAILhttps://phabricator.wikimedia.org/T174036WORKBOARDhttps://phabricator.wikimedia.org/project/board/3374/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: CCicalese_WMF, gerritbot, Tgr, Anomie, Liuxinyu970226, TomT0m, Smalyshev, Lokal_Profil, -jem-, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, MGChecker, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

daniel added a comment.
This use case seems similar to caching parsoid HTML, which is done in RESTbase and backed by Cassandra. It's similar, because it's re-generated upon edit, and accessed from clients upon view, via an API.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: daniel, mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Eevans, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195828: Check constraints on Forms and Senses when loading Lexeme entity page

2018-09-12 Thread Tarrow

Tarrow added a comment.
I would agree with thisTASK DETAILhttps://phabricator.wikimedia.org/T195828EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDE, TarrowCc: Tarrow, Aklapper, Lucas_Werkmeister_WMDE, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203609: simplewiktionary provides wrong stats

2018-09-12 Thread Otourly

Otourly added a comment.
Hello,

How many Wiktionaries have the entry " ашәахь " ?

According to https://fr.wiktionary.org/wiki/%D0%B0%D1%88%D3%99%D0%B0%D1%85%D1%8C
I would like to answer only three;

But " I miss You "  tool gives us 17 except en one.TASK DETAILhttps://phabricator.wikimedia.org/T203609EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lea_Lacroix_WMDE, OtourlyCc: Otourly, Lea_Lacroix_WMDE, Lydia_Pintscher, GoranSMilovanovic, Aklapper, Pamputt, Lahi, Gq86, Cinemantique, QZanden, LawExplorer, Thibaut120094, jberkel, Psychoslave, Wikidata-bugs, aude, GPHemsley, Shizhao, Nemo_bis, Darkdadaah, Mbch331, Ltrlg, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204024: Store WikibaseQualityConstraint check data in an SQL table instead of in the cache

2018-09-12 Thread mobrovac

mobrovac added projects: Services (designing), Cassandra.mobrovac added a comment.
Could you describe the exact data that would be stored and its data model? I looked at T179849, but I see two different things there: in T179849#3770891 a resulting JSON blob is mentioned, but T179849#3778358 outlines a full SQL schema (with various indices) and I cannot relate the two.

If we are talking about a key/value JSON/blob storage, the Cassandra-powered key/value storage component might be a good fit for it, but at this point we need more info:


the aforementioned data model
access pattern: is it write-once, read multiple times, do overwrites happen, etc



In T204024#4573953, @Jonas wrote:
+1 for Cassandra, but one disadvantage might be that normal installation don't have the service.


Ideally, once we have the storage component in place in our infrastructure, alternative MW interfaces ought to be developed that allow smaller-scale installation to use something else, which should resolve this concern.TASK DETAILhttps://phabricator.wikimedia.org/T204024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Jonas, Lucas_Werkmeister_WMDE, Aklapper, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, merbst, LawExplorer, Agabi10, Eevans, Hardikj, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T174036: Diffs page should show diffs and content from multiple slots [MCR]

daniel closed subtask T174035: Allow the view action to show multiple slots [MCR] as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T174036EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: CCicalese_WMF, gerritbot, Tgr, Anomie, Liuxinyu970226, TomT0m, Smalyshev, Lokal_Profil, -jem-, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, MGChecker, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T174035: Allow the view action to show multiple slots [MCR]

daniel closed this task as "Resolved".daniel moved this task from Needs Review to Done on the Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2) board.
TASK DETAILhttps://phabricator.wikimedia.org/T174035WORKBOARDhttps://phabricator.wikimedia.org/project/board/3374/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Tgr, gerritbot, Aklapper, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Jdforrester-WMF, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T194347: [Bug] Language of Lemma Box doesn't appear after failed submit of Special:NewLexeme

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T194347EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tarrow, gerritbotCc: gerritbot, Aklapper, Lucas_Werkmeister_WMDE, Tarrow, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Luke081515, Wikidata-bugs, aude, Darkdadaah, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T194347: [Bug] Language of Lemma Box doesn't appear after failed submit of Special:NewLexeme

gerritbot added a comment.
Change 45 had a related patch set uploaded (by Tarrow; owner: Tarrow):
[mediawiki/extensions/WikibaseLexeme@master] Special:NewLexeme - Language code box visible after failed submit

https://gerrit.wikimedia.org/r/45TASK DETAILhttps://phabricator.wikimedia.org/T194347EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tarrow, gerritbotCc: gerritbot, Aklapper, Lucas_Werkmeister_WMDE, Tarrow, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Luke081515, Wikidata-bugs, aude, Darkdadaah, Mbch331, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204065: Wikibase CI broken (database errors)

gerritbot added a comment.
Change 459991 had a related patch set uploaded (by Addshore; owner: Addshore):
[integration/config@master] Add more Wikibase extensions to gatedextensions

https://gerrit.wikimedia.org/r/459991TASK DETAILhttps://phabricator.wikimedia.org/T204065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Jdforrester-WMF, greg, gerritbot, WMDE-leszek, Pablo-WMDE, hashar, TerraCodes, Liuxinyu970226, daniel, Addshore, Aklapper, Lucas_Werkmeister_WMDE, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

Addshore added a comment.

In T97368#4576510, @daniel wrote:
Another option would be to force this to go into APC instead of memcached.


Even with just a short life this would probably massively reduce the traffic hitting this one key.TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204109: Investigate some Wikdata write api queries taking over 30 seconds. (In EntityContent::collectValues ?)

Addshore created this task.Addshore added projects: Wikidata, Performance, wikidata-tech-focus.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONWhile investigating T97368#4576389 I noticed that the particular query that I was looking at took over 30 seconds to finish executing according to the api.log

... [W5jEGwpAAK4AAKd9eigV] ... API POST ... T=31327ms action="" format=json claim=Q56596767$BD081022-A6F4-4297-B7A2-484F2918094A property=P1932 value=%22A.%20Zucchetta%22 snaktype=value ... baserevid=744943483 bot=1

I recreated the edit to profile and the result can be seen on https://performance.wikimedia.org/xhgui/run/view?id=5b98dd85bb85446306a75aae

This appears to indicate that most of the time is spent in a single method in EntityContent:

Wikibase\EntityContent::collectValues@2
3,530,113 µs

Which is apparently called 30 times?
I might need someone from #performance-team, perhaps @Krinkle to make sure I am reading xhgui correctly

We should investigate this and see if we can speed this code path up.
It would be great to create a copy of this item on our test wiki to benchmark against.TASK DETAILhttps://phabricator.wikimedia.org/T204109EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Krinkle, Aklapper, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, LawExplorer, Vali.matei, Volker_E, Wikidata-bugs, aude, GWicke, Dinoguy1000, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

daniel added a comment.
Another option would be to force this to go into APC instead of memcached.TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T197658: Provide easy script to reset Blazegraph

2018-09-12 Thread despens

despens added a subscriber: Tarrow.despens added a comment.
After some consultation with @Tarrow


I removed the query service volume (starting from scratch with Blazegraph)
Updated all instances of wikibase.svc in docker-compose.yml to the full public domain name.
Entered the wdqs-updater container and ran the updating command again.


This created the following error:

# docker exec -it dockercomposefiles_wdqs-updater_1 bash
bash-4.4# nano
bash: nano: command not found
bash-4.4# /runUpdate.sh -- -v --start 2001010112 -t 2 --verify -W https://staging.catalog.rhizome.org/ -U http://staging.catalog.rhizome.org/ --init
wait-for-it.sh: waiting 120 seconds for staging.catalog.rhizome.org:80
wait-for-it.sh: staging.catalog.rhizome.org:80 is available after 0 seconds
wait-for-it.sh: waiting 120 seconds for wdqs.svc:
wait-for-it.sh: wdqs.svc: is available after 0 seconds
Updating via http://wdqs.svc:/bigdata/namespace/wdq/sparql
OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/wdqs/wdqs-updater_jvm_gc.pid202.log due to No such file or directory

Could not start Jolokia agent: java.net.BindException: Address in use
#logback.classic pattern: %d{HH:mm:ss.SSS} [%thread] %-5level %logger{36} - %msg%n
09:19:27.957 [main] INFO  org.wikidata.query.rdf.tool.Update - Checking where we left off
09:19:27.960 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - Checking for left off time from the updater
09:19:28.099 [main] INFO  o.w.query.rdf.tool.rdf.RdfRepository - Found left off time from the updater
09:19:28.101 [main] ERROR org.wikidata.query.rdf.tool.Update - Error during initialization.
java.lang.IllegalStateException: RDF store reports the last update time is before the minimum safe poll time.  You will have to reload from scratch or you might have missing data.
	at org.wikidata.query.rdf.tool.Update.buildRecentChangePollerChangeSource(Update.java:168)
	at org.wikidata.query.rdf.tool.Update.buildChangeSource(Update.java:141)
	at org.wikidata.query.rdf.tool.Update.main(Update.java:65)
Exception in thread "main" java.lang.IllegalStateException: RDF store reports the last update time is before the minimum safe poll time.  You will have to reload from scratch or you might have missing data.
	at org.wikidata.query.rdf.tool.Update.buildRecentChangePollerChangeSource(Update.java:168)
	at org.wikidata.query.rdf.tool.Update.buildChangeSource(Update.java:141)
	at org.wikidata.query.rdf.tool.Update.main(Update.java:65)

I'm now wondering if runUpdater.sh is starting up the updater service in general, which seems to be already running:
Could not start Jolokia agent: java.net.BindException: Address in use

The exception java.lang.IllegalStateException: RDF store reports the last update time is before the minimum safe poll time.  You will have to reload from scratch or you might have missing data. doesn't make sense to me... What should be reloaded? Isn't the command I issued all about ignoring the save poll time?

Blazegraph still seems to be empty, see test query.TASK DETAILhttps://phabricator.wikimedia.org/T197658EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: despensCc: Tarrow, Smalyshev, tk, Aklapper, Addshore, despens, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Gstupp, merbst, LawExplorer, Avner, Gehel, Abbe98, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T204105: CI failure: TypeError: Cannot read property 'widgets' of undefined

2018-09-12 Thread Nikerabbit

Nikerabbit created this task.Nikerabbit added a project: Wikidata.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONCX patches fail to merge quite regularly due to this error, see for example https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php70-docker/9954/console from https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContentTranslation/+/459893TASK DETAILhttps://phabricator.wikimedia.org/T204105EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NikerabbitCc: Aklapper, Arrbee, KartikMistry, Nikerabbit, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

Addshore added a comment.
So the logging I added only ran for 7 minutes, but already gives us some idea of the usage of this thing:

getPropertyInfoForDataType was not called at all. After a quick look through the code the only place this seems to be called is on https://www.wikidata.org/wiki/Special:ListProperties

addshore@mwlog1001:/srv/mw-log$ cat AdHocDebug.log |grep "dataType" | wc -l
0

getPropertyInfo (by ID) is far more heavily used. Some requests can apparently call this many thousands of times. The below request involves http://wikidata.org/wiki/Q56596767 which is pretty large:

addshore@mwlog1001:/srv/mw-log$ cat AdHocDebug.log |grep W5jEGwpAAK4AAKd9eigV |grep "for property" | wc -l
23100

It might make sense to have cache keys per property instead. That would result in around cache entries instead.
We would still have to cover the case of wanting to retrieve all property info at once, but the main key holding all data could remain, but the traffic to it would be greatly decreased.

The request above would have result in 11 separate calls to the cache:

addshore@mwlog1001:/srv/mw-log$ cat AdHocDebug.log |grep W5jEGwpAAK4AAKd9eigV |grep "for property" | cut -c 130- | sort | uniq -c
 10 P1433
 10 P1476
   9170 P1545
 91 P1932
  13636 P2093
 10 P31
 10 P356
 10 P433
 10 P478
133 P50
 10 P577

The number of calls to memcached essentially matches up to the number of properties referenced on the entity being touched.
I guess in the worst situation this would be ~6000, if an entity touched every single property, but this case would essentially never happen.
I'll try and get some numbers for the most number of properties used on a single entity.
If we were cleverer we could have some modifiable threshold to choose between hitting the cache of all property info vs the caches per property (if we go down this route)TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

2018-09-12 Thread ReleaseTaggerBot

ReleaseTaggerBot added a project: MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)).
TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T198493: php-lint in wikibase times out

hashar added a comment.
That is still going on.  For extensions and skins Quibble does:

composer validate --no-check-publish
composer install --no-progress --prefer-dist --profile -v
composer test

Wikibase composer.json has:

{
  "scripts": {
"test": [
  "composer validate --no-interaction",
  "parallel-lint . --exclude vendor --exclude node_modules --exclude .git",
  "phpcs -p -s",
  "minus-x check ."
}

Hence it runs parallel-lint on every single files which takes roughly 5 minutes by itself.

mediawiki/core has a similar issue, but Quibble passes the list of files changed in the patchset to the composer test command. This way it only lint altered files which is way faster.TASK DETAILhttps://phabricator.wikimedia.org/T198493EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: WMDE-leszek, Jonas, Jdforrester-WMF, Aklapper, hashar, cscott, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, thcipriani, Wikidata-bugs, aude, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-12T07:45:39Z]  Synchronized php-1.32.0-wmf.20/extensions/Wikibase/lib/includes/Store/: REVERT: Debug logging for T97368 [[gerrit:459905]] (duration: 00m 51s)TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

hashar updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...This will probably be a problem very similar to the one we had with `SiteList`, but having a static file cache isn't a possible solution here.


https://grafana.wikimedia.org/dashboard/db/t204083?orgId=1 shows the excessive traffic moving around the various memcached hosts for the last 1 year.TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2018-09-12T07:38:06Z]  Synchronized php-1.32.0-wmf.20/extensions/Wikibase/lib/includes/Store/: Debug logging for T97368 [[gerrit:459905]] (duration: 00m 53s)TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T97368: Investigate more efficient memcached solution for CacheAwarePropertyInfoStore

gerritbot added a comment.
Change 459905 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@wmf/1.32.0-wmf.20] PropertyInfoStore cache usage debug logging for wmf.20

https://gerrit.wikimedia.org/r/459905TASK DETAILhttps://phabricator.wikimedia.org/T97368EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jdforrester-WMF, Joe, mark, Addshore, jijiki, akosiaris, Krinkle, JanZerebecki, thiemowmde, aude, daniel, Aklapper, hoo, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, LawExplorer, Vali.matei, Lewizho99, Zppix, Maathavan, Wong128hk, Wikidata-bugs, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T204065: Wikibase CI broken (database errors)