[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
jcrespo added a comment. This is probably a symptom and not a cause, but I wanted to comment it anyway in case it was interesting: There seems to be higher than usual hhvm exceptions: https://logstash.wikimedia.org/goto/80fa5708f0a5e9da4be9f4630969b72e Most of those, at least the ones that are known, seem to be coming from the job queue, ChangeNotification and RefreshLinks, among others. They possibly are getting better lately.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173892: Setup dump for categories RDF representation
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T173892EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Jheald, Aklapper, Bugreporter, schana, gerritbot, PokestarFan, Smalyshev, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174047: Provide backwards compatibility views for toolforge replica [MCR]
bd808 edited projects, added Data-Services; removed Toolforge. TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Tbscho, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Gryllida, Ricordisamoa, Fabrice_Florin, Raymond, scfc, Mbch331, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop
EBernhardson added a comment. Parsing through the existing jobs with a script to measure the "real" number of purges that will be issued: P5916 I'm finding that on the wikis with the largest queues the majority of the jobs do nothing. The first 50k jobs for a few wikis: wikidatawiki: Empty: 44166 Jobs: 5834 Real: 12224 Per real job: 2.0953033938978 viwiki: Empty: 49271 Jobs: 729 Real: 4658 Per real job: 6.3895747599451 enwiki: Empty: 475 Jobs: 525 Real: 2370012 Per real job: 4514.3085714286 (only the first 1k on enwiki, because the avg purges per job is a bit crazy) Now, i suppose the recent change to not count recursive jobs as work items should help resolve this, but since these jobs are already done via deferred updates after closing the request that caused them to be created, maybe we could drastically cut down on the number of jobs inserted by resolving the first level of recursion directly when creating the job? That would skip inserting quite a few jobs and prevent them from being backlogged by the throttling. On the other hand this should have no actual effect on purge rates, other than reducing the number of jobs that do nothing in the job queue.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop
ReleaseTaggerBot edited projects, added MW-1.30-release-notes (WMF-deploy-2017-08-29 (1.30.0-wmf.16)); removed MW-1.30-release-notes (WMF-deploy-2017-08-22 (1.30.0-wmf.15)). TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
gerritbot added a comment. Change 373705 merged by jenkins-bot: [mediawiki/core@master] Disable rebound CDN purges for backlinks in HTMLCacheUpdateJob https://gerrit.wikimedia.org/r/373705TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
aaron added a comment. In T173710#3551156, @aaron wrote: Secondary purges where for dealing with replication lag scenarios, not lost purges. That was one extra purge (2X). One easy change I can see to not use CdnCacheUpdate from HtmlCacheUpdateJob (but still for the pages directly being edited). There is already processing delay anyway (and if there is none, there less likely to be replag, though not guaranteed), so there is less "de facto" use in a secondary purge for backlinks. That said, there is still some extension or underlying user pattern that I suspect is the underlying cause. Sacrificing rebound purges will cut purges in half, and it's easy to do, hence my patch above.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aaronCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
gerritbot added a comment. Change 373705 had a related patch set uploaded (by Aaron Schulz; owner: Aaron Schulz): [mediawiki/core@master] Disable rebound CDN purges for backlinks in HTMLCacheUpdateJob https://gerrit.wikimedia.org/r/373705TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
EBernhardson added a comment. Note necessarily a cause, but while looking into viwiki's backlog, i noticed this bot which seems to be creating an incredible number of purge jobs: https://vi.wikipedia.org/wiki/%C4%90%E1%BA%B7c_bi%E1%BB%87t:%C4%90%C3%B3ng_g%C3%B3p/TuanminhBot?uselang=enTASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
aaron added a comment. Secondary purges where for dealing with replication lag scenarios, not lost purges. That was one extra purge (2X). One easy change I can see to not use CdnCacheUpdate from HtmlCacheUpdateJob (but still for the pages directly being edited). There is already processing delay anyway (and if there is none, there less likely to be replag, though not guaranteed), so there is less "de facto" use in a secondary purge for backlinks.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aaronCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T172774: Review users being throttled
debt added subscribers: chelsyx, mpopov, debt.debt triaged this task as "Normal" priority.debt added a comment. @Gehel, would you be able to gather this data mentioned above in T172774#3510390 or should we bring @chelsyx or @mpopov to help?TASK DETAILhttps://phabricator.wikimedia.org/T172774EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: debt, mpopov, chelsyx, Aklapper, PokestarFan, Smalyshev, Gehel, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T168532: Check constraints on qualifiers and references
Ivan_A_Krestinin added a comment. About KrBot: current implementation fully ignores references and ranks. Qualifiers are checked only by https://www.wikidata.org/wiki/Q37845003 and https://www.wikidata.org/wiki/Q21510863. Also https://www.wikidata.org/wiki/Q19474404 constraint uses qualifiers if https://www.wikidata.org/wiki/Property:P4155 is specified. In other words: qualifiers are not checked too.TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ivan_A_KrestininCc: Ivan_A_Krestinin, gerritbot, PokestarFan, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
zhuyifei1999 added a comment. You mean Category:Pages_with_script_errors? Most of them look irrelevant to me, and my last null edit run only removed a few dozen pages iirc. I just edited a broken template and started the bot. Let's see how many can be removed.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff, zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
IKhitron added a comment. In T170039#3550856, @zhuyifei1999 wrote: In T170039#3550446, @IKhitron wrote: You can rerun it, starting filtering 14 first. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) There are 2,500 pages still there. I tried to nulledit one - it was removed from the category.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff, IKhitronCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
zhuyifei1999 added a comment. In T170039#3550446, @IKhitron wrote: You can rerun it, starting filtering 14 first. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff, zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
EBernhardson added a comment. In T173710#3550759, @Jdforrester-WMF wrote: Well, it's dropped by ~1.5M jobs in the last couple of hours and seems to be now more slowly draining the pool. Thats because i ran all the htmlCacheUpdate jobs on srwiki (~2M) with throttling disabled to see what kind of effect it has. The effect was to increase the global request rate to varnish by 3x which isn't sustainable to clear out the queues.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop
EBernhardson added a comment. Related previous tickets about purge problems/increases: T124418 T133821TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
Jdforrester-WMF added a comment. Well, it's dropped by ~1.5M jobs in the last couple of hours and seems to be now more slowly draining the pool.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
EBernhardson added a comment. Some background from bblack about the cache purge pipeline: A) Sometime in the distant past, the way it worked is that when an edit/delete POST request came in, at the end of the request (after sending the response), there's some kind of post-response hook for async processing (before handling another request), and that's where we sent out an immediate, singualr multicast purge towards varnish. B) Sometime later, at least some of the purging was moved to going through JobQueue. Relatedly, sometime later, someone decided to patch over the rare "lost purge" issue by having MediaWiki send out 3x copies of a given purge, spaced out by several seconds. I think this had to be via the jobqueue (as we wouldn't stall post-response handling to do that) C) I'm not sure, once those things were in play, whether an immediate post-response purge packet was still being sent, in addition to firing off a jobqueue thing for the delayed repeats. or if now all purges only went via jobqueue and never immediate. D) In addition, sometime since 2015 we've started doing a much "better" job of handling templates/transclusions/etc... where the invalidation of a template goes into jobqueue, and then jobqueue recurses through all the dependent objects that got touched and purges those too... we may have gone through multiple steps of "improvement" on this front, generating at each step far larger volumes of purge traffic And a suggestion from jynus about something that changed around that same time period, not sure how to check if this is related: 13:07 < jynus> interesting, that day is when commons article definition was changed 13:07 < jynus> https://commons.wikimedia.org/wiki/Commons:Village_pump/Archive/2017/07#Should_content_pages_consist_of_galleries_only_or_also_include_File_pages.3F The increase in purges happens between 8/7 08:00 and 8/8 08:00. Looking at the SAL log there is really nothing interesting in there, train didn't roll forward till later (and then only to group0). Something other than a deployment seems to have triggered this increase.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T173710: Job queue is increasing non-stop
EBernhardson added a subscriber: BBlack.EBernhardson added a comment. I've been doing some testing with the HTMLCacheUpdate jobs against relatively low traffic wikis with high numbers of jobs (viwki and srwiki with 2M and 600k page views/day respectively). It seems like almost the entirety of the time being taken is to allow for throttling. The throttling for this is currently set to 30 'work items' per second. I'm not entirely sure how that works out, but it looks like that's 30 work items per server running jobs(of which i count 15 in eqiad)? Giving us roughly 450 items per second, 27k per minute, 1.6M per hour, and 38M per day. Talking to @BBlack there is also a coninciding increase in purge jobs: https://grafana.wikimedia.org/dashboard/db/varnish-aggregate-client-status-codes?orgId=1&var-site=All&var-cache_type=upload&var-status_type=1&var-status_type=2&var-status_type=3&var-status_type=4&var-status_type=5&from=now-90d&to=now Basically around 8/8, the same time the job queue started growing, purge rates increased dramatically and stayed there. Somehow we are creating significantly more purges and they are probably linked to something deloyed around 8/8.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
IKhitron added a comment. In T170039#3550423, @zhuyifei1999 wrote: It's running, but getting tons of 500s. You can rerun it, starting filtering 14 first.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff, IKhitronCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
zhuyifei1999 added a comment. In T170039#3550411, @IKhitron wrote: Great. What about the category? It's running, but getting tons of 500s.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff, zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T170039: Pages display Lua error in mw.wikibase.entity.lua
MoritzMuehlenhoff closed this task as "Resolved".MoritzMuehlenhoff claimed this task.MoritzMuehlenhoff added a comment. In T170039#3550054, @Vachovec1 wrote: I recommend to close this bug as resolved (or should we wait until @Johan sends the messages?). Yeah, let's close this. Notifying people for cleanups is orthogonal.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoffCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
IKhitron added a comment. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) Great. What about the category?TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: IKhitronCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T170563: Conversations about Structured Data on Commons at Wikimedia Hackathon @ Wikimania 2017
SandraF_WMF added a parent task: T174078: Represent Structured Data on Commons at Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T170563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Romaine, Magnus, Ricordisamoa, VIGNERON, Susannaanas, PierreSelim, Lokal_Profil, PokestarFan, Abit, Astinson, SandraF_WMF, Aklapper, GoranSMilovanovic, Ivana_Isadora, QZanden, srishakatux, Acer, Jseddon, FloNight, Trizek-WMF, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Gryllida, Fabrice_Florin, Raymond, Rfarrand, Mbch331, Krenair, Keegan, jeremyb, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174078: Represent Structured Data on Commons at Wikimania 2017
SandraF_WMF added a subtask: T170563: Conversations about Structured Data on Commons at Wikimedia Hackathon @ Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T174078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
zhuyifei1999 added a comment. (Actually, everything besides Category: namespace on commons is clearTASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017
SandraF_WMF added a comment. Slides of the presentation: https://wikimania2017.wikimedia.org/wiki/File:Structured_Data_on_Commons_-_What_changes_are_coming%3F_-_presentation_at_Wikimania_2017.pdfTASK DETAILhttps://phabricator.wikimedia.org/T174079EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Blocker] T174078: Represent Structured Data on Commons at Wikimania 2017
SandraF_WMF created subtask T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T174078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017
SandraF_WMF created this task.SandraF_WMF added projects: Structured-Data-Commons, Community-Liaisons (Jul-Sep 2017), Wikidata. TASK DESCRIPTIONhttps://wikimania2017.wikimedia.org/wiki/Submissions/Structured_Commons:_what_changes_are_coming%3FTASK DETAILhttps://phabricator.wikimedia.org/T174079EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174078: Represent Structured Data on Commons at Wikimania 2017
SandraF_WMF created this task.SandraF_WMF added projects: Structured-Data-Commons, Community-Liaisons (Jul-Sep 2017).Herald added a subscriber: Aklapper.Herald added a project: Wikidata. TASK DESCRIPTIONConversations with Commons community members at the hackathon and beyond + 30-minute presentation during WikimaniaTASK DETAILhttps://phabricator.wikimedia.org/T174078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Tgr, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T170039: Pages display Lua error in mw.wikibase.entity.lua
zhuyifei1999 added a comment. Commons File: namespace is clear. The progress on Category: namespace is very slow due to T171392 & T173194TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
aaron added a comment. In T173710#3548223, @daniel wrote: In T173710#3547580, @aaron wrote: In other words, base jobs for entities that will divide up and purge all backlinks to the given entity. Note that each job has two entries. Wait - each job has two entries? You mean, there are duplicates inserted, and not pruned?... No, just two entries in the screen output of that script (STARTING and DONE).TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aaronCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
Johan added a comment. I don't think closing this needs to wait for Tech News to be sent out.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JohanCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
Vachovec1 added a comment. 24 hours after purging affected pages on cs-wiki, everything looks good: no new Lua errors (of type error in mw.wikibase.entity.lua) no more "phantom" Lua errors (false positives) in the "script errors" category no more "phantom" Lua errors (false positives) elsewhere (f. e. in the "pages where expansion depth is exceeded" category) I recommend to close this bug as resolved (or should we wait until @Johan sends the messages?).TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Vachovec1Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T123213: User i18n@wikidata getting 503 when viewing filtered watchlist
Mattflaschen-WMF added a comment. Do you get a long code inside brackets ([]) (likely next to "Fatal exception of type"? If so, please post that whole line, including the code.TASK DETAILhttps://phabricator.wikimedia.org/T123213EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mattflaschen-WMFCc: Mattflaschen-WMF, TTO, I18n, Aklapper, Reedy, StudiesWorld, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T165041: Create WikibaseServices container that makes of the container of DispatchingServices
gerritbot added a comment. Change 355450 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Renamed EntityDataRetrievalServiceFactory to DataAccessServices https://gerrit.wikimedia.org/r/355450TASK DETAILhttps://phabricator.wikimedia.org/T165041EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lydia_Pintscher, daniel, WMDE-leszek, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T165047: Use WikibaseServices in Client and Repo
gerritbot added a comment. Change 353317 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Use WikibaseServices in Client and Repo instead of EntityDataRetrievalServiceFactory https://gerrit.wikimedia.org/r/353317TASK DETAILhttps://phabricator.wikimedia.org/T165047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lydia_Pintscher, daniel, WMDE-leszek, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
EBernhardson added a comment. In T173710#3547826, @Ladsgroup wrote: The jobqueue has slowed down but still increasing, and cirrusSearchIncomingLinkCount still increases the jobqueue with rate of 100 jobs/second. Cirrus link counting jobs are probably just a symptom of the backlog of refresh links jobs. Basically every time a refresh links job finishes it queues up a cirrus job to propogate the link updates from mysql to cirrussearch. Note also that the count of refresh links jobs in the queue is relatively undercounted, because an individual refresh links job may re-queue itself many times as it recursively distributes the work contained within it. So a single refresh links root job will turn into quite a few cirrus link counting jobs.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T141859: [Task] Contemporary Constraint check
abian added a comment. In T141859#3549363, @Lucas_Werkmeister_WMDE wrote: (Aside: that first query should probably include “work period (start)”. It seems to be missing a P279 statement.) I’m not convinced that this is the best approach. Do we really need all the properties for every constraint? I feel like it might make more sense to define the properties to be used on the constraint, and to limit them to a smaller set: for instance, perhaps a contemporary constraint check for “spouse” should only take into account “date of birth” and “date of death”, not “service entry” or “date of official closure”. Indeed, but, on the one hand, this constraint is applied to many different properties, even P31 and P279. On the other hand, I see no undesirable effects when considering more subproperties than necessary if the difference in computational cost is negligible (no idea for now, but it shouldn't be huge). By defining what subproperties should be considered for the constraint for each property, we are also introducing redundancies and potential inconsistencies with other constraints, mainly with conflicts-with constraint, apart from all the problems mentioned above. An algorithm that gives us the same outputs as another in almost the same time and with fewer inputs is a better algorithm. If the difference in computational cost wasn't relevant here (no idea if it will finally be or not) and, in addition, the algorithm with more inputs (qualifiers) brings us all the considered problems, I have clear which is the best option. But consensus should decide, not my point of view... 😇TASK DETAILhttps://phabricator.wikimedia.org/T141859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abianCc: Ivan_A_Krestinin, PokestarFan, Lucas_Werkmeister_WMDE, Lydia_Pintscher, Wikibase-Quality-Constraints, abian, Aklapper, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, Agabi10, Izno, Wikidata-bugs, aude, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T174025: Implement MCR revision retrieval legacy version
daniel claimed this task.daniel moved this task from Inbox to Short in progress on the MediaWiki-Platform-Team board. TASK DETAILhttps://phabricator.wikimedia.org/T174025WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T174039: Implement MCR page update legacy version
daniel claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T174023: Implement MCR storage layer
daniel moved this task from Inbox to Epic in progress on the MediaWiki-Platform-Team board.daniel claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T174023WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T174025: Implement MCR revision retrieval legacy version
daniel renamed this task from "Implement MCR revision retrieval legacy dummy" to "Implement MCR revision retrieval legacy version". TASK DETAILhttps://phabricator.wikimedia.org/T174025EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T174039: Implement MCR page update legacy version
daniel renamed this task from "Implement MCR page update legacy dummy" to "Implement MCR page update legacy version". TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174023: Implement MCR storage layer
daniel added a parent task: T174044: Deploy MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174023EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174044: Deploy MCR storage layer
daniel added a subtask: T174023: Implement MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Marostegui, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Krenair, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T141859: [Task] Contemporary Constraint check
Lucas_Werkmeister_WMDE added a comment. (Aside: that first query should probably include “work period (start)”. It seems to be lacking a P279 statement.) I’m not convinced that this is the best approach. Do we really need all the properties for every constraint? I feel like it might make more sense to define the properties to be used on the constraint, and to limit them to a smaller set: for instance, perhaps a contemporary constraint check for “spouse” should only take into account “date of birth” and “date of death”, not “service entry” or “date of official closure”.TASK DETAILhttps://phabricator.wikimedia.org/T141859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abian, Lucas_Werkmeister_WMDECc: Ivan_A_Krestinin, PokestarFan, Lucas_Werkmeister_WMDE, Lydia_Pintscher, Wikibase-Quality-Constraints, abian, Aklapper, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, Agabi10, Izno, Wikidata-bugs, aude, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
daniel added a comment. Now let's see what the reduced batch size does. It may actually make the problem worse, but increasing the total number of jobs. Let's hope it makes it better, by reducing the time job runners are blocked...TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, Reedy, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T141859: [Task] Contemporary Constraint check
abian added a comment. In T141859#3546806, @Ivan_A_Krestinin wrote: All other constraints store settings as qualifiers on property page. I think it is good practice make all constraints as similar as possible. This makes implementation and understanding of full constraints system easier. This is actually a similar case to the one of P31/P279, and not so similar to the rest of constraints: we don't want to define information about the properties having the constraint, but about what property in Wikidata represents something. We have two trivial parent properties, P580 and P582, whose URIs are, presumably, stable and won't change, as if they were P31 and P279. Knowing P580 and P582, and knowing that P1647 is the equivalent of P279 for properties, we can also load all the corresponding subproperties (two sets that can change, generally grow up). This keeps a correct ontology, avoids duplicating a lot of information (repeating the same qualifiers between properties, repeating which the subproperties of P580 and P582 are, etc.), avoids inconsistencies, makes maintaining the constraint easier and saves some effort to the community by not having to update anything related to the constraint when a subproperty of P580 or P582 is created, defined or deprecated.TASK DETAILhttps://phabricator.wikimedia.org/T141859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abianCc: Ivan_A_Krestinin, PokestarFan, Lucas_Werkmeister_WMDE, Lydia_Pintscher, Wikibase-Quality-Constraints, abian, Aklapper, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, Agabi10, Izno, Wikidata-bugs, aude, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T135461: Exploratory: Making Wikidata content accessible on wikimediafoundation.org
Liuxinyu970226 added a comment. I don't think that this should happen per T166782#3309406, this wiki is not maintained after 2013.TASK DETAILhttps://phabricator.wikimedia.org/T135461EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Liuxinyu970226Cc: PokestarFan, Liuxinyu970226, Lydia_Pintscher, aude, Heather, JAnstee_WMF, Aklapper, Varnent, Zppix, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174045: DB schema migration for MCR
daniel created subtask T174047: Provide backwards compatibility views for toolforge replica [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Luke081515, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Ltrlg, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174047: Provide backwards compatibility views for toolforge replica [MCR]
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, Toolforge. TASK DESCRIPTIONWe should try to avoid breaking tools when we roll out the new DB schema. To that end, we should provide views that emulate the legacy DB schema on Toolforge.TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Tbscho, Acer, Freddy2001, JJMC89, TerraCodes, Susannaanas, Izno, Luke081515, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Gryllida, jayvdb, Ricordisamoa, Fabrice_Florin, Raymond, scfc, coren, Mbch331, valhallasw, Tgr, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua
Vachovec1 added a comment.
@Johan : I would reccomend something like this:
Lua executing entity = mw.wikibase.getEntity() or entity = mw.wikibase.getEntityObject() caused problems resulting in a big red error message(s) announcing a Lua error in mw.wikibase.entity.lua. This has now been fixed so we don't get new errors, but all affected pages still need need to be fixed.
To do this, you can do one of the following things to all pages in your local {{int:scribunto-common-error-category}} category and all pages you find when you search for mw.wikibase.entity.lua in all namespaces (many affected pages are NOT properly categorized):
Purge all affected pages
Use Pywikibot touch on all affected pages
Run the script in T170039#347375599
Or rebuild any other way
A lot of affected pages were NOT listed in the script errors categories. Instead of this, the categories were/are full of false positives. Nevertheless, those pages need to be purged too, otherwise they will be stuck in the category until edited or their cache will be renewed.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Vachovec1Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa, Mr.Ibrahem, Ladsgroup, eranroz, IKhitron, Kipod, zhuyifei1999, PokestarFan, hoo, Anomie, gerritbot, thiemowmde, Salgo60, AnotherLadsgroup, RolandUnger, Larske, Arbnos, daniel, putnik, Framawiki, Zebulon84, Thibaut120094, TerraCodes, Jay8g, Liuxinyu970226, aude, Vachovec1, Zdzislaw, ValterVB, Agabi10, Ankry, Jarekt, Lydia_Pintscher, matej_suchanek, JohnBlackburne, Aklapper, Johnuniq, Cosine02, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, JJMC89, Maathavan, SundanceRaphael, Izno, Luke081515, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, jayvdb, MrStradivarius, Arlolra, TheDJ, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173850: Possible WMF deployed extension PHP 7 issues
Ottomata edited projects, added Analytics-Kanban; removed Analytics. TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, Krinkle, MaxSem, Krenair, Reedy, Minilexikon, Timoavax79, GoranSMilovanovic, TheDragonFire, Maosef, 45Jayjay1969, QZanden, EBjune, Orienteerix, EnricoCNC, Litanwei, Avner, Ddproxy, debt, TerraCodes, SundanceRaphael, Reasno, Gehel, Debenben, Jseddon, JGirault, gabriel-wmde, phabyogi, FloNight, DStrine, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, Izno, SBisson, Matiia, ferdbold, lxbarth, Wong128hk, Luke081515, Nirmos, Planemad, Wikidata-bugs, Snowolf, Prod, Hydriz, aude, fredw, SPQRobin, AndyRussG, Ebe123, Pcoombe, Huji, Physikerwelt, Pkra, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Arrbee, scfc, KartikMistry, Se4598, Jackmcbarn, Mbch331, Jay8g, Ltrlg, Joe, jeremyb, Legoktm, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174028: Finalize DB schema for content meta-data
daniel added a parent task: T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174045: DB schema migration for MCR
daniel added subtasks: T174028: Finalize DB schema for content meta-data , T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Luke081515, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Ltrlg, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR
daniel added a parent task: T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174045: DB schema migration for MCR
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team, Schema-change. TASK DESCRIPTIONSee schema migration plan: https://www.mediawiki.org/wiki/Multi-Content_Revisions/Content_Meta-Data#Migration_PlanTASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Luke081515, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Ltrlg, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174044: Deploy MCR storage layer
daniel created subtask T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Marostegui, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Krenair, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174043: Deploy Multi-Content Revisions
daniel created subtask T174044: Deploy MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174044: Deploy MCR storage layer
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team, Blocked-on-schema-change. TASK DESCRIPTIONTrack deployment of the storage layer component of MCR. This particularly covers the necessary DB schema migration.TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Marostegui, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Krenair, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174043: Deploy Multi-Content Revisions
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team.Herald added a subscriber: Aklapper. TASK DESCRIPTIONTrack deployment of MCRTASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174022: Implement multi-content revisions
daniel added a parent task: T174043: Deploy Multi-Content Revisions. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174043: Deploy Multi-Content Revisions
daniel added a subtask: T174022: Implement multi-content revisions. TASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174038: Implement MCR page update interface
daniel added subtasks: T161671: Compacting the revision table, T166732: Refactor comment storage in the database and abstract access in MediaWiki. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174026: Implement MCR content meta-data storage service
daniel added a parent task: T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR
daniel added a parent task: T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174038: Implement MCR page update interface
daniel added subtasks: T174026: Implement MCR content meta-data storage service, T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174039: Implement MCR page update legacy dummy
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONImplement the new MCR page update interface on top of the old database schema. Only the main slot is supported.TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174038: Implement MCR page update interface
daniel created subtask T174039: Implement MCR page update legacy dummy. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T174025: Implement MCR revision retrieval legacy dummy
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONImplement the new MCR revision retrieval interface on top of the old database schema. Only the //main// slot is supported.TASK DETAILhttps://phabricator.wikimedia.org/T174025EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174038: Implement MCR page update interface
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis ticket covers the implementation of a mechanism for creating new page revisions with multiple content objects. The functionality provided is roughly equivalent to the doEditContent functionality offered by the Revision class. The Revision class should remain a thin layer on top of the new revision retrieval interface, as a legacy proxy. Design draft: https://www.mediawiki.org/wiki/Multi-Content_Revisions/Page_Update_ControllerTASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174023: Implement MCR storage layer
daniel created subtask T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174023EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T174024: Implement MCR revision retrieval interface
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONThe revision retrieval interface allows all relevant information for a given page revision to be retrieved. The information provided must be sufficient to locate and load all content objects that belong to the revision (slots). Access to revision meta-data such as the edit comment is also covered by this ticket. The functionality provided is roughly equivalent to the retrieve/read functionality offered by the Revision class. The Revision class should remain a thin layer on top of the new revision retrieval interface, as a legacy proxy. Design draft: https://www.mediawiki.org/wiki/Multi-Content_Revisions/Revision_RetrievalTASK DETAILhttps://phabricator.wikimedia.org/T174024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions
daniel created subtask T174037: Implement single-slot UI [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T174037: Implement single-slot UI [MCR]
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONAll UI actions/views that need to be updated to support multiple content objects should also have a "single-slot" mode, triggered by providing the //slot// argument in the URL. With that argument set, the user would only see the content of a single slot for the view action, would be able to edit a single slot with edit action, etc. See https://www.mediawiki.org/wiki/Multi-Content_Revisions/Views#Single-Slot_UITASK DETAILhttps://phabricator.wikimedia.org/T174037EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174037: Implement single-slot UI [MCR]
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONAll UI actions/views that need to be updated to support multiple content objects should also have a "single-slot" mode, triggered by providing the slot argument in the URL. With that argument set, the user would only see the content of a single slot for the view action, would be able to edit a single slot with edit action, etc.TASK DETAILhttps://phabricator.wikimedia.org/T174037EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174035: Allow the view action to show multiple slots [MCR]
daniel removed a project: Epic. TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174035: Allow the view action to show multiple slots [MCR]
daniel created subtask T174036: Allow the diffs to show multiple slots [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174036: Allow the diffs to show multiple slots [MCR]
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONWhen showing a diff between revisions of a page that has multiple streams (multiple slots per revision), a diff for each slot needs to be show. See https://www.mediawiki.org/wiki/Multi-Content_Revisions/Views#DiffsTASK DETAILhttps://phabricator.wikimedia.org/T174036EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174035: Allow the view action to show multiple slots [MCR]
daniel created this task.daniel added projects: Wikidata, Epic, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONWhen viewing a wiki page (revision), the content of all slots should be shown. Control over the layout should lie with the ContentHandler of the main slot. See https://www.mediawiki.org/wiki/Multi-Content_Revisions/Views#View_Action for notes.TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions
daniel created subtask T174035: Allow the view action to show multiple slots [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-08-24T14:44:42Z] Synchronized php-1.30.0-wmf.15/extensions/Wikidata/extensions/Wikibase/client/includes/Changes/WikiPageUpdater.php: Reduce batch size in WikiPageUpdater (T173710) (duration: 00m 48s)TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, Reedy, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions
daniel created subtask T174033: Refactor EditPage to allow multiple slots to be edited atomically [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174032: Make relevant API modules aware of MCR
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output. See https://www.mediawiki.org/wiki/Multi-Content_Revisions/Web_API for some initial thoughtsTASK DETAILhttps://phabricator.wikimedia.org/T174032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions
daniel created subtask T174032: Make relevant API modules aware of MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
gerritbot added a comment. Change 373551 merged by jenkins-bot: [mediawiki/extensions/Wikidata@wmf/1.30.0-wmf.15] Hotfix: Reduce batch size in WikiPageUpdater https://gerrit.wikimedia.org/r/373551TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, Reedy, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174031: Support MCR in XML dump format
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONPlaceholder ticket for MCR support in dumps, as described in https://www.mediawiki.org/wiki/Multi-Content_Revisions/DumpsTASK DETAILhttps://phabricator.wikimedia.org/T174031EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions
daniel created subtask T174031: Support MCR in XML dump format. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174028: Finalize DB schema for content meta-data
daniel added a parent task: T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR
daniel added a subtask: T174028: Finalize DB schema for content meta-data . TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174024: Implement MCR revision retrieval interface
daniel created subtask T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174030: Implement DB schema migration tools for MCR
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis ticket covers all tools needed to convert from the old 1 table schema for revisions to the new 3 table schema using the migration plan described in https://www.mediawiki.org/wiki/Multi-Content_Revisions/Content_Meta-Data#Migration_PlanTASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T171607: Main snak and reference snaks do not include hash in JSON output
Lucas_Werkmeister_WMDE added a comment. To summarize an IRC discussion (in an unlogged channel :/ ) – We certainly don’t need a mixture of having hashes for some snaks but not others. To this end, I’ve created WikibaseDataModelSerialization#233, and once version 2.5.0 of that library is released we should use SerializerFactory::OPTION_SERIALIZE_SNAKS_WITHOUT_HASH. We definitely don’t want hashes in the database, and it’s debatable whether we want them in the JSON dumps. (Perhaps we want two kinds of JSON dumps – see T174029.) Elsewhere, we can probably include the hashes. It might not even need to be configurable. (Daniel: “I’m okay with always including the hashes in API output, and output of Special:EntityData.”) This should be announced as, at least, a significant change. If we go for dumps without hashes, it’s a breaking change, because qualifier snaks used to have hashes. TASK DETAILhttps://phabricator.wikimedia.org/T171607EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Addshore, Aklapper, daniel, Lucas_Werkmeister_WMDE, PokestarFan, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174029: Two kinds of JSON dumps?
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONOn the #wikimedia-de-tech IRC channel, the idea of having two kinds of JSON dumps came up: compact dumps and fully expanded dumps. One difference would be that full dumps would include snak hashes (see T171607: Main snak and reference snaks do not include hash in JSON output), but there might be other things we could include/exclude as well. I’ll leave this for the CC’d people to discuss :)TASK DETAILhttps://phabricator.wikimedia.org/T174029EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: ArielGlenn, hoo, daniel, Addshore, Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T174026: Implement MCR content meta-data storage service
daniel created subtask T174028: Finalize DB schema for content meta-data . TASK DETAILhttps://phabricator.wikimedia.org/T174026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T174028: Finalize DB schema for content meta-data
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis task covers the specification of the DB schema for content meta-data. Design draft: https://www.mediawiki.org/wiki/Multi-Content_Revisions/Content_Meta-Data#Database_SchemaTASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T174024: Implement MCR revision retrieval interface
daniel added subtasks: T166732: Refactor comment storage in the database and abstract access in MediaWiki, T161671: Compacting the revision table. TASK DETAILhttps://phabricator.wikimedia.org/T174024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Anomie, Mbch331, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
gerritbot added a comment. Change 373551 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [mediawiki/extensions/Wikidata@wmf/1.30.0-wmf.15] Hotfix: Reduce batch size in WikiPageUpdater https://gerrit.wikimedia.org/r/373551TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, Harej, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, Emijrp, gerritbot, Reedy, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
