[Wikidata-bugs] [Maniphest] [Updated] T173892: Setup dump for categories RDF representation

2017-08-24 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T173892EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Jheald, Aklapper, Bugreporter, schana, gerritbot, PokestarFan, Smalyshev, Lordiis, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Updated] T174047: Provide backwards compatibility views for toolforge replica [MCR]

2017-08-24 Thread bd808
bd808 edited projects, added Data-Services; removed Toolforge. TASK DETAILhttps://phabricator.wikimedia.org/T174047EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Tbscho, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. Parsing through the existing jobs with a script to measure the "real" number of purges that will be issued: P5916 I'm finding that on the wikis with the largest queues the majority of the jobs do nothing. The first 50k jobs for a few wikis: wikidatawiki: Empty: 44166

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-08-24 Thread ReleaseTaggerBot
ReleaseTaggerBot edited projects, added MW-1.30-release-notes (WMF-deploy-2017-08-29 (1.30.0-wmf.16)); removed MW-1.30-release-notes (WMF-deploy-2017-08-22 (1.30.0-wmf.15)). TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 373705 merged by jenkins-bot: [mediawiki/core@master] Disable rebound CDN purges for backlinks in HTMLCacheUpdateJob https://gerrit.wikimedia.org/r/373705TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread aaron
aaron added a comment. In T173710#3551156, @aaron wrote: Secondary purges where for dealing with replication lag scenarios, not lost purges. That was one extra purge (2X). One easy change I can see to not use CdnCacheUpdate from HtmlCacheUpdateJob (but still for the pages directly being edited).

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 373705 had a related patch set uploaded (by Aaron Schulz; owner: Aaron Schulz): [mediawiki/core@master] Disable rebound CDN purges for backlinks in HTMLCacheUpdateJob https://gerrit.wikimedia.org/r/373705TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. Note necessarily a cause, but while looking into viwiki's backlog, i noticed this bot which seems to be creating an incredible number of purge jobs: https://vi.wikipedia.org/wiki/%C4%90%E1%BA%B7c_bi%E1%BB%87t:%C4%90%C3%B3ng_g%C3%B3p/TuanminhBot?uselang=enTASK

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread aaron
aaron added a comment. Secondary purges where for dealing with replication lag scenarios, not lost purges. That was one extra purge (2X). One easy change I can see to not use CdnCacheUpdate from HtmlCacheUpdateJob (but still for the pages directly being edited). There is already processing delay

[Wikidata-bugs] [Maniphest] [Triaged] T172774: Review users being throttled

2017-08-24 Thread debt
debt added subscribers: chelsyx, mpopov, debt.debt triaged this task as "Normal" priority.debt added a comment. @Gehel, would you be able to gather this data mentioned above in T172774#3510390 or should we bring @chelsyx or @mpopov to help?TASK DETAILhttps://phabricator.wikimedia.org/T172774EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T168532: Check constraints on qualifiers and references

2017-08-24 Thread Ivan_A_Krestinin
Ivan_A_Krestinin added a comment. About KrBot: current implementation fully ignores references and ranks. Qualifiers are checked only by https://www.wikidata.org/wiki/Q37845003 and https://www.wikidata.org/wiki/Q21510863. Also https://www.wikidata.org/wiki/Q19474404 constraint uses qualifiers if

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread zhuyifei1999
zhuyifei1999 added a comment. You mean Category:Pages_with_script_errors? Most of them look irrelevant to me, and my last null edit run only removed a few dozen pages iirc. I just edited a broken template and started the bot. Let's see how many can be removed.TASK

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread IKhitron
IKhitron added a comment. In T170039#3550856, @zhuyifei1999 wrote: In T170039#3550446, @IKhitron wrote: You can rerun it, starting filtering 14 first. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) There are 2,500 pages

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread zhuyifei1999
zhuyifei1999 added a comment. In T170039#3550446, @IKhitron wrote: You can rerun it, starting filtering 14 first. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. In T173710#3550759, @Jdforrester-WMF wrote: Well, it's dropped by ~1.5M jobs in the last couple of hours and seems to be now more slowly draining the pool. Thats because i ran all the htmlCacheUpdate jobs on srwiki (~2M) with throttling disabled to see what kind of

[Wikidata-bugs] [Maniphest] [Updated] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. Related previous tickets about purge problems/increases: T124418 T133821TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: BBlack, Peachey88, Liuxinyu970226,

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread Jdforrester-WMF
Jdforrester-WMF added a comment. Well, it's dropped by ~1.5M jobs in the last couple of hours and seems to be now more slowly draining the pool.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. Some background from bblack about the cache purge pipeline: A) Sometime in the distant past, the way it worked is that when an edit/delete POST request came in, at the end of the request (after sending the response), there's some kind of post-response hook for async

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a subscriber: BBlack.EBernhardson added a comment. I've been doing some testing with the HTMLCacheUpdate jobs against relatively low traffic wikis with high numbers of jobs (viwki and srwiki with 2M and 600k page views/day respectively). It seems like almost the entirety of the

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread IKhitron
IKhitron added a comment. In T170039#3550423, @zhuyifei1999 wrote: It's running, but getting tons of 500s. You can rerun it, starting filtering 14 first.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread zhuyifei1999
zhuyifei1999 added a comment. In T170039#3550411, @IKhitron wrote: Great. What about the category? It's running, but getting tons of 500s.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MoritzMuehlenhoff,

[Wikidata-bugs] [Maniphest] [Closed] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread MoritzMuehlenhoff
MoritzMuehlenhoff closed this task as "Resolved".MoritzMuehlenhoff claimed this task.MoritzMuehlenhoff added a comment. In T170039#3550054, @Vachovec1 wrote: I recommend to close this bug as resolved (or should we wait until @Johan sends the messages?). Yeah, let's close this. Notifying people

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread IKhitron
IKhitron added a comment. In T170039#3550379, @zhuyifei1999 wrote: (Actually, everything besides Category: namespace on commons is clear) Great. What about the category?TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T170563: Conversations about Structured Data on Commons at Wikimedia Hackathon @ Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF added a parent task: T174078: Represent Structured Data on Commons at Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T170563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Romaine, Magnus, Ricordisamoa, VIGNERON,

[Wikidata-bugs] [Maniphest] [Updated] T174078: Represent Structured Data on Commons at Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF added a subtask: T170563: Conversations about Structured Data on Commons at Wikimedia Hackathon @ Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T174078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread zhuyifei1999
zhuyifei1999 added a comment. (Actually, everything besides Category: namespace on commons is clearTASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww,

[Wikidata-bugs] [Maniphest] [Commented On] T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF added a comment. Slides of the presentation: https://wikimania2017.wikimedia.org/wiki/File:Structured_Data_on_Commons_-_What_changes_are_coming%3F_-_presentation_at_Wikimania_2017.pdfTASK DETAILhttps://phabricator.wikimedia.org/T174079EMAIL

[Wikidata-bugs] [Maniphest] [Blocker] T174078: Represent Structured Data on Commons at Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF created subtask T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017. TASK DETAILhttps://phabricator.wikimedia.org/T174078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, SandraF_WMF,

[Wikidata-bugs] [Maniphest] [Created] T174079: Prepare and give presentation about Structured Data on Commons at Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF created this task.SandraF_WMF added projects: Structured-Data-Commons, Community-Liaisons (Jul-Sep 2017), Wikidata. TASK DESCRIPTIONhttps://wikimania2017.wikimedia.org/wiki/Submissions/Structured_Commons:_what_changes_are_coming%3FTASK

[Wikidata-bugs] [Maniphest] [Created] T174078: Represent Structured Data on Commons at Wikimania 2017

2017-08-24 Thread SandraF_WMF
SandraF_WMF created this task.SandraF_WMF added projects: Structured-Data-Commons, Community-Liaisons (Jul-Sep 2017).Herald added a subscriber: Aklapper.Herald added a project: Wikidata. TASK DESCRIPTIONConversations with Commons community members at the hackathon and beyond + 30-minute

[Wikidata-bugs] [Maniphest] [Updated] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread zhuyifei1999
zhuyifei1999 added a comment. Commons File: namespace is clear. The progress on Category: namespace is very slow due to T171392 & T173194TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zhuyifei1999Cc: Johan,

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread aaron
aaron added a comment. In T173710#3548223, @daniel wrote: In T173710#3547580, @aaron wrote: In other words, base jobs for entities that will divide up and purge all backlinks to the given entity. Note that each job has two entries. Wait - each job has two entries? You mean, there are

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread Johan
Johan added a comment. I don't think closing this needs to wait for Tech News to be sent out.TASK DETAILhttps://phabricator.wikimedia.org/T170039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JohanCc: Johan, MoritzMuehlenhoff, ksmith, 4shadoww, Dvorapa,

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread Vachovec1
Vachovec1 added a comment. 24 hours after purging affected pages on cs-wiki, everything looks good: no new Lua errors (of type error in mw.wikibase.entity.lua) no more "phantom" Lua errors (false positives) in the "script errors" category no more "phantom" Lua errors (false positives) elsewhere

[Wikidata-bugs] [Maniphest] [Commented On] T123213: User i18n@wikidata getting 503 when viewing filtered watchlist

2017-08-24 Thread Mattflaschen-WMF
Mattflaschen-WMF added a comment. Do you get a long code inside brackets ([]) (likely next to "Fatal exception of type"? If so, please post that whole line, including the code.TASK DETAILhttps://phabricator.wikimedia.org/T123213EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T165041: Create WikibaseServices container that makes of the container of DispatchingServices

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 355450 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Renamed EntityDataRetrievalServiceFactory to DataAccessServices https://gerrit.wikimedia.org/r/355450TASK DETAILhttps://phabricator.wikimedia.org/T165041EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T165047: Use WikibaseServices in Client and Repo

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 353317 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Use WikibaseServices in Client and Repo instead of EntityDataRetrievalServiceFactory https://gerrit.wikimedia.org/r/353317TASK DETAILhttps://phabricator.wikimedia.org/T165047EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread EBernhardson
EBernhardson added a comment. In T173710#3547826, @Ladsgroup wrote: The jobqueue has slowed down but still increasing, and cirrusSearchIncomingLinkCount still increases the jobqueue with rate of 100 jobs/second. Cirrus link counting jobs are probably just a symptom of the backlog of refresh

[Wikidata-bugs] [Maniphest] [Commented On] T141859: [Task] Contemporary Constraint check

2017-08-24 Thread abian
abian added a comment. In T141859#3549363, @Lucas_Werkmeister_WMDE wrote: (Aside: that first query should probably include “work period (start)”. It seems to be missing a P​279 statement.) I’m not convinced that this is the best approach. Do we really need all the properties for every

[Wikidata-bugs] [Maniphest] [Claimed] T174025: Implement MCR revision retrieval legacy version

2017-08-24 Thread daniel
daniel claimed this task.daniel moved this task from Inbox to Short in progress on the MediaWiki-Platform-Team board. TASK DETAILhttps://phabricator.wikimedia.org/T174025WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL

[Wikidata-bugs] [Maniphest] [Claimed] T174039: Implement MCR page update legacy version

2017-08-24 Thread daniel
daniel claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base,

[Wikidata-bugs] [Maniphest] [Claimed] T174023: Implement MCR storage layer

2017-08-24 Thread daniel
daniel moved this task from Inbox to Epic in progress on the MediaWiki-Platform-Team board.daniel claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T174023WORKBOARDhttps://phabricator.wikimedia.org/project/board/2693/EMAIL

[Wikidata-bugs] [Maniphest] [Retitled] T174025: Implement MCR revision retrieval legacy version

2017-08-24 Thread daniel
daniel renamed this task from "Implement MCR revision retrieval legacy dummy" to "Implement MCR revision retrieval legacy version". TASK DETAILhttps://phabricator.wikimedia.org/T174025EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel,

[Wikidata-bugs] [Maniphest] [Retitled] T174039: Implement MCR page update legacy version

2017-08-24 Thread daniel
daniel renamed this task from "Implement MCR page update legacy dummy" to "Implement MCR page update legacy version". TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF,

[Wikidata-bugs] [Maniphest] [Updated] T174023: Implement MCR storage layer

2017-08-24 Thread daniel
daniel added a parent task: T174044: Deploy MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174023EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno,

[Wikidata-bugs] [Maniphest] [Updated] T174044: Deploy MCR storage layer

2017-08-24 Thread daniel
daniel added a subtask: T174023: Implement MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Marostegui,

[Wikidata-bugs] [Maniphest] [Commented On] T141859: [Task] Contemporary Constraint check

2017-08-24 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. (Aside: that first query should probably include “work period (start)”. It seems to be lacking a P​279 statement.) I’m not convinced that this is the best approach. Do we really need all the properties for every constraint? I feel like it might make more

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread daniel
daniel added a comment. Now let's see what the reduced batch size does. It may actually make the problem worse, but increasing the total number of jobs. Let's hope it makes it better, by reducing the time job runners are blocked...TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T141859: [Task] Contemporary Constraint check

2017-08-24 Thread abian
abian added a comment. In T141859#3546806, @Ivan_A_Krestinin wrote: All other constraints store settings as qualifiers on property page. I think it is good practice make all constraints as similar as possible. This makes implementation and understanding of full constraints system easier. This

[Wikidata-bugs] [Maniphest] [Updated] T135461: Exploratory: Making Wikidata content accessible on wikimediafoundation.org

2017-08-24 Thread Liuxinyu970226
Liuxinyu970226 added a comment. I don't think that this should happen per T166782#3309406, this wiki is not maintained after 2013.TASK DETAILhttps://phabricator.wikimedia.org/T135461EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Liuxinyu970226Cc:

[Wikidata-bugs] [Maniphest] [Block] T174045: DB schema migration for MCR

2017-08-24 Thread daniel
daniel created subtask T174047: Provide backwards compatibility views for toolforge replica [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Created] T174047: Provide backwards compatibility views for toolforge replica [MCR]

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, Toolforge. TASK DESCRIPTIONWe should try to avoid breaking tools when we roll out the new DB schema. To that end, we should provide views that emulate the legacy DB schema on Toolforge.TASK

[Wikidata-bugs] [Maniphest] [Commented On] T170039: Pages display Lua error in mw.wikibase.entity.lua

2017-08-24 Thread Vachovec1
Vachovec1 added a comment. @Johan : I would reccomend something like this: Lua executing entity = mw.wikibase.getEntity() or entity = mw.wikibase.getEntityObject() caused problems resulting in a big red error message(s) announcing a Lua error in mw.wikibase.entity.lua. This has now been fixed so

[Wikidata-bugs] [Maniphest] [Updated] T173850: Possible WMF deployed extension PHP 7 issues

2017-08-24 Thread Ottomata
Ottomata edited projects, added Analytics-Kanban; removed Analytics. TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore,

[Wikidata-bugs] [Maniphest] [Updated] T174028: Finalize DB schema for content meta-data

2017-08-24 Thread daniel
daniel added a parent task: T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno,

[Wikidata-bugs] [Maniphest] [Updated] T174045: DB schema migration for MCR

2017-08-24 Thread daniel
daniel added subtasks: T174028: Finalize DB schema for content meta-data , T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel,

[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR

2017-08-24 Thread daniel
daniel added a parent task: T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno,

[Wikidata-bugs] [Maniphest] [Created] T174045: DB schema migration for MCR

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team, Schema-change. TASK DESCRIPTIONSee schema migration plan: https://www.mediawiki.org/wiki/Multi-Content_Revisions/Content_Meta-Data#Migration_PlanTASK

[Wikidata-bugs] [Maniphest] [Block] T174044: Deploy MCR storage layer

2017-08-24 Thread daniel
daniel created subtask T174045: DB schema migration for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Marostegui,

[Wikidata-bugs] [Maniphest] [Block] T174043: Deploy Multi-Content Revisions

2017-08-24 Thread daniel
daniel created subtask T174044: Deploy MCR storage layer. TASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann,

[Wikidata-bugs] [Maniphest] [Created] T174044: Deploy MCR storage layer

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team, Blocked-on-schema-change. TASK DESCRIPTIONTrack deployment of the storage layer component of MCR. This particularly covers the necessary DB schema migration.TASK

[Wikidata-bugs] [Maniphest] [Created] T174043: Deploy Multi-Content Revisions

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, Structured-Data-Commons, MediaWiki-Platform-Team.Herald added a subscriber: Aklapper. TASK DESCRIPTIONTrack deployment of MCRTASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel added a parent task: T174043: Deploy Multi-Content Revisions. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Updated] T174043: Deploy Multi-Content Revisions

2017-08-24 Thread daniel
daniel added a subtask: T174022: Implement multi-content revisions. TASK DETAILhttps://phabricator.wikimedia.org/T174043EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Updated] T174038: Implement MCR page update interface

2017-08-24 Thread daniel
daniel added subtasks: T161671: Compacting the revision table, T166732: Refactor comment storage in the database and abstract access in MediaWiki. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc:

[Wikidata-bugs] [Maniphest] [Updated] T174026: Implement MCR content meta-data storage service

2017-08-24 Thread daniel
daniel added a parent task: T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR

2017-08-24 Thread daniel
daniel added a parent task: T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Updated] T174038: Implement MCR page update interface

2017-08-24 Thread daniel
daniel added subtasks: T174026: Implement MCR content meta-data storage service, T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper,

[Wikidata-bugs] [Maniphest] [Created] T174039: Implement MCR page update legacy dummy

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONImplement the new MCR page update interface on top of the old database schema. Only the main slot is supported.TASK DETAILhttps://phabricator.wikimedia.org/T174039EMAIL

[Wikidata-bugs] [Maniphest] [Block] T174038: Implement MCR page update interface

2017-08-24 Thread daniel
daniel created subtask T174039: Implement MCR page update legacy dummy. TASK DETAILhttps://phabricator.wikimedia.org/T174038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Edited] T174025: Implement MCR revision retrieval legacy dummy

2017-08-24 Thread daniel
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONImplement the new MCR revision retrieval interface on top of the old database schema. Only the //main// slot is supported.TASK DETAILhttps://phabricator.wikimedia.org/T174025EMAIL

[Wikidata-bugs] [Maniphest] [Created] T174038: Implement MCR page update interface

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis ticket covers the implementation of a mechanism for creating new page revisions with multiple content objects. The functionality provided is roughly equivalent to the

[Wikidata-bugs] [Maniphest] [Block] T174023: Implement MCR storage layer

2017-08-24 Thread daniel
daniel created subtask T174038: Implement MCR page update interface. TASK DETAILhttps://phabricator.wikimedia.org/T174023EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Edited] T174024: Implement MCR revision retrieval interface

2017-08-24 Thread daniel
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONThe revision retrieval interface allows all relevant information for a given page revision to be retrieved. The information provided must be sufficient to locate and load all content objects that belong to the revision

[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel created subtask T174037: Implement single-slot UI [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno,

[Wikidata-bugs] [Maniphest] [Edited] T174037: Implement single-slot UI [MCR]

2017-08-24 Thread daniel
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONAll UI actions/views that need to be updated to support multiple content objects should also have a "single-slot" mode, triggered by providing the //slot// argument in the URL. With that argument set, the user would

[Wikidata-bugs] [Maniphest] [Created] T174037: Implement single-slot UI [MCR]

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONAll UI actions/views that need to be updated to support multiple content objects should also have a "single-slot" mode, triggered by providing the slot argument in the URL.

[Wikidata-bugs] [Maniphest] [Updated] T174035: Allow the view action to show multiple slots [MCR]

2017-08-24 Thread daniel
daniel removed a project: Epic. TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base,

[Wikidata-bugs] [Maniphest] [Block] T174035: Allow the view action to show multiple slots [MCR]

2017-08-24 Thread daniel
daniel created subtask T174036: Allow the diffs to show multiple slots [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Created] T174036: Allow the diffs to show multiple slots [MCR]

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONWhen showing a diff between revisions of a page that has multiple streams (multiple slots per revision), a diff for each slot needs to be show. See

[Wikidata-bugs] [Maniphest] [Created] T174035: Allow the view action to show multiple slots [MCR]

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, Epic, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONWhen viewing a wiki page (revision), the content of all slots should be shown. Control over the layout should lie with the ContentHandler of the main slot. See

[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel created subtask T174035: Allow the view action to show multiple slots [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-08-24T14:44:42Z] Synchronized php-1.30.0-wmf.15/extensions/Wikidata/extensions/Wikibase/client/includes/Changes/WikiPageUpdater.php: Reduce batch size in WikiPageUpdater (T173710) (duration: 00m 48s)TASK

[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel created subtask T174033: Refactor EditPage to allow multiple slots to be edited atomically [MCR]. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF,

[Wikidata-bugs] [Maniphest] [Created] T174032: Make relevant API modules aware of MCR

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output. See

[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel created subtask T174032: Make relevant API modules aware of MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas,

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 373551 merged by jenkins-bot: [mediawiki/extensions/Wikidata@wmf/1.30.0-wmf.15] Hotfix: Reduce batch size in WikiPageUpdater https://gerrit.wikimedia.org/r/373551TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL

[Wikidata-bugs] [Maniphest] [Created] T174031: Support MCR in XML dump format

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONPlaceholder ticket for MCR support in dumps, as described in https://www.mediawiki.org/wiki/Multi-Content_Revisions/DumpsTASK

[Wikidata-bugs] [Maniphest] [Block] T174022: Implement multi-content revisions

2017-08-24 Thread daniel
daniel created subtask T174031: Support MCR in XML dump format. TASK DETAILhttps://phabricator.wikimedia.org/T174022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, Susannaanas, Izno,

[Wikidata-bugs] [Maniphest] [Updated] T174028: Finalize DB schema for content meta-data

2017-08-24 Thread daniel
daniel added a parent task: T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Updated] T174030: Implement DB schema migration tools for MCR

2017-08-24 Thread daniel
daniel added a subtask: T174028: Finalize DB schema for content meta-data . TASK DETAILhttps://phabricator.wikimedia.org/T174030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Block] T174024: Implement MCR revision retrieval interface

2017-08-24 Thread daniel
daniel created subtask T174030: Implement DB schema migration tools for MCR. TASK DETAILhttps://phabricator.wikimedia.org/T174024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Created] T174030: Implement DB schema migration tools for MCR

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis ticket covers all tools needed to convert from the old 1 table schema for revisions to the new 3 table schema using the migration plan described in

[Wikidata-bugs] [Maniphest] [Updated] T171607: Main snak and reference snaks do not include hash in JSON output

2017-08-24 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. To summarize an IRC discussion (in an unlogged channel :/ ) – We certainly don’t need a mixture of having hashes for some snaks but not others. To this end, I’ve created WikibaseDataModelSerialization#233, and once version 2.5.0 of that library is released

[Wikidata-bugs] [Maniphest] [Created] T174029: Two kinds of JSON dumps?

2017-08-24 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONOn the #wikimedia-de-tech IRC channel, the idea of having two kinds of JSON dumps came up: compact dumps and fully expanded dumps. One difference would be

[Wikidata-bugs] [Maniphest] [Block] T174026: Implement MCR content meta-data storage service

2017-08-24 Thread daniel
daniel created subtask T174028: Finalize DB schema for content meta-data . TASK DETAILhttps://phabricator.wikimedia.org/T174026EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Aklapper, daniel, SandraF_WMF, GoranSMilovanovic, QZanden, Acer,

[Wikidata-bugs] [Maniphest] [Created] T174028: Finalize DB schema for content meta-data

2017-08-24 Thread daniel
daniel created this task.daniel added projects: Wikidata, MediaWiki-Platform-Team, Structured-Data-Commons. TASK DESCRIPTIONThis task covers the specification of the DB schema for content meta-data. Design draft:

[Wikidata-bugs] [Maniphest] [Updated] T174024: Implement MCR revision retrieval interface

2017-08-24 Thread daniel
daniel added subtasks: T166732: Refactor comment storage in the database and abstract access in MediaWiki, T161671: Compacting the revision table. TASK DETAILhttps://phabricator.wikimedia.org/T174024EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc:

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

2017-08-24 Thread gerritbot
gerritbot added a comment. Change 373551 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [mediawiki/extensions/Wikidata@wmf/1.30.0-wmf.15] Hotfix: Reduce batch size in WikiPageUpdater https://gerrit.wikimedia.org/r/373551TASK

[Wikidata-bugs] [Maniphest] [Edited] T174024: Implement MCR revision retrieval interface

2017-08-24 Thread daniel
daniel updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONThe revision retrieval interface allows all relevant information for a given page revision to be retrieved. The information provided must be sufficient to locate and load all content objects that belong to the revision

  1   2   >