date:20171011

Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T175948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T160332: View the page when hovering over a reference URL

2017-10-11 Thread Quiddity

Quiddity added a comment.
IIUC this mockup is directly connected to this: M218/693/TASK DETAILhttps://phabricator.wikimedia.org/T160332EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Kiailandi, QuiddityCc: Quiddity, Glorian_Yapinus, Aklapper, Hjfocs, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T113468: [Task] Use compact representation of diffs in EntityChange.

hoo moved this task from Proposed to Doing on the Wikidata-Sprint board.hoo claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T113468WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, hoo, gerritbot, aude, Aklapper, daniel, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177356: Metrics for SDoC: look at querying databases

mpopov updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...** [x] Average time to deletion?
* [] How many people are involved in flagging for deletion/deleting files
TASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177356: Metrics for SDoC: look at querying databases

mpopov added a comment.
Time-to-deletion:

F10150716: time-to-deletion.png


Most copyright-related deletions happen within 1 day of upload across almost all media types, with the exception of 'drawing' (SVGs)
A lot of audio files are deleted within 1 minute or 1 week of upload
Half of all images and PDFs deleted were deleted within 1 month of upload for non-copyright reasons
TASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T105845: Page components / content widgets

2017-10-11 Thread GWicke

GWicke removed GWicke as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T105845EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GWickeCc: leila, Reasno, SBisson, MZMcBride, Mholloway, RandomDSdevel, jmadler, Bianjiang, LikeLifer, MGChecker, -jem-, Daniel_Mietchen, StudiesWorld, Kelson, Jonas, daniel, Jhernandez, MrStradivarius, JanZerebecki, Quiddity, mobrovac, ssastry, Tgr, Ltrlg, Inez, cscott, TrevorParscal, Jdlrobson, GWicke, GoranSMilovanovic, QZanden, Luke081515, Jrf, Wikidata-bugs, aude, Gryllida, jayvdb, fbstj, RobLa-WMF, santhosh, Arlolra, Jdforrester-WMF, Mbch331, Rxy, Jay8g, bd808, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171027: "Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis

2017-10-11 Thread Alsee

Alsee added a comment.

In T171027#3673060, @Lydia_Pintscher wrote:
This is a hugely political issue.


It doesn't matter whether Political Issues come from the community, a project manager, or President of the Planet. They wait in line when a database administrator declares an emergency:
we are close of running out of space on several main database servers, breaking all of Wikipedia.TASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, AlseeCc: Alsee, awight, Matthewrbowker, Noella94, Nirmos, Stryn, Mike_Peel, Capankajsmilyo, Elitre, Risker, Peachey88, Stashbot, Finavon, WMDE-leszek, saper, Masti, Lydia_Pintscher, D3r1ck01, matej_suchanek, Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Vali.matei, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Poyekhali, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T99088: [RFC] Evolving our content platform: Content adaptability, structured data and caching

2017-10-11 Thread GWicke

GWicke removed GWicke as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T99088EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GWickeCc: jmadler, Bianjiang, gpaumier, LikeLifer, Mholloway, MZMcBride, RobLa-WMF, StudiesWorld, Qgil, Tgr, JanZerebecki, RobLa, cscott, Dbrant, Smalyshev, greg, bearND, JKatzWMF, Gilles, Ltrlg, Fhocutt, Jhernandez, Joe, BBlack, Tnegrin, mark, faidon, Tfinc, TrevorParscal, damons, Anomie, bd808, dr0ptp4kt, daniel, BGerstle-WMF, tstarling, ssastry, mobrovac, Catrope, ori, brion, GWicke, GoranSMilovanovic, QZanden, merbst, Luke081515, Wikidata-bugs, aude, fbstj, Mbch331, Jay8g, Krenair, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177354: Metrics for SDoC: look at contributions

2017-10-11 Thread chelsyx

chelsyx added a comment.
@mpopov Looks like the file type categorization on commons is messier than we thought...
For example, File:Krazy_Kat_Bugolist_1916_silent.ogv is an ogv file, but its img_minor_mime is ogg, img_major_mime is application, and img_media_type is video. This is the same for other ogv files. While for ogg files like File:Whitenoisesound.ogg, its img_minor_mime is ogg, img_major_mime is application, and img_media_type is audio.

Not sure if the field img_media_type is more trustworthy...TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177356: Metrics for SDoC: look at querying databases

mpopov updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...*** copyright violations (Use case: creation of auto-copyright violation tools)
 Use case: creation of auto-copyright violation tools*** [[ https://commons.wikimedia.org/wiki/Commons:OTRS | OTRS ]]
** [] ores 
** [] Average time to deletion?...TASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177534: Metrics for SDoC: eventlogging

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION= Investigating what and if sufficient eventlogging is already setup for Commons search
* if not,* [] investigate what are the appropriate metrics to track
* [] is eventlogging setup only on Commons or is it on other projects...TASK DETAILhttps://phabricator.wikimedia.org/T177534EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: mpopov, chelsyx, debt, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177358: Metrics for SDoC: translations

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION= Translations
* F* [] how many files/descriptions are in multiple languages?...** [] How many files are in lang X?
** [] How many have multiple languages in them?
** [] How many Western industrialized languages?...** [] How many search queries happen in what languages?...TASK DETAILhttps://phabricator.wikimedia.org/T177358EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177357: Metrics for SDoC: future work of interest (templates and licensing)

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...** [] How many times licenses are being used
** [] How many media files have multiple licenses...** [] Number of categories, number of hidden categories (how many pages they are applied to - might be future work), number of categories that go away (deleted)

TASK DETAILhttps://phabricator.wikimedia.org/T177357EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177354: Metrics for SDoC: look at contributions

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION= Contributions by:
** [] individualsals
* [] mass-tools/institutions
* [] number of contributions as of present time
* mass-tools/institutions* [] compare to what it looked like 30 days agoTASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...* [] file name vs. description vs. category
* [] "Unfindable" images metrics 
* [] lack of categorization, unhelpful file name, no description (or poor description)...* [] investigate file annotations and if any tracking (logging) of them are availableTASK DETAILhttps://phabricator.wikimedia.org/T177353EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177356: Metrics for SDoC: look at querying databases

debt updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...* [] How  many: mpegs, pngs, ogg, etc...*** Would be good to show “here’s how many files that are images and why it’s okay for us to focus on those for now”
* [] After MP3 upload is implemented
 Track usage
* Tell the story on how it went / how it’s going
** [] Track organic growth rate of uploads (historical trends)...** [x] How many files are getting deleted? F10148687
*** copyright violations
 Use case: creation of auto-copyright violation tools
*** otres** [] ores 
* [] Average time to deletion?...TASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopov, debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T172394: InjectRCRecordsJob: include the serialize EntityChange object in the job spec

gerritbot added a comment.
Change 370915 abandoned by Krinkle:
Remove unused code snippets from EntityChangeFactory and related

Reason:
Looks like these imports have already been removed and/or changed significantly in other commits since.

https://gerrit.wikimedia.org/r/370915TASK DETAILhttps://phabricator.wikimedia.org/T172394EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: thcipriani, PokestarFan, mmodell, Aklapper, aude, gerritbot, Stashbot, Jay8g, TerraCodes, Paladox, IKhitron, Lucas_Werkmeister_WMDE, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177764: [Task] Make Wikibase JavaScript unit tests QUnit 2 compatible

2017-10-11 Thread Krinkle

Krinkle added a comment.
@thiemowmde The tests still fail with QUnit 2 at https://gerrit.wikimedia.org/r/#/c/367838/13. Failures come from data-values/value-view.


In T177764#3674594, @gerritbot wrote:
Change 383383 merged by jenkins-bot:
 [data-values/value-view@master] Remove QUnit.Parameterize dependency and make tests pass with QUnit 2

https://gerrit.wikimedia.org/r/383383


This would fix those failures, but it seems that while merged before the mediawiki/extensions/Wikidata build this morning, it is not included. I guess it needs to be released and pulled through?

https://github.com/wikimedia/mediawiki-extensions-Wikidata/commits/master/extensions/ValueView/tests/src/jquery.valueview.tests.testExpert.jsTASK DETAILhttps://phabricator.wikimedia.org/T177764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmde, KrinkleCc: gerritbot, WMDE-leszek, Aleksey_WMDE, Addshore, hoo, aude, Aklapper, Krinkle, Jonas, Ladsgroup, thiemowmde, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177356: Metrics for SDoC: look at querying databases

mpopov added a comment.
Reasons for files deleted in 2017:

F10148687: deletion_reasons.pngTASK DETAILhttps://phabricator.wikimedia.org/T177356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T105638: RFC: Streamlining Composer usage

2017-10-11 Thread Krinkle

Krinkle closed this task as "Declined".Krinkle triaged this task as "Normal" priority.Krinkle added a comment.

In T105638#3670708, @Addshore wrote:
Personally I think out composer usage is rather streamlined right now


Indeed. Our conventions around how Composer should be used in MediaWiki development, release and deployment have settled. I don't think we're in an ideal or perfect situation but it seems to be working well enough right now and meets the original criteria for adopting Composer

However, the RFC about agreeing how to use Composer (initially) is a separate one:https://www.mediawiki.org/wiki/Requests_for_comment/Composer_managed_libraries_for_use_on_WMF_cluster

Despite its generic name, this RFC (T105638) was not so much about setting up how we use Composer, but changing how we use Composer to be different. Specifically to address complexity with regards to merging composer.json files from multiple sources whilst still making it easy and consistent to test and install separately. This was mainly for the use case of the Wikidata build, which is being changed to not have its own vendor install anymore, thus making this an RFC without a shephard/stakeholder.

The idea of automating mediawiki/vendor  and/or to move the Composer step to be during CI or deployment, instead of in Git, remains interesting for the future. But following a reevaluation from TechCom, I'm closing this RFC given the original use case is becoming obsolete, and there is no longer resourcing from the affected teams for this problem.

Affected teams (e.g. Release Engineering or MediaWiki Platform Team) are free to create a new RFC at any time, possibly borrowing some of the ideas from this RFC.TASK DETAILhttps://phabricator.wikimedia.org/T105638EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Scott_WUaS, RobLa-WMF, adrianheine, Ricordisamoa, MoritzMuehlenhoff, dduvall, Tgr, mobrovac, GWicke, Addshore, Spage, greg, tstarling, aude, hoo, daniel, thcipriani, mmodell, bd808, csteipp, Legoktm, Krinkle, hashar, JanZerebecki, Aklapper, GoranSMilovanovic, QZanden, Lynhg, SBisson, Luke081515, Wikidata-bugs, Malyacko, jayvdb, fbstj, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T171027: "Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis

2017-10-11 Thread Catrope

Catrope added a subscriber: awight.Catrope added a comment.
Thanks, I'll experiment with removing the STRAIGHT_JOIN, as well as with @awight's suggestion at T164796#3560530 of breaking out the change tags rollup.TASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, CatropeCc: awight, Matthewrbowker, Noella94, Nirmos, Stryn, Mike_Peel, Capankajsmilyo, Elitre, Risker, Peachey88, Stashbot, Finavon, WMDE-leszek, saper, Masti, Lydia_Pintscher, D3r1ck01, matej_suchanek, Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Vali.matei, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Poyekhali, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

2017-10-11 Thread ReleaseTaggerBot

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-17 (1.31.0-wmf.4)).
TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T177990: Could not wait for replica DBs to catch up to db1063

hoo closed this task as "Resolved".hoo added a comment.
Fixed in 9849b31626d8f2bcc31d82a39eac234446fb4de1.TASK DETAILhttps://phabricator.wikimedia.org/T177990EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171027: "Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis

2017-10-11 Thread Bawolff

Bawolff added a comment.
Well wikidata is almost certainly a contributing factor, (particularly for russian) I would hesitate to blame it solely for slow ores on watchlist speeds, without more evidence. Especially on english wikipedia with its large recentchanges table and relatively low usage of wikidata.

So addendum to this. For the enwiki case, and talking about watchlist (Not Special:RecentChanges) all the timeouts I could find - https://logstash.wikimedia.org/goto/3183d6a077082f6b4469255e51e60105 (This are just the severe read timeouts. I had trouble making a logstash query for the query longer than 5 seconds warning) had STRAIGHT_JOIN specified, including people with small watchlists. This probably makes sense for Special:Recentchanges case, but for the watchlist case, when the user has a small watchlist, this will cause the query to be much slower then needed. I'd reccomend removing the STRAIGHT_JOIN in the watchlist case for ORESTASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, BawolffCc: Matthewrbowker, Noella94, Nirmos, Stryn, Mike_Peel, Capankajsmilyo, Elitre, Risker, Peachey88, Stashbot, Finavon, WMDE-leszek, saper, Masti, Lydia_Pintscher, D3r1ck01, matej_suchanek, Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Vali.matei, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Poyekhali, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177990: Could not wait for replica DBs to catch up to db1063

hoo created this task.hoo added projects: Wikimedia-log-errors, Wikidata, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper.
TASK DESCRIPTION2017-10-11 07:41:27 [f7f66ea8a97c730e54d9821f] mw1306 enwiki 1.31.0-wmf.2 exception ERROR: [f7f66ea8a97c730e54d9821f] /rpc/RunJobs.php?wiki=enwiki=refreshLinks=30=300M   Wikimedia\Rdbms\DBReplicationWaitError from line 372 of /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/lbfactory/LBFactory.php: Could not wait for replica DBs to catch up to db1063 {"exception_id":"f7f66ea8a97c730e54d9821f","exception_url":"/rpc/RunJobs.php?wiki=enwiki=refreshLinks=30=300M","caught_by":"mwe_handler"}
[Exception Wikimedia\Rdbms\DBReplicationWaitError] (/srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/lbfactory/LBFactory.php:372) Could not wait for replica DBs to catch up to db1063
  #0 /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/lbfactory/LBFactory.php(413): Wikimedia\Rdbms\LBFactory->waitForReplication(array)
  #1 /srv/mediawiki/php-1.31.0-wmf.2/includes/jobqueue/jobs/RefreshLinksJob.php(254): Wikimedia\Rdbms\LBFactory->commitAndWaitForReplication(string, integer)
  #2 /srv/mediawiki/php-1.31.0-wmf.2/includes/jobqueue/jobs/RefreshLinksJob.php(118): RefreshLinksJob->runForTitle(Title)
  #3 /srv/mediawiki/php-1.31.0-wmf.2/includes/jobqueue/JobRunner.php(295): RefreshLinksJob->run()
  #4 /srv/mediawiki/php-1.31.0-wmf.2/includes/jobqueue/JobRunner.php(193): JobRunner->executeJob(RefreshLinksJob, Wikimedia\Rdbms\LBFactoryMulti, BufferingStatsdDataFactory, integer)
  #5 /srv/mediawiki/rpc/RunJobs.php(47): JobRunner->run(array)
  #6 {main}
2017-10-11 07:41:29 [WdYloApAEKoAACiSVR0AAABW] mw1164 itwiki 1.31.0-wmf.2 exception ERROR: [WdYloApAEKoAACiSVR0AAABW] /rpc/RunJobs.php?wiki=itwiki=refreshLinks=30=300M   Wikimedia\Rdbms\DBReplicationWaitError from line 372 of /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/lbfactory/LBFactory.php: Could not wait for replica DBs to catch up to db1054 {"exception_id":"WdYloApAEKoAACiSVR0AAABW","exception_url":"/rpc/RunJobs.php?wiki=itwiki=refreshLinks=30=300M","caught_by":"mwe_handler"}TASK DETAILhttps://phabricator.wikimedia.org/T177990EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

hoo moved this task from Review to Done on the ArticlePlaceholder board.hoo closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T177980WORKBOARDhttps://phabricator.wikimedia.org/project/board/1416/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

gerritbot added a comment.
Change 383637 merged by jenkins-bot:
[mediawiki/extensions/ArticlePlaceholder@master] Short-circuit in ItemNotabilityFilter if list of item ids is empty

https://gerrit.wikimedia.org/r/383637TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T158025: Support ORES for propagated Wikidata edits

2017-10-11 Thread jmatazzoni

jmatazzoni edited projects, added Collaboration-Team-Triage; removed Collaboration-Team-Triage (Collab-Team-Q1-Jul-Sep-2017).
TASK DETAILhttps://phabricator.wikimedia.org/T158025EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jmatazzoniCc: Capankajsmilyo, Catrope, jmatazzoni, Aklapper, Mattflaschen-WMF, GoranSMilovanovic, QZanden, Iniquity, Mkdw, SBisson, Wikidata-bugs, aude, Alchimista, Ladsgroup, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

2017-10-11 Thread thiemowmde

thiemowmde removed a project: Patch-For-Review.thiemowmde moved this task from Review to Done on the Wikidata-Sprint board.thiemowmde triaged this task as "Low" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T177980WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, thiemowmdeCc: gerritbot, Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

2017-10-11 Thread Bawolff

Bawolff added a comment.
Correction: the response is cached according to the maxage specified in the request; however, I’m not sure if this works if pages are edited or purged (as far as I can tell, the browser doesn’t validate its cached data), so it can be hard to choose the right maxage. (This workaround also requires that you parse and transform the canonical URI, which is ugly.)

This is also true for action="" action="" is not purged and only gets an (s)maxage if set by url parameter. (exception: ="" and ="" are purged, but other action="" urls are not. See Title::getCdnUrls).TASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BawolffCc: Bawolff, hoo, Ladsgroup, daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

Lucas_Werkmeister_WMDE added subscribers: Ladsgroup, hoo.Lucas_Werkmeister_WMDE added a comment.
@hoo or @Ladsgroup could you perhaps take a look? You seem to be more familiar with CORS than I am :)TASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: hoo, Ladsgroup, daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...As far as I understand, this will definitely require at least an `Access-Control-Allow-Origin: *` header on the `/data/main`, redirect, which can be added [like this](http://mark.koli.ch/set-cache-control-and-expires-headers-on-a-redirect-with-mod-rewrite). After that, there are different options. We can make `index.php` send that header as well on any successful `GET` request to the `Data:` namespace, but this seems a bit risky. Alternatively, we could make `Special:PageData` redirect to something other than `index.php?action="" (which isn’t a very nice solution anyways), e. g. an endpoint of the REST API. The REST API already supports the endpoint `/page/wikitext/{title}`, but only for `POST` requests. We could add support for `GET` requests to it, or perhaps add another endpoint (after all, the content model isn’t actually wikitext).

See also the related issue {T150290}, which also features a redirect chain with partial CORS support.TASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...There is a workaround to this problem: use the Action API (which supports CORS), with `action="" `prop=revisions`, and `rvprop=content` (and selecting the pages with `titles`, `pageids`, or some generator, etc.), and extract the page content from `response.query.pages.{pageId}.revisions[0]['*']`. ~~However, API responses are never cached, resulting in more work for the API servers as well as lots of unnecessary data transfer.~~ Correction: the response is cached according to the `maxage` specified in the request; however, I’m not sure if this works if pages are edited or purged (as far as I can tell, the browser doesn’t validate its cached data), so it can be hard to choose the right `maxage`. (ItThis workaround also requires that you parse and transform the canonical URI, which is ugly.)...TASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Aklapper, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, cmadeo, Lewizho99, Maathavan, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

gerritbot added a comment.
Change 383637 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/extensions/ArticlePlaceholder@master] Short-circuit in ItemNotabilityFilter if list of item ids is empty

https://gerrit.wikimedia.org/r/383637TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

hoo added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

hoo removed subscribers: Wikimedia-log-errors, ArticlePlaceholder, Wikidata.hoo added projects: Wikimedia-log-errors, ArticlePlaceholder, Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, cmadeo, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177980: ItemNotabilityFilter can't handle empty ItemId sets, query times out

hoo created this task.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONWe see the below error if the list of item ids passed to ItemNotabilityFilter::getItemsWithoutArticle is empty.

2017-10-11 14:30:33 [Wd4qhApAMF0AAEllNCMO] mw1258 bnwiki 1.31.0-wmf.2 exception ERROR: [Wd4qhApAMF0AAEllNCMO] …  Wikimedia\Rdbms\DBQueryError from line 1167 of /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/database/Database.php: A connection error occured.
Query: SELECT  ips_site_id,ips_site_page,ips_item_id  FROM `wb_items_per_site`WHERE ips_site_id = 'bnwiki'
Function: Wikibase\Lib\Store\Sql\SiteLinkTable::getLinks
Error: 2013 Lost connection to MySQL server during query (10.64.48.25)
[Exception Wikimedia\Rdbms\DBQueryError] (/srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/database/Database.php:1167) A connection error occured.
Query: SELECT  ips_site_id,ips_site_page,ips_item_id  FROM `wb_items_per_site`WHERE ips_site_id = 'bnwiki'
Function: Wikibase\Lib\Store\Sql\SiteLinkTable::getLinks
Error: 2013 Lost connection to MySQL server during query (10.64.48.25)

  #0 /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/database/Database.php(979): Wikimedia\Rdbms\Database->reportQueryError(string, integer, string, string, boolean)
  #1 /srv/mediawiki/php-1.31.0-wmf.2/includes/libs/rdbms/database/Database.php(1362): Wikimedia\Rdbms\Database->query(string, string)
  #2 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/Wikibase/lib/includes/Store/Sql/SiteLinkTable.php(295): Wikimedia\Rdbms\Database->select(string, array, array, string)
  #3 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/Wikibase/lib/includes/Store/CachingSiteLinkLookup.php(93): Wikibase\Lib\Store\Sql\SiteLinkTable->getLinks(array, array, array)
  #4 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/ArticlePlaceholder/includes/ItemNotabilityFilter.php(156): Wikibase\Lib\Store\CachingSiteLinkLookup->getLinks(array, array)
  #5 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/ArticlePlaceholder/includes/ItemNotabilityFilter.php(90): ArticlePlaceholder\ItemNotabilityFilter->getItemsWithoutArticle(array)
  #6 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/ArticlePlaceholder/includes/SearchHookHandler.php(197): ArticlePlaceholder\ItemNotabilityFilter->getNotableEntityIds(array)
  #7 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/ArticlePlaceholder/includes/SearchHookHandler.php(141): ArticlePlaceholder\SearchHookHandler->renderTermSearchResults(array)
  #8 /srv/mediawiki/php-1.31.0-wmf.2/extensions/Wikidata/extensions/ArticlePlaceholder/includes/SearchHookHandler.php(129): ArticlePlaceholder\SearchHookHandler->addToSearch(SpecialSearch, OutputPage, string)
  #9 /srv/mediawiki/php-1.31.0-wmf.2/includes/Hooks.php(177): ArticlePlaceholder\SearchHookHandler::onSpecialSearchResultsAppend(SpecialSearch, OutputPage, string)
  #10 /srv/mediawiki/php-1.31.0-wmf.2/includes/Hooks.php(205): Hooks::callHook(string, array, array, NULL)
  #11 /srv/mediawiki/php-1.31.0-wmf.2/includes/specials/SpecialSearch.php(459): Hooks::run(string, array)
  #12 /srv/mediawiki/php-1.31.0-wmf.2/includes/specials/SpecialSearch.php(185): SpecialSearch->showResults(string)
  #13 /srv/mediawiki/php-1.31.0-wmf.2/includes/specialpage/SpecialPage.php(522): SpecialSearch->execute(NULL)
  #14 /srv/mediawiki/php-1.31.0-wmf.2/includes/specialpage/SpecialPageFactory.php(578): SpecialPage->run(NULL)
  #15 /srv/mediawiki/php-1.31.0-wmf.2/includes/MediaWiki.php(287): SpecialPageFactory::executePath(Title, RequestContext)
  #16 /srv/mediawiki/php-1.31.0-wmf.2/includes/MediaWiki.php(851): MediaWiki->performRequest()
  #17 /srv/mediawiki/php-1.31.0-wmf.2/includes/MediaWiki.php(523): MediaWiki->main()
  #18 /srv/mediawiki/php-1.31.0-wmf.2/index.php(43): MediaWiki->run()
  #19 /srv/mediawiki/w/index.php(3): include(string)
  #20 {main}TASK DETAILhttps://phabricator.wikimedia.org/T177980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, Wikimedia-log-errors, ArticlePlaceholder, Wikidata, hoo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T150290: add CORS to all redirecs in chain from https://www.wikidata.org/entity/{Q...}

Lucas_Werkmeister_WMDE added a comment.
I don't think Apache has a nice way to set additional headers in these cases (only).

I found this blog post while looking into the similar issue T177966 – TL;DR: set an environment variable in the redirect (E=acoa:1) and add a Header always set directive with that environment variable as condition (env=acoa). I guess it’s not very nice, but it’s possible (unless something in Wikimedia’s Apache setup prevents it).

Thiemo pointed out another complication: our canonical URIs are HTTP, not HTTPS. There is a redirect from the HTTP URL to the HTTPS URL.

wikidata.org is on the HSTS preload list used by Chrome, Firefox, Opera, Safari, IE11, and Edge, so those clients should immediately use the HTTPS version. Are there any clients that don’t use this HSTS preload list but still apply same-origin restrictions? (There’s also a task for switching the canonical URIs to HTTPS – T153563 – but it’s not clear if it should be done.)TASK DETAILhttps://phabricator.wikimedia.org/T150290EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, thiemowmde, gerritbot, hoo, daniel, Aklapper, elf-pavlik, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177022: Add an API module for querying MediaInfo entities by file page title

2017-10-11 Thread MarkTraceur

MarkTraceur added a comment.
OK, I think I have the lookup services mostly written (probably some PHP wiring that I'm not quite perfect on, will deal with details during testing), but I'm a little unclear how I'm meant to hook those up to the existing API module in Wikibase. I obviously can't put MediaInfo-specific code in there, but I'm also not sure if there's already a generalized way to say "for whatever entity type/namespace got passed in, determine the ID or title lookup service, call it with whatever information we have, and return the result", so I'll go into a documentation hole now but if you all have a faster answer I'd love to hear it.TASK DETAILhttps://phabricator.wikimedia.org/T177022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceurCc: Aleksey_WMDE, thiemowmde, Lydia_Pintscher, Addshore, gerritbot, Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, V4switch, Lewizho99, Maathavan, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177354: Metrics for SDoC: look at contributions

mpopov added a comment.

In T177354#3676545, @chelsyx wrote:
Unfortunately, the mediawiki snapshot doesn't has the image table which describes images and other uploaded files.


Ah, yeah. I missed the reference to image in your query. But looks like we can use img_timestamp, although those queries will take some time.

Also something to note is that img_major_mime shows up as "application" for .ogg files (which are audio files) and .pdf files:

SELECT DISTINCT img_major_mime, img_minor_mime
FROM commonswiki.image;




img_major_mimeimg_minor_mime
imagegif
imagejpeg
imagepng
imagetiff
imagevnd.djvu
imagewebp
imagex-xcf
imagesvg+xml
applicationogg
audiomidi
audiowav
audiowebm
audiox-flac
videowebm
applicationpdf



I recommend adding a CASE that returns "audio" for ogg files and "document" (for example) for PDFs.TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177857: Test RDF exports in beta cluster

gerritbot added a comment.
Change 383376 merged by jenkins-bot:
[operations/mediawiki-config@master] labs: Add $wgWBRepoSettings['canonicalUriProperty']

https://gerrit.wikimedia.org/r/383376TASK DETAILhttps://phabricator.wikimedia.org/T177857EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: Lucas_Werkmeister_WMDE, gerritbot, daniel, Aklapper, Ladsgroup, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Lewizho99, Maathavan, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177354: Metrics for SDoC: look at contributions

2017-10-11 Thread chelsyx

chelsyx added a comment.
Hey @chelsyx - what time frame does this cover?

Jumping in to say this looks like it's from launch of Commons to now.

Thanks @mpopov ! Yes, this is the file counts on Oct 10.

Can we also get a count of how this has changed over the last week and compare that to the last 30 days? It'd be interesting to see if the numbers are fairly consistent (individual vs institution) or if they have changed quite a bit when extending the time scope.

@chelsyx this may be useful: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits as it contains monthly snapshots of the page & user tables as of April 2017

Unfortunately, the mediawiki snapshot doesn't has the image table which describes images and other uploaded files.TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T173850: Possible WMF deployed extension PHP 7 issues

2017-10-11 Thread Reedy

Reedy added a comment.
Many are likely to be false positives, and that's not too much of an issue as long as people have looked over them and deemed them as such :)TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Smalyshev, Paladox, Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, MaxSem, Krenair, Reedy, SilvioAryneutro, Minilexikon, Timoavax79, Lordiis, GoranSMilovanovic, Adik2382, 45Jayjay1969, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Orienteerix, EnricoCNC, Lewizho99, Ddproxy, Maathavan, debt, SundanceRaphael, Reasno, Jseddon, JGirault, gabriel-wmde, phabyogi, DStrine, Dixtosa, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, SBisson, ferdbold, lxbarth, JAllemandou, Zache, Planemad, Wikidata-bugs, Base, aude, AndyRussG, Pcoombe, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Jackmcbarn, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T174028: Finalize database schema for MCR content meta-data

2017-10-11 Thread Anomie

Anomie added a comment.
What I got out of the meeting we just had:

Should we introduce content_sha1?

DBAs don't really care. Narrower tables are better, but the cost here probably isn't very significant if it's needed.

Making the field nullable would allow for reclaiming the majority of the space without an alter if we decide we don't need it after all (although I think the difference is only 7 or 8 bits per row versus setting it empty?).

Should we build in support for sharing (partitioning) on the page ID?

DBAs say no to MySQL's built-in partitioning. If we're going to do partitioning then we would need do it at the application level rather than the DB level.

I note this gives us more flexibility. For example, we don't actually need the page_id in the tables in order to shard by page_id as long as all the code that is doing the DB access knows the page_id to be able to use the right shard.

Should slot_revision be declared BIGINT right away?

This wasn't discussed that I recall. See the existing answer in T174028#3664170. However,

If that maintenance is going to happen anyways, we could probably go for int with slot_revision and schedule both maintenances at the same time?

Of course we can schedule the change of slot_revision at the same time we schedule the change of rev_id and every field that refers to rev_id, it's just one more ALTER. I suppose what Daniel is really looking for is for someone to say which is worse, performance impact of joining a bigint with an int or the time it'll take to alter slot_revision later. It sounds like the answer at the moment is "we don't know what the performance impact is, so we can't say".TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Marostegui, cicalese, Abit, brion, Anomie, jcrespo, gerritbot, Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, Lewizho99, Maathavan, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T173850: Possible WMF deployed extension PHP 7 issues

Smalyshev added a comment.
CirrusSearch one seems to be false positive.TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Paladox, Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, MaxSem, Krenair, Reedy, SilvioAryneutro, Minilexikon, Timoavax79, Lordiis, GoranSMilovanovic, Adik2382, 45Jayjay1969, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Orienteerix, EnricoCNC, Lewizho99, Ddproxy, Maathavan, debt, SundanceRaphael, Reasno, Jseddon, JGirault, gabriel-wmde, phabyogi, DStrine, Dixtosa, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, SBisson, ferdbold, lxbarth, JAllemandou, Zache, Planemad, Wikidata-bugs, Base, aude, AndyRussG, Pcoombe, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Jackmcbarn, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T173850: Possible WMF deployed extension PHP 7 issues

Smalyshev removed a project: Discovery.
TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Paladox, Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, MaxSem, Krenair, Reedy, SilvioAryneutro, Minilexikon, Timoavax79, Lordiis, GoranSMilovanovic, Adik2382, 45Jayjay1969, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Orienteerix, EnricoCNC, Lewizho99, Ddproxy, Maathavan, debt, SundanceRaphael, Reasno, Jseddon, JGirault, gabriel-wmde, phabyogi, DStrine, Dixtosa, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, SBisson, ferdbold, lxbarth, JAllemandou, Zache, Planemad, Wikidata-bugs, Base, aude, AndyRussG, Pcoombe, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Jackmcbarn, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T173850: Possible WMF deployed extension PHP 7 issues

Smalyshev removed projects: CirrusSearch, Discovery-Search.
TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Paladox, Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, MaxSem, Krenair, Reedy, SilvioAryneutro, Minilexikon, Timoavax79, Lordiis, GoranSMilovanovic, Adik2382, 45Jayjay1969, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Orienteerix, EnricoCNC, Avner, Lewizho99, Ddproxy, Maathavan, debt, SundanceRaphael, Reasno, Gehel, Jseddon, JGirault, gabriel-wmde, phabyogi, FloNight, DStrine, Dixtosa, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, SBisson, ferdbold, lxbarth, JAllemandou, Zache, Planemad, Wikidata-bugs, Base, aude, AndyRussG, Pcoombe, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Jackmcbarn, Mbch331, Jay8g, Ltrlg, jeremyb, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177970: Expand references with constraint violations

Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: Wikidata, Wikibase-Quality, Wikibase-Quality-Constraints.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONConstraint check results on references are hidden because references are collapsed by default. Should we expand references with constraint violations to raise their visibility?

From the developer tools console, this can be done with the following command:

$( '.wikibase-referenceview .wbqc-reports-button' )
  .parents( '.wikibase-statementview-references-container' )
  .find( '.wikibase-statementview-references-heading .ui-toggler-toggle-collapsed' )
  .click()

However, I hope our real implementation, if we decide to do this, will be a bit less hacky :)TASK DETAILhttps://phabricator.wikimedia.org/T177970EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177354: Metrics for SDoC: look at contributions

mpopov added a comment.

In T177354#3675988, @debt wrote:
Hey @chelsyx - what time frame does this cover?


Jumping in to say this looks like it's from launch of Commons to now.

Can we also get a count of how this has changed over the last week and compare that to the last 30 days? It'd be interesting to see if the numbers are fairly consistent (individual vs institution) or if they have changed quite a bit when extending the time scope.

@chelsyx this may be useful: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits as it contains monthly snapshots of the page & user tables as of April 2017TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...`Special:PageData` adds an `Access-Control-Allow-Origin: *` header to its redirect, but there is no such header on the first redirect, nor on the final response, which means that in a cross-origin scenario (e. g. fetching the data via _javascript_ on another website) the request is blocked. (Aside: if I understand correctly, Firefox doesn’t yet support CORS on redirects at all. See [Bug 1346749](https://bugzilla.mozilla.org/show_bug.cgi?id=1346749).) To enhance availability of these data, there should be a way for other websites to dynamically access the data in a way where the response can be cachedTASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T177966: Add CORS-enabled, cacheable way to access contents of Data namespace

Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: User-Daniel, Wikidata, MediaWiki-General-or-Unknown.
TASK DESCRIPTIONCurrently, accessing data on commons via the canonical URI eventually ends up at index.php?action="">:


https://commons.wikimedia.org/data/main/Foo.map →
https://commons.wikimedia.org/wiki/Special:PageData/main/Foo.map →
https://commons.wikimedia.org/w/index.php?title=Foo.map="">


Special:PageData adds an Access-Control-Allow-Origin: * header to its redirect, but there is no such header on the first redirect, nor on the final response, which means that the request is blocked. (Aside: if I understand correctly, Firefox doesn’t yet support CORS on redirects at all. See Bug 1346749.) To enhance availability of these data, there should be a way for other websites to dynamically access the data in a way where the response can be cached.

There is a workaround to this problem: use the Action API (which supports CORS), with action="">, prop=revisions, and rvprop=content (and selecting the pages with titles, pageids, or some generator, etc.), and extract the page content from response.query.pages.{pageId}.revisions[0]['*']. However, API responses are never cached, resulting in more work for the API servers as well as lots of unnecessary data transfer. (It also requires that you parse and transform the canonical URI, which is ugly.)

As far as I understand, this will definitely require at least an Access-Control-Allow-Origin: * header on the /data/main, redirect, which can be added like this. After that, there are different options. We can make index.php send that header as well on any successful GET request to the Data: namespace, but this seems a bit risky. Alternatively, we could make Special:PageData redirect to something other than index.php?action=""> (which isn’t a very nice solution anyways), e. g. an endpoint of the REST API. The REST API already supports the endpoint /page/wikitext/{title}, but only for POST requests. We could add support for GET requests to it, or perhaps add another endpoint (after all, the content model isn’t actually wikitext).TASK DETAILhttps://phabricator.wikimedia.org/T177966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: daniel, Aklapper, Jdforrester-WMF, Smalyshev, Lucas_Werkmeister_WMDE, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Block] T163921: [Epic] Implement canonical data URLs for machine readable page content

Lucas_Werkmeister_WMDE created subtask T177966: Add CORS-enabled, cacheable way to access contents of Data namespace.
TASK DETAILhttps://phabricator.wikimedia.org/T163921EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Smalyshev, Jdforrester-WMF, Aklapper, daniel, Dfil7, Icedevil, GoranSMilovanovic, 45Jayjay1969, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171027: "Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis

2017-10-11 Thread Bawolff

Bawolff added a comment.

In T171027#3676023, @jmatazzoni wrote:
In T171027#3673060, @Lydia_Pintscher wrote:

This is a hugely political issue. Let's please not do this unless necessary.

Right now, ORES is unusable on Watchlist for English, Russian and probably some other big wikis. It causes delays of 30 seconds to a minute when users have more than 3 days set. I'm told Wikidata is a likely culprit. If that's correct (I can't say it is or isn't), then by that standard, some kind of change appears to be "necessary,"  and, as Risker says, some kind of escalation appears both justified and required.


Well wikidata is almost certainly a contributing factor, (particularly for russian) I would hesitate to blame it solely for slow ores on watchlist speeds, without more evidence. Especially on english wikipedia with its large recentchanges table and relatively low usage of wikidata.TASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, BawolffCc: Noella94, Nirmos, Stryn, Mike_Peel, Capankajsmilyo, Elitre, Risker, Peachey88, Stashbot, Finavon, WMDE-leszek, saper, Masti, Lydia_Pintscher, D3r1ck01, matej_suchanek, Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Vali.matei, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Poyekhali, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T177356: Metrics for SDoC: look at querying databases

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.mpopov set the point value for this task to "6".mpopov claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T177356WORKBOARDhttps://phabricator.wikimedia.org/project/board/1241/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Project Column] T177356: Metrics for SDoC: look at querying databases

mpopov moved this task from Needs triage to Current work on the Discovery-Analysis board.mpopov edited projects, added Discovery-Analysis (Current work); removed Discovery-Analysis.
TASK DETAILhttps://phabricator.wikimedia.org/T177356WORKBOARDhttps://phabricator.wikimedia.org/project/board/1850/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopovCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171027: "Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis

2017-10-11 Thread jmatazzoni

jmatazzoni added a comment.
In T171027#3673060, @Lydia_Pintscher wrote:

This is a hugely political issue. Let's please not do this unless necessary.

Right now, ORES is unusable on Watchlist for English, Russian and probably some other big wikis. It causes delays of 30 seconds to a minute when users have more than 3 days set. I'm told Wikidata is a likely culprit. If that's correct, then by that standard, some kind of change appears to be "necessary,"  and, as Risker says, some kind of escalation appears both justified and required.TASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, jmatazzoniCc: Noella94, Nirmos, Stryn, Mike_Peel, Capankajsmilyo, Elitre, Risker, Peachey88, Stashbot, Finavon, WMDE-leszek, saper, Masti, Lydia_Pintscher, D3r1ck01, matej_suchanek, Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Vali.matei, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Poyekhali, Volker_E, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177354: Metrics for SDoC: look at contributions

debt added a comment.
Hey @chelsyx - what time frame does this cover?

Can we also get a count of how this has changed over the last week and compare that to the last 30 days? It'd be interesting to see if the numbers are fairly consistent (individual vs institution) or if they have changed quite a bit when extending the time scope.TASK DETAILhttps://phabricator.wikimedia.org/T177354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyx, debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T127929: [Story] Add a new datatype for linking to creators of artwork and more (smart URI)

2017-10-11 Thread TheDJ

TheDJ added a comment.
Other considerations


Anonymous creator
Pseudonymous creator (worse, a pseudonym whose name later became a known author)
Multi party copyright/creators
hierarchies ? For instance JPL lab images are often credited as NASA/JPL/Project/Person
TASK DETAILhttps://phabricator.wikimedia.org/T127929EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TheDJCc: TheDJ, SandraF_WMF, Sannita, Aleksey_WMDE, Jarekt, Ayack, Ghouston, Charlie_WMDE, Izno, thiemowmde, Ladsgroup, Liuxinyu970226, Pigsonthewing, Bugreporter, Jan_Dittrich, Josve05a, Sadads, Poyekhali, gerritbot, DannyH, Micru, intracer, mkroetzsch, Aklapper, daniel, Steinsplitter, Lydia_Pintscher, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, QZanden, Acer, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, El_Grafo, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T89552: Implement International Image Interoperability Framework (IIIF) prototype service on Wikimedia labs

2017-10-11 Thread BeatEstermann

BeatEstermann added a comment.
The Swiss National Library got a request by research platforms providers to support the IIIF standard and raised the issue at the last meeting of the Swiss GLAM-Wiki Contact Group. IIIF support could be an extra argument for institutions with public domain material or freely licensed material to make their content available through Wikimedia Commons. Especially smaller institutions are not expected to support the standard on their own platforms in the near future.TASK DETAILhttps://phabricator.wikimedia.org/T89552EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BeatEstermannCc: BeatEstermann, PokestarFan, Astinson, SandraF_WMF, Pyb, Spinster, Jane023, Puik, Shonagon, Jdforrester-WMF, Sumit, GAllegre, brion, Regisrob, Fae, Klokantech, Pietromarialiuzzo, Nemo_bis, Matanya, Marsupium, Husky, Jheald, Tgr, Bawolff, Gilles, dschwen, Aklapper, Multichill, E1presidente, Waytogoeducation, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, QZanden, srishakatux, Acer, V4switch, Pahadiahimanshu, Manrajsinghgrover, Keer25, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T144103: Create .nt (NTriples) dumps for wikidata data

hoo added a subtask: T176844: Look into truthy nt dump performance.
TASK DETAILhttps://phabricator.wikimedia.org/T144103EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lydia_Pintscher, thalhamm, Hydriz, Lokal_Profil, Sylvain_WMFr, ArielGlenn, Jonas, hoo, aude, daniel, -jem-, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T176844: Look into truthy nt dump performance

hoo added a parent task: T144103: Create .nt (NTriples) dumps for wikidata data.
TASK DETAILhttps://phabricator.wikimedia.org/T176844EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, Stashbot, gerritbot, Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T163551: Huge number of duplicate rows in wb_terms

hoo added a comment.

In T163551#3675712, @daniel wrote:
Do we know where the dupes come from?


Well, prior to ab66ee5348ede2ad0686f5f9e733970c79a9847a we only checked on replica if a term already exists, before writing it. Together with many edits in a row, this can easily lead to duplicates.TASK DETAILhttps://phabricator.wikimedia.org/T163551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lydia_Pintscher, Krinkle, Ladsgroup, gerritbot, daniel, Smalyshev, jcrespo, aude, Aklapper, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T163551: Huge number of duplicate rows in wb_terms

2017-10-11 Thread daniel

daniel added a comment.
Do we know where the dupes come from?TASK DETAILhttps://phabricator.wikimedia.org/T163551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Lydia_Pintscher, Krinkle, Ladsgroup, gerritbot, daniel, Smalyshev, jcrespo, aude, Aklapper, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T167114: Open view for term_full_entity_id in wb_terms table in labs

2017-10-11 Thread daniel

daniel added a comment.
Thank you all for sorting this out!

@Andrew For the record: yes, wb_terms is wikidata only (and wikidata test). Generally, tables with the wb_ prefix are only for wikibase repos, while the wbc_ prefix is used for tables on wikibase clients. Note that with the SDC project, commons will become a wikibase repo, and get the respective tables.TASK DETAILhttps://phabricator.wikimedia.org/T167114EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Andrew, danielCc: Marostegui, Andrew, bd808, Pasleim, PokestarFan, chasemp, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, IMBLUESKY, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, Gryllida, scfc, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T168532: Check constraints on qualifiers and references

Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...- [x] [Add support for checking constraints on qualifiers and references to gadget](https://gerrit.wikimedia.org/r/#/c/379747/)
- [ - [x] Enable config on Wikidata: {T176863}...TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: abian, Ivan_A_Krestinin, gerritbot, PokestarFan, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T168532: Check constraints on qualifiers and references

Lucas_Werkmeister_WMDE closed subtask T176863: Enable constraint checks on qualifiers and references on Wikidata as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: abian, Ivan_A_Krestinin, gerritbot, PokestarFan, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T176863: Enable constraint checks on qualifiers and references on Wikidata

Lucas_Werkmeister_WMDE closed this task as "Resolved".Lucas_Werkmeister_WMDE claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T176863EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Stashbot, gerritbot, Aklapper, Lucas_Werkmeister_WMDE, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

hoo added a comment.
cawiki had (at the time statement usage were disable again) 90,430 statement usages from just 1,118 pages. This means each of these pages had an average of about 81 statement usages (median: 90) and one page had 196 even.

Top 10 pages:

mysql:wikiadmin@db1094 [cawiki]> SELECT COUNT(*) AS No, eu_page_id FROM wbc_entity_usage WHERE eu_aspect LIKE "C.%" GROUP BY eu_page_id ORDER BY No DESC LIMIT 10;
+-++
| No  | eu_page_id |
+-++
| 196 |  90242 |
| 192 |  53024 |
| 179 |  68079 |
| 177 | 236868 |
| 166 | 153616 |
| 165 |  40888 |
| 164 | 881994 |
| 162 | 577523 |
| 158 |1113825 |
| 157 | 114421 |
+-++

On elwiki there are only 1,853,264 statement usages on 88,106 pages, thus each of these pages has an average of only 21 statement usages (median: 14).

Top 10 pages:

mysql:wikiadmin@db1072 [elwiki]> SELECT COUNT(*) AS No, eu_page_id FROM wbc_entity_usage WHERE eu_aspect LIKE "C.%" GROUP BY eu_page_id ORDER BY No DESC LIMIT 10;
+-++
| No  | eu_page_id |
+-++
| 210 | 519024 |
| 100 | 196573 |
|  96 | 189235 |
|  96 |  13235 |
|  96 | 233523 |
|  93 | 171936 |
|  93 |  16531 |
|  92 | 186490 |
|  92 | 435266 |
|  90 | 189233 |
+-++

On cewiki there are up to now only 99,814 statement usages on 5,865 pages, thus each of these pages has an average of only 17 statement usages (median: 14).

Top 10 pages:

mysql:wikiadmin@db1078 [cewiki]> SELECT COUNT(*) AS No, eu_page_id FROM wbc_entity_usage WHERE eu_aspect LIKE "C.%" GROUP BY eu_page_id ORDER BY No DESC LIMIT 10;
+-++
| No  | eu_page_id |
+-++
| 187 |   2237 |
| 154 |   2443 |
| 125 |   9584 |
| 125 |   9516 |
| 122 |   2680 |
| 121 |  62650 |
| 121 |   2278 |
| 119 |   2284 |
| 118 |   2179 |
| 116 |   9609 |
+-++TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177707: don't dispatch changes to all affected pages for highly used items

gerritbot added a comment.
Change 383551 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Add tracking for fallout from fix for T177707

https://gerrit.wikimedia.org/r/383551TASK DETAILhttps://phabricator.wikimedia.org/T177707EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Mike_Peel, gerritbot, Jdforrester-WMF, brion, Mattflaschen-WMF, Strainu, TerraCodes, Jay8g, Liuxinyu970226, jcrespo, Bawolff, Aklapper, hoo, daniel, Ladsgroup, Lydia_Pintscher, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

hoo added a comment.
Table sizes pre-deploy to cawiki and cewiki:

mysql:wikiadmin@db1079 [cawiki]> SHOW TABLE STATUS like "wbc_entity_usage"\G
*** 1. row ***
   Name: wbc_entity_usage
 Engine: InnoDB
Version: 10
 Row_format: Compact
   Rows: 11676926
 Avg_row_length: 124
Data_length: 1450704896
Max_data_length: 0
   Index_length: 1864957952
  Data_free: 258998272
 Auto_increment: 27091066
…

mysql:wikiadmin@db1094 [cawiki]> SHOW TABLE STATUS like "wbc_entity_usage"\G
*** 1. row ***
   Name: wbc_entity_usage
 Engine: InnoDB
Version: 10
 Row_format: Compact
   Rows: 11275586
 Avg_row_length: 129
Data_length: 1454882816
Max_data_length: 0
   Index_length: 1839742976
  Data_free: 279969792
 Auto_increment: 27091066
…



mysql:wikiadmin@db1078 [cewiki]> SHOW TABLE STATUS like "wbc_entity_usage"\G
*** 1. row ***
   Name: wbc_entity_usage
 Engine: InnoDB
Version: 10
 Row_format: Compact
   Rows: 5958796
 Avg_row_length: 78
Data_length: 465485824
Max_data_length: 0
   Index_length: 564248576
  Data_free: 9437184
 Auto_increment: 10184030
…

mysql:wikiadmin@db1077 [cewiki]> SHOW TABLE STATUS like "wbc_entity_usage"\G
*** 1. row ***
   Name: wbc_entity_usage
 Engine: InnoDB
Version: 10
 Row_format: Compact
   Rows: 5825230
 Avg_row_length: 81
Data_length: 474906624
Max_data_length: 0
   Index_length: 568295424
  Data_free: 11534336
 Auto_increment: 10184030
…

Usages pre-deploy:
cawiki:

No  eu_aspect
5767425 L.ca
412499  L.en
442257  L.oc
585871  O
649594  S
3046987 T
1174675 X

cewiki:

No  eu_aspect
130585  L.ce
3905L.en
126406  L.ru
160246  O
172761  S
1798197 T
3645127 X

cawiki had to be reverted after a few minutes as the number of usages added skyrocketed, I saw over 22,000 usages being added in a minute. (Usages: 23832; SLEEP(60); Usages: 46490). A total of 90430 statement usages were added in just 6 minutes on cawiki (~15k per minute or 250/s).TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176863: Enable constraint checks on qualifiers and references on Wikidata

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T13:24:55Z]  Synchronized wmf-config/Wikibase-production.php: Enable constraint checks on qualifiers and references - T176863 (duration: 00m 47s)TASK DETAILhttps://phabricator.wikimedia.org/T176863EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, gerritbot, Aklapper, Lucas_Werkmeister_WMDE, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T176863: Enable constraint checks on qualifiers and references on Wikidata

gerritbot added a comment.
Change 383163 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable constraint checks on qualifiers and references

https://gerrit.wikimedia.org/r/383163TASK DETAILhttps://phabricator.wikimedia.org/T176863EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Lucas_Werkmeister_WMDE, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T12:54:16Z]  Synchronized wmf-config/InitialiseSettings.php: Disable Statement usage tracking on cawiki (T151717) (duration: 00m 47s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T12:53:30Z]  Start recentchanges purge on s4 primary master T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

gerritbot added a comment.
Change 383556 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable statement usage tracking on cawiki

https://gerrit.wikimedia.org/r/383556TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T12:48:49Z]  Kill recentchanges purge on s4 primary master - https://phabricator.wikimedia.org/T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

gerritbot added a comment.
Change 383556 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[operations/mediawiki-config@master] Disable statement usage tracking on cawiki

https://gerrit.wikimedia.org/r/383556TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T12:44:53Z]  Synchronized wmf-config/InitialiseSettings.php: (temp) Disable Statement usage tracking on cawiki (T151717) (duration: 00m 48s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T12:38:06Z]  Synchronized wmf-config/InitialiseSettings.php: Enable Statement usage tracking on cawiki and cewiki (T151717) (duration: 00m 47s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177707: don't dispatch changes to all affected pages for highly used items

gerritbot added a comment.
Change 383551 had a related patch set uploaded (by Daniel Kinzler; owner: Daniel Kinzler):
[mediawiki/extensions/Wikibase@master] Add tracking for fallout from fix for T177707

https://gerrit.wikimedia.org/r/383551TASK DETAILhttps://phabricator.wikimedia.org/T177707EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Mike_Peel, gerritbot, Jdforrester-WMF, brion, Mattflaschen-WMF, Strainu, TerraCodes, Jay8g, Liuxinyu970226, jcrespo, Bawolff, Aklapper, hoo, daniel, Ladsgroup, Lydia_Pintscher, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

gerritbot added a comment.
Change 383440 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable Statement usage tracking on cawiki and cewiki

https://gerrit.wikimedia.org/r/383440TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Project Column] T171586: Mandatory / non-mandatory constraint UI

Lucas_Werkmeister_WMDE moved this task from Doing to Review on the Wikidata-Sprint board.Lucas_Werkmeister_WMDE added a comment.
Okay, done. New screenshot:
F10143220: Screenshot-2017-10-11 Douglas Adams.pngTASK DETAILhttps://phabricator.wikimedia.org/T171586WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: gerritbot, Charlie_WMDE, Hanna_Petruschat_WMDE, Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Lucas_Werkmeister_WMDE, PokestarFan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T171586: Mandatory / non-mandatory constraint UI

Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...Different icon or icon style? Different headings? Different organization?

#patch-for-review:
- [ ] https://gerrit.wikimedia.org/r/382476 (preparation)
- [ ] https://gerrit.wikimedia.org/r/382462 (new icons)TASK DETAILhttps://phabricator.wikimedia.org/T171586EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: gerritbot, Charlie_WMDE, Hanna_Petruschat_WMDE, Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Lucas_Werkmeister_WMDE, PokestarFan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used

gerritbot added a comment.
Change 383439 merged by jenkins-bot:
[operations/mediawiki-config@master] Move WB client "disabledUsageAspects" setting into $wmgWikibaseDisabledUsageAspects

https://gerrit.wikimedia.org/r/383439TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171586: Mandatory / non-mandatory constraint UI

Lucas_Werkmeister_WMDE added a comment.
But also, the non-mandatory icon is larger again… it looks like OO.ui (or whatever it is that loads the icons – perhaps it’s a property of the browser directly?) just ignores the SVG’s declared size, so if you’re designing an icon set, the icons need to have the same base size and then be scaled within the image. I’ll try to fix the icon accordingly.TASK DETAILhttps://phabricator.wikimedia.org/T171586EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: gerritbot, Charlie_WMDE, Hanna_Petruschat_WMDE, Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Lucas_Werkmeister_WMDE, PokestarFan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171586: Mandatory / non-mandatory constraint UI

Lucas_Werkmeister_WMDE added a comment.
Hm, I think the outline thing on the non-mandatory icon isn’t so helpful, because now there are masks in the SVG, which I don’t understand at all :) fortunately, I was able to replace the entire border with an identical-looking , since all the required coordinates were very simple (20×20, stroke-width 2). (svgo then turned the  back into a .)TASK DETAILhttps://phabricator.wikimedia.org/T171586EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: gerritbot, Charlie_WMDE, Hanna_Petruschat_WMDE, Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Lucas_Werkmeister_WMDE, PokestarFan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T11:11:25Z]  starting purge of ruwiki.recentchanges T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T171586: Mandatory / non-mandatory constraint UI

2017-10-11 Thread Hanna_Petruschat_WMDE

Hanna_Petruschat_WMDE added a comment.
So here it comes again. Hope the cleanup helped as discussed.
F10140821: WD_Constraints-again-again.zipTASK DETAILhttps://phabricator.wikimedia.org/T171586EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Hanna_Petruschat_WMDECc: gerritbot, Charlie_WMDE, Hanna_Petruschat_WMDE, Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Lucas_Werkmeister_WMDE, PokestarFan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-11 Thread jcrespo

jcrespo added a comment.
ruwiki results are more extreme:

root@db2076[ruwiki]> SELECT count(*) FROM recentchanges;
+--+
| count(*) |
+--+
| 37427748 |
+--+
1 row in set (11.19 sec)

root@db2076[ruwiki]> SELECT COUNT(*) FROM recentchanges WHERE rc_source = 'wb';
+--+
| COUNT(*) |
+--+
| 36207647 |
+--+
1 row in set (8 min 57.10 sec)TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177707: don't dispatch changes to all affected pages for highly used items

2017-10-11 Thread ReleaseTaggerBot

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-17 (1.31.0-wmf.4)).
TASK DETAILhttps://phabricator.wikimedia.org/T177707EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Mike_Peel, gerritbot, Jdforrester-WMF, brion, Mattflaschen-WMF, Strainu, TerraCodes, Jay8g, Liuxinyu970226, jcrespo, Bawolff, Aklapper, hoo, daniel, Ladsgroup, Lydia_Pintscher, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

hoo added a comment.
Even though the growth has reduced to just 1.3% this week, the dump still seems to be substantially slower… since we deployed https://gerrit.wikimedia.org/r/380628 the dumps have been at least a few hours slower :/

I have no evidence that supports that https://gerrit.wikimedia.org/r/380628 might be harmful here, but we/ I might need to investigate further.TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lordiis, GoranSMilovanovic, Adik2382, Soteriaspace, Jayprakash12345, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Zoranzoki21, Lewizho99, Maathavan, Wikidata-bugs, Svick, TheDJ, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T177764: [Task] Make Wikibase JavaScript unit tests QUnit 2 compatible

2017-10-11 Thread thiemowmde

thiemowmde closed this task as "Resolved".thiemowmde removed a project: Patch-For-Review.thiemowmde updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/383383
[x] https://github.com/wmde/DataValuesJavaScript/pull/131TASK DETAILhttps://phabricator.wikimedia.org/T177764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: gerritbot, WMDE-leszek, Aleksey_WMDE, Addshore, hoo, aude, Aklapper, Krinkle, Jonas, Ladsgroup, thiemowmde, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177707: don't dispatch changes to all affected pages for highly used items

gerritbot added a comment.
Change 383384 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Quick fix for flooding of the RC table

https://gerrit.wikimedia.org/r/383384TASK DETAILhttps://phabricator.wikimedia.org/T177707EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Mike_Peel, gerritbot, Jdforrester-WMF, brion, Mattflaschen-WMF, Strainu, TerraCodes, Jay8g, Liuxinyu970226, jcrespo, Bawolff, Aklapper, hoo, daniel, Ladsgroup, Lydia_Pintscher, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T173262: Get arbitrary label from Item without loading the full Item (via Lua).

2017-10-11 Thread ReleaseTaggerBot

ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-17 (1.31.0-wmf.4)); removed MW-1.31-release-notes (WMF-deploy-2017-10-10 (1.31.0-wmf.3)).
TASK DETAILhttps://phabricator.wikimedia.org/T173262EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Bawolff, zhuyifei1999, PokestarFan, Jarekt, eranroz, Aklapper, aude, Ricordisamoa, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T173262: Get arbitrary label from Item without loading the full Item (via Lua).

gerritbot added a comment.
Change 383479 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Docs: Discourage use of mw.wikibase.getLabelByLang for getting in user lang

https://gerrit.wikimedia.org/r/383479TASK DETAILhttps://phabricator.wikimedia.org/T173262EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Bawolff, zhuyifei1999, PokestarFan, Jarekt, eranroz, Aklapper, aude, Ricordisamoa, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-11 Thread Gehel

Gehel added a comment.
According to Kirk Pepperdine, we might have run into a G1 bug... I'll try to help the JVM guys debug it, and we might get a long term solution at some point...TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-11T07:46:08Z]  restart commonswiki recentchanges purging T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Liuxinyu970226, Marostegui, jcrespo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T177764: [Task] Make Wikibase JavaScript unit tests QUnit 2 compatible

gerritbot added a comment.
Change 383383 merged by jenkins-bot:
[data-values/value-view@master] Remove QUnit.Parameterize dependency and make tests pass with QUnit 2

https://gerrit.wikimedia.org/r/383383TASK DETAILhttps://phabricator.wikimedia.org/T177764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmde, gerritbotCc: gerritbot, WMDE-leszek, Aleksey_WMDE, Addshore, hoo, aude, Aklapper, Krinkle, Jonas, Ladsgroup, thiemowmde, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T177816: Turn pseudo-extension data-values/value-view into a npm package