[Wikidata-bugs] [Maniphest] [Commented On] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

Smalyshev added a comment. The page for nominating endpoints is here: https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input It'd be nice to have licensing and documentation pages for each (more than one can have the same docs/license of course).TASK

[Wikidata-bugs] [Maniphest] [Updated] T121274: Provide an RDF mapping for external identifiers

Smalyshev added a comment. Do we have any architecture to deal with this (purge affected Special:EntityData/*.ttl pages from Varnish No, we do not. In fact, I'm not sure we even have one to deal with simpler cases. See e.g. T128667. And is this a big problem? Not sure. Hopefully not too big,

[Wikidata-bugs] [Maniphest] [Commented On] T174298: Figure out a way for WDQS example parsing not rely on parsoid

Yurik added a comment. I have already implemented this as part of my own override: https://github.com/nyurik/wikidata-query-gui/blob/master/wikibase/queryService/api/QuerySamples.js#L171TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

debt moved this task from In progress to Done on the Discovery-Analysis (Current work) board.debt added a comment. @chelsyx - let's work on finishing up the other metrics before we take on any additional training and testing of the models (since the feature we're looking at isn't already being

[Wikidata-bugs] [Maniphest] [Commented On] T121274: Provide an RDF mapping for external identifiers

Lucas_Werkmeister_WMDE added a comment. One thing I’ve just realized (not sure if it was discussed somewhere before): editing a “URI used in RDF” statement on a property invalidates all wdtn:/psn:/pqn:/prn: triples for that property, across all entities. I can’t think of any other kind of edit

[Wikidata-bugs] [Maniphest] [Commented On] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

chelsyx added a comment. In T177353#3714007, @debt wrote: Oh, that looks like that will be quite interesting, @chelsyx, although it looks like it might be a bit of manual work involved. Getting data from the move log is easy, but it will take some time to train and adjust the model. @debt

[Wikidata-bugs] [Maniphest] [Commented On] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting

chelsyx added a comment. In T177353#3716995, @debt wrote: Great idea, @EBernhardson, let's do it! @chelsyx can you get that sampling from the data we already have? @debt Yes, I can get those queries from TestSearchSatisfaction2 table. We will need help from @EBernhardson to run them against

[Wikidata-bugs] [Maniphest] [Commented On] T179338: Q8229 shows "u niversalidD" as Dutch description in wbsearchentities, despite having no description in nl

jhsoby added a comment. That description was added in this edit and reverted 3 hours and 11 minutes later in this edit. I assume setting a random description and then deleting it should fix this issue for this specific item, but it might be symptomatic of something else that's worth looking

[Wikidata-bugs] [Maniphest] [Created] T179338: Q8229 shows "u niversalidD" as Dutch description in wbsearchentities, despite having no description in nl

Sjoerddebruin created this task.Sjoerddebruin added projects: Wikidata, Regression.Herald added a subscriber: Aklapper. TASK DESCRIPTIONThis query shows the non-existing description "u niversalidD". This value isn't present as Dutch description, so normally the English fallback would be showed. {

[Wikidata-bugs] [Maniphest] [Changed Project Column] T177198: Assist with the GLAM stakeholders survey for Structured Commons

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T177198WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T177204: Enable the Structured Commons newsletter via Extension:Newsletter as well

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T177204WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174168: Update the Frequently Asked Questions (FAQ) pages about Structured Data on Commons

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T174168WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T174168: Update the Frequently Asked Questions (FAQ) pages about Structured Data on Commons

SandraF_WMF added a comment. We have a basic FAQ: https://commons.wikimedia.org/wiki/Commons:Structured_data/About/FAQTASK DETAILhttps://phabricator.wikimedia.org/T174168EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, PokestarFan, Elitre,

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173971: Get community input on tools, bots and workflows on Wikimedia Commons that will likely be affected by Structured Data on Commons.

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T173971WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173979: Get community input on a wide variety of interesting Commons files that can be used as examples to prepare for metadata modelling

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T173979WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174142: Build up and facilitate a focus group of Commons and Wikidata contributors for (long-term) feedback and input on Structured Data on Common

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T174142WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173924: Revisit old Structured Data on Commons documentation (2014) + summarize and archive

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T173924WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T173978: Collect and get community input on user stories related to Structured Data on Commons

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T173978WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174134: Build up and facilitate a focus group of GLAM representatives for (long-term) feedback on Structured Data on Commons

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T174134WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174565: Gather first community input and create focus groups for Structured Data on Wikimedia Commons

SandraF_WMF moved this task from October to November on the Community-Liaisons (Oct-Dec 2017) board. TASK DETAILhttps://phabricator.wikimedia.org/T174565WORKBOARDhttps://phabricator.wikimedia.org/project/board/2706/EMAIL

[Wikidata-bugs] [Maniphest] [Closed] T174928: Initiate v1 of a glossary about Structured Data on Commons.

SandraF_WMF closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T174928EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, PokestarFan, Elitre, Aklapper, Ramsey-WMF, SandraF_WMF, Lahi, E1presidente, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Commented On] T174928: Initiate v1 of a glossary about Structured Data on Commons.

SandraF_WMF added a comment. Here it is! There will still be some polishing, but the basics are there. https://commons.wikimedia.org/wiki/Commons:Structured_data/About/GlossaryTASK DETAILhttps://phabricator.wikimedia.org/T174928EMAIL

[Wikidata-bugs] [Maniphest] [Unblock] T173820: Cleanup and update drive of information pages / portal about Structured Data on Commons

SandraF_WMF closed subtask T174928: Initiate v1 of a glossary about Structured Data on Commons. as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T173820EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, Ramsey-WMF, Aklapper,

[Wikidata-bugs] [Maniphest] [Block] T170236: [Epic] Newsletters about Structured Data on Commons

SandraF_WMF created subtask T179328: Structured Commons newsletter - Nov-Dec 2017 edition. TASK DETAILhttps://phabricator.wikimedia.org/T170236EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, Qgil, Elitre, PokestarFan, Sadads, SandraF_WMF,

[Wikidata-bugs] [Maniphest] [Created] T179328: Structured Commons newsletter - Nov-Dec 2017 edition

SandraF_WMF created this task.SandraF_WMF added projects: Wikidata, Structured-Data-Commons, Community-Liaisons, Epic. TASK DESCRIPTIONA new newsletter!TASK DETAILhttps://phabricator.wikimedia.org/T179328EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Closed] T173840: Send out Structured Data on Commons Newsletter - The October 2017 Edition

SandraF_WMF closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T173840EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, Aklapper, Sadads, PokestarFan, Elitre, SandraF_WMF, Lahi, E1presidente, Ramsey-WMF,

[Wikidata-bugs] [Maniphest] [Unblock] T170236: [Epic] Newsletters about Structured Data on Commons

SandraF_WMF closed subtask T173840: Send out Structured Data on Commons Newsletter - The October 2017 Edition as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T170236EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, Qgil, Elitre,

[Wikidata-bugs] [Maniphest] [Commented On] T173840: Send out Structured Data on Commons Newsletter - The October 2017 Edition

SandraF_WMF added a comment. Done! https://meta.wikimedia.org/wiki/Structured_Data_on_Commons/Newsletter/2017-10-25TASK DETAILhttps://phabricator.wikimedia.org/T173840EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Abit, Aklapper, Sadads,

[Wikidata-bugs] [Maniphest] [Updated] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Aklapper, hoo, Lahi,

[Wikidata-bugs] [Maniphest] [Commented On] T179312: robots.txt prevents indexing of Special:EntityData

daniel added a comment. robots.txt is controlled by the WMF. Special pages are listed there because Special pages generally contain dynamic data, and should not be cached. Special:EntityData could be indexable, but it's a bit awkward. Depending on the request (particularly, the query string and

[Wikidata-bugs] [Maniphest] [Updated] T179235: "Create article" with translation causes "this.config is undefined mw.cx.SiteMapper.prototype.getPageUrl"

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T179235EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Liridon, Aklapper, Lucie,

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack added a comment. In T179156#3720392, @BBlack wrote: In T179156#3719995, @BBlack wrote: We have an obvious case of normal slow chunked uploads of large files to commons to look at for examples to observe, though. Rewinding a little: this is false, I was just getting confused by

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack added a comment. In T179156#3719995, @BBlack wrote: We have an obvious case of normal slow chunked uploads of large files to commons to look at for examples to observe, though. Rewinding a little: this is false, I was just getting confused by terminology. Commons "chunked" uploads

[Wikidata-bugs] [Maniphest] [Commented On] T150136: multiple items with identical coordinates not discoverable in map view?

Jonas added a comment. Does not completely fix the problem, but at least is an improvement for some situations... Decreased fill opacity so overlaps are discoverable: F1052: image.pngTASK DETAILhttps://phabricator.wikimedia.org/T150136EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

EBernhardson added a comment. All jobs have a requestId parameter, which is passed down through the execution chain. This is the same as the reqId field in logstash. Basically this means if the originating request logged anything to logstash, you should be able to find it with the query

[Wikidata-bugs] [Maniphest] [Changed Project Column] T150136: multiple items with identical coordinates not discoverable in map view?

Jonas moved this task from Backlog to Doing on the Wikidata Query UI board. TASK DETAILhttps://phabricator.wikimedia.org/T150136WORKBOARDhttps://phabricator.wikimedia.org/project/board/2901/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: gerritbot,

[Wikidata-bugs] [Maniphest] [Updated] T150136: multiple items with identical coordinates not discoverable in map view?

gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T150136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Yurik, Aklapper, Esc3300, Lahi, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] [Commented On] T150136: multiple items with identical coordinates not discoverable in map view?

gerritbot added a comment. Change 387298 had a related patch set uploaded (by Jonas Kress (WMDE); owner: Jonas Kress (WMDE)): [wikidata/query/gui@master] Decrease fill opacity so overlaps are discoverable https://gerrit.wikimedia.org/r/387298TASK

[Wikidata-bugs] [Maniphest] [Updated] T150136: multiple items with identical coordinates not discoverable in map view?

Jonas edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAILhttps://phabricator.wikimedia.org/T150136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Yurik, Aklapper, Esc3300, Lahi, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

elukey added a comment. We had some relief after the last change in the configs of the jobrunners, namely the queue started shrinking, but then we got back into the bad behavior in which we have constantly more jobs enqueued vs completed: F10519970: Screen Shot 2017-10-30 at 6.19.11 PM.png I am

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

daniel added a comment. Because they're POST they'd be handled as an immediate pass through the varnish layers, so I don't think this would cause what we're looking at now. "pass" means stream, right? wouldn't that also grab a backend connection from the pool, and hog it if throughput is slow?

[Wikidata-bugs] [Maniphest] [Commented On] T178652: Wikidata dispatchers should use a LockManager with a short TTL

daniel added a comment. @hoo Sounds like we should just go ahead and do this! Don't forget to change dispatchingLockManager accordingly.TASK DETAILhttps://phabricator.wikimedia.org/T178652EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T179038: DomainException / NullResult holds no constraint

ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)); removed MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T179038EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T179312: robots.txt prevents indexing of Special:EntityData

Lydia_Pintscher added subscribers: aude, daniel, hoo.Lydia_Pintscher added a comment. @daniel @hoo @aude: Can you say if this rule is needed or if we can get rid of it?TASK DETAILhttps://phabricator.wikimedia.org/T179312EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T178997: AddUsagesForPageJob doesn't really report execution status

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T178997EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pchelolo, ReleaseTaggerBotCc: thiemowmde, gerritbot, daniel,

[Wikidata-bugs] [Maniphest] [Created] T179312: robots.txt prevents indexing of Special:EntityData

Lydia_Pintscher created this task.Lydia_Pintscher added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONWe currently disallow indexing of any /entity/Q... URI via our robots.txt because we disallow indexing of Special:EntityData. I've been asked if we can change this

[Wikidata-bugs] [Maniphest] [Edited] T178652: Wikidata dispatchers should use a LockManager with a short TTL

hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...I suggest to addconfigure a new (redis based) lockmanger either specifically for this, or generally for "short lived tasks" with a `lockTTL` of maybe 5m. (This may or may not be the reason behind yesterday's dispatch

[Wikidata-bugs] [Maniphest] [Changed Project Column] T145819: Jobs invoking SiteConfiguration::getConfig cause HHVM to fail updating the bytecode cache due to being filesize limited to 512MBytes

greg moved this task from To Triage to Backlog on the Release-Engineering-Team board.greg edited projects, added Release-Engineering-Team (Backlog); removed Release-Engineering-Team. TASK

[Wikidata-bugs] [Maniphest] [Updated] T145819: Jobs invoking SiteConfiguration::getConfig cause HHVM to fail updating the bytecode cache due to being filesize limited to 512MBytes

greg added a project: Scap. TASK DETAILhttps://phabricator.wikimedia.org/T145819EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gregCc: thcipriani, Anomie, aaron, MZMcBride, Tobi_WMDE_SW, FastLizard4, JJMC89, zeljkofilipin, Lydia_Pintscher, daniel, aude,

[Wikidata-bugs] [Maniphest] [Commented On] T95685: Drop wb_entity_per_page table

MusikAnimal added a comment. In T95685#3720048, @Ladsgroup wrote: Hey, It has been announced in June 1st and we waited for several months and then reminded in early October. Ah I see. I was not subscribed to wikidata-tech, but I am now :) Dropping a table seems like a major change. Perhaps

[Wikidata-bugs] [Maniphest] [Lowered Priority] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack lowered the priority of this task from "Unbreak Now!" to "High".BBlack added a comment. Reducing this from UBN->High, because current best-working-theory is this problem is gone so long as we keep the VCL do_stream=false change reverted. Obviously, there's still some related investigations

[Wikidata-bugs] [Maniphest] [Commented On] T95685: Drop wb_entity_per_page table

Ladsgroup added a comment. Hey, It has been announced in June 1st and we waited for several months and then reminded in early October.TASK DETAILhttps://phabricator.wikimedia.org/T95685EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: MusikAnimal,

[Wikidata-bugs] [Maniphest] [Commented On] T177257: ArticlePlaceholder hit counts from bnwiki seem bogus

JAllemandou added a comment. Hi folks, Not a bug for me: SELECT access_method, count(1) from wmf.webrequest WHERE is_pageview AND pageview_info['project'] = 'bn.wikipedia' AND year = 2017 AND month = 9 AND day = 30 AND webrequest_source = 'text' AND x_analytics_map['ns'] = '-1' AND

[Wikidata-bugs] [Maniphest] [Updated] T172914: [Tracking] Lazy register fine-grained usage tracking in generic Lua getters via __index

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T172914EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranroz, ReleaseTaggerBotCc: Stashbot, Bawolff, thiemowmde,

[Wikidata-bugs] [Maniphest] [Updated] T179038: DomainException / NullResult holds no constraint

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T179038EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, ReleaseTaggerBotCc: Stashbot,

[Wikidata-bugs] [Maniphest] [Updated] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)). TASK DETAILhttps://phabricator.wikimedia.org/T178247EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: ArielGlenn, gerritbot, daniel,

[Wikidata-bugs] [Maniphest] [Updated] T148411: Item search for statements ranks disambiguation items too highly

ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)); removed MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)). TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T177257: ArticlePlaceholder hit counts from bnwiki seem bogus

Addshore added a comment. It looks like most of this traffic is coming from Internet.org per the IORG proxy shown in the X-Analytics header as set by modules/varnish/templates/analytics.inc.vcl.erb in operations/puppet I have updated the X-Analytics page on wikitech to show this IORG proxy which

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack added a comment. In T179156#3719928, @daniel wrote: In any case, this would consume front-edge client connections, but wouldn't trigger anything deeper into the stack That's assuming varnish always caches the entire request, and never "streams" to the backend, even for file uploads. When

[Wikidata-bugs] [Maniphest] [Updated] T95685: Drop wb_entity_per_page table

MusikAnimal added a comment. Was this ever announced? I woke up today getting reports that XTool's ArticleInfo tool was broken. I searched my email and the only place I saw mention of wb_entity_per_page was in the Scrum of Scrum meeting notes, and not any sort of targeted, formal announcement.

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

daniel added a comment. In any case, this would consume front-edge client connections, but wouldn't trigger anything deeper into the stack That's assuming varnish always caches the entire request, and never "streams" to the backend, even for file uploads. When discussing this with @hoo he told me

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack added a comment. Trickled-in POST on the client side would be something else. Varnish's timeout_idle, which is set to 5s on our frontends, acts as the limit for receiving all client request headers, but I'm not sure that it has such a limitation that applies to client-sent bodies. In any

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

daniel added a comment. @BBlack wrote: something that's doing a legitimate request->response cycle, but trickling out the bytes of it over a very long period. That's a well known attack method. Could this be coming from the outside, trickling bits bytes of a post? Are we sure we are safe against

[Wikidata-bugs] [Maniphest] [Updated] T168532: Check constraints on qualifiers and references

ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)); removed MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)). TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T178757: Add diff support for Lexeme

ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)); removed MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)). TASK DETAILhttps://phabricator.wikimedia.org/T178757EMAIL

[Wikidata-bugs] [Maniphest] [Closed] T163551: Huge number of duplicate rows in wb_terms

Lydia_Pintscher closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T163551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, Lydia_PintscherCc: Lydia_Pintscher, Krinkle, Ladsgroup, gerritbot, daniel, Smalyshev, jcrespo, aude,

[Wikidata-bugs] [Maniphest] [Commented On] T177257: ArticlePlaceholder hit counts from bnwiki seem bogus

hoo added a comment. I looked at this again earlier today and there are actually a lot of requests to APs on bnwiki… all coming from Facebook IP ranges (ipv6), but with different UAs and organically looking patterns.TASK DETAILhttps://phabricator.wikimedia.org/T177257EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T174298: Figure out a way for WDQS example parsing not rely on parsoid

Lucas_Werkmeister_WMDE added a parent task: T179262: wikibase-docker wdqs-frontend The example button leads to the examples from Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:

[Wikidata-bugs] [Maniphest] [Updated] T179262: wikibase-docker wdqs-frontend The example button leads to the examples from Wikidata

Lucas_Werkmeister_WMDE added a subtask: T174298: Figure out a way for WDQS example parsing not rely on parsoid. TASK DETAILhttps://phabricator.wikimedia.org/T179262EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Jonas, Addshore,

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387236 had a related patch set uploaded (by BBlack; owner: BBlack): [operations/debs/varnish4@debian-wmf] [WIP] backend transaction_timeout https://gerrit.wikimedia.org/r/387236TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

Lucas_Werkmeister_WMDE added a subscriber: Smalyshev.Lucas_Werkmeister_WMDE added a comment. I think @Smalyshev is the final authority on that, I just wanted to get started with some information that AFAIK he’ll need anyways :)TASK DETAILhttps://phabricator.wikimedia.org/T179268EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

Jneubert added a comment. OK, I did not think about licenses - sorry! /gnd/ is just the dump of the CC0 set provided at https://data.dnb.de/opendata/. I did not include additional data. /repec/ are the authors and organization from repec.org. Their statement at

[Wikidata-bugs] [Maniphest] [Updated] T179286: WDCM Regular Updates

GoranSMilovanovic added a project: Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T179286EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GoranSMilovanovicCc: Tobi_WMDE_SW, Addshore, Lydia_Pintscher, GoranSMilovanovic, Aklapper, Lahi, QZanden,

[Wikidata-bugs] [Maniphest] [Commented On] T177257: ArticlePlaceholder hit counts from bnwiki seem bogus

Addshore added a comment. @hoo do you mean https://github.com/wikimedia/analytics-refinery-source/commit/efb4b5c53c666b7204820f39f9f6b9bef5c3fbcf#diff-a8fb32654e92b0615778ea4620228001R91 ?TASK DETAILhttps://phabricator.wikimedia.org/T177257EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop

Ladsgroup added a comment. In T173710#3718725, @Jack_who_built_the_house wrote: Thanks for the reply. It just surprises me that on enwiki, the job queue is very lightweight, while on ruwiki, it's 2/3 of the overall pages count, and enwiki is much more active. Is it because of wide use of Wikidata

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387228 had a related patch set uploaded (by BBlack; owner: BBlack): [operations/puppet@production] cache_text: reduce inter-cache backend timeouts as well https://gerrit.wikimedia.org/r/387228TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387225 had a related patch set uploaded (by BBlack; owner: BBlack): [operations/puppet@production] cache_text: reduce applayer timeouts to reasonable values https://gerrit.wikimedia.org/r/387225TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

Lucas_Werkmeister_WMDE added a comment. In T179156#3719057, @BBlack wrote: could other services on text-lb be making these kinds of queries to WDQS on behalf of the client and basically proxying the same behavior through? WikibaseQualityConstraints runs a limited set of queries, but none that

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T54971: [Goal] Sitelinks to Incubator, OldWikisource and BetaWikiversity

Lydia_Pintscher added a subscriber: daniel.Lydia_Pintscher added a comment. @daniel @hoo what's your thinking about @Tpt's suggestion?TASK DETAILhttps://phabricator.wikimedia.org/T54971EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: daniel,

[Wikidata-bugs] [Maniphest] [Commented On] T146838: Allow seeking in UsageLookup::getPagesUsing results

hoo added a comment. This is currently running into timeouts from time to time: 2017-10-30 08:20:44 [24fef4b5c21833a8949cf7b1] mw1302 ruwiki 1.31.0-wmf.4 DBQuery WARNING: Wikimedia\Rdbms\Database::query: lost connection to 10.64.32.114; reconnected: #0

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 386824 merged by BBlack: [operations/puppet@production] Revert "cache_text: raise MW connection limits to 10K" https://gerrit.wikimedia.org/r/386824TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] Move wikidatawiki back to wmf5 [] Re-enable remex html (T178632) [x] Re-enable the RDF mapping of external identifiers on Wikidata (T178180) [x] Re-enable the RDF mapping of external identifiers on Wikidata

[Wikidata-bugs] [Maniphest] [Unblock] T121274: Provide an RDF mapping for external identifiers

hoo closed subtask T178180: Enable RDF mapping for external identifiers for Wikidata.org as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T121274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, hooCc: Pigsonthewing, mkroetzsch, Denny,

[Wikidata-bugs] [Maniphest] [Closed] T178180: Enable RDF mapping for external identifiers for Wikidata.org

hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.hoo added a comment. This has been enabled (again) and this time it's here to stay! \o/TASK DETAILhttps://phabricator.wikimedia.org/T178180EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

BBlack added a comment. In T179156#3718772, @ema wrote: There's a timeout limiting the total amount of time varnish is allowed to spend on a single request, send_timeout, defaulting to 10 minutes. Unfortunately there's no counter tracking when the timer kicks in, although a debug line is logged

[Wikidata-bugs] [Maniphest] [Commented On] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

Lucas_Werkmeister_WMDE added a comment. The licensing situation seems unclear for some of these databases. I only found this page, which only documents two of these endpoints. The data under /stw/ is ODbL 1.0 according to these pages. The data under /gnd/ is unclear to me. GND data itself is CC0

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-30T11:44:38Z] Synchronized wmf-config/Wikibase.php: Re-add property for RDF mapping of external identifiers for Wikidata (T179156, T178180) (duration: 00m 49s)TASK

[Wikidata-bugs] [Maniphest] [Updated] T178180: Enable RDF mapping for external identifiers for Wikidata.org

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-30T11:44:38Z] Synchronized wmf-config/Wikibase.php: Re-add property for RDF mapping of external identifiers for Wikidata (T179156, T178180) (duration: 00m 49s)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387190 merged by jenkins-bot: [operations/mediawiki-config@master] Revert "Revert "Add property for RDF mapping of external identifiers for Wikidata"" https://gerrit.wikimedia.org/r/387190TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-30T11:33:14Z] Synchronized wmf-config/Wikibase-production.php: Re-enable constraints check with SPARQL (T179156) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387189 merged by jenkins-bot: [operations/mediawiki-config@master] Revert "Disable constraints check with SPARQL for now" https://gerrit.wikimedia.org/r/387189TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

Lucas_Werkmeister_WMDE added a comment. The only live polling feature I can think of that was recently introduced is for the live updates to Special:RecentChanges. As far as I know, that feature just reloads the recent changes every few seconds with a new request. Another thing that might be

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-30T11:15:55Z] rebuilt wikiversions.php and synchronized wikiversions files: Wikidatawiki back to wmf.5 (T179156)TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

gerritbot added a comment. Change 387188 merged by jenkins-bot: [operations/mediawiki-config@master] Revert "Wikidatawiki to wmf.4" https://gerrit.wikimedia.org/r/387188TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T178722: Remove puppet class role::labs::lvm::mnt

Stashbot added a comment. Mentioned in SAL (#wikimedia-releng) [2017-10-30T10:56:20Z] deployment-logstash2 removed puppet class role::labs::lvm::mnt, replacing with role::labs::lvm::srv . /srv is already mounted. Unmounting /mnt and restarting elastcisearch - T178722TASK

[Wikidata-bugs] [Maniphest] [Edited] T178722: Remove puppet class role::labs::lvm::mnt

hashar updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Project: deployment-prep #beta-cluster-infrastructure - **DONE** Oct 30th * deployment-logstash2.deployment-prep.eqiad.wmflabs...TASK DETAILhttps://phabricator.wikimedia.org/T178722EMAIL

[Wikidata-bugs] [Maniphest] [Unblock] T108944: [Epic] Improve change dispatching

hoo closed subtask T179060: Dispatchers occasionally seem to "freeze" for certain wikis as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T108944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Sjoerddebruin, hoo, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] [Closed] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review.hoo moved this task from Review to Done on the Wikidata-Sprint board.hoo claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T179060WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T179060: Dispatchers occasionally seem to "freeze" for certain wikis

gerritbot added a comment. Change 387114 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Remove bogus "lock" condition from SqlChangeDispatchCoordinator query https://gerrit.wikimedia.org/r/387114TASK DETAILhttps://phabricator.wikimedia.org/T179060EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

Aklapper added a project: Wikidata-Query-Service.Aklapper added a comment.Herald added projects: Wikidata, Discovery. I assume this task is about #wikidata-query-serviceTASK DETAILhttps://phabricator.wikimedia.org/T179268EMAIL

  1   2   >