[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-15 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-16T05:54:52Z] Synchronized wmf-config/db-eqiad.php: Depool db1084 - T174509 T12 (duration: 00m 46s)TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 384439 merged by jenkins-bot: [operations/mediawiki-config@master] db-eqiad.php: Depool db1084 https://gerrit.wikimedia.org/r/384439TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-15 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-16T05:53:36Z] Optimize recentchanges, pagelinks and templatelinks on db1084 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 384439 had a related patch set uploaded (by Marostegui; owner: Marostegui): [operations/mediawiki-config@master] db-eqiad.php: Depool db1084 https://gerrit.wikimedia.org/r/384439TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...I consider this patchtask done when the dumps finish no later than mid-Thursday again and don't run well into the weekend.TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/383414 [x] https://gerrit.wikimedia.org/r/384204 [] Conclude and revert/ alter https://gerrit.wikimedia.org/r/384204 [] https://gerrit.wikimedia.org/r/384322 (T178247) I consider this

[Wikidata-bugs] [Maniphest] [Commented On] T178224: Tours are broken: TypeError

2017-10-15 Thread Mrjohncummings
Mrjohncummings added a comment. In T178224#3686187, @Pasleim wrote: The problem is related to overlays. I removed the overlays from the tours, now they are working again for the time being, but with a worse graphics. Thanks for identifying the issue, whilst disabling the overlays has made the

[Wikidata-bugs] [Maniphest] [Commented On] T140890: Drop EntityPerPage service

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 352797 merged by ArielGlenn: [operations/puppet@production] Do not make dumps of wb_entity_per_page https://gerrit.wikimedia.org/r/352797TASK DETAILhttps://phabricator.wikimedia.org/T140890EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T178224: Tours are broken: TypeError

2017-10-15 Thread Pasleim
Pasleim added a comment. The problem is related to overlays. I removed the overlays from the tours, now they are working again for the time being, but with a worse graphics.TASK DETAILhttps://phabricator.wikimedia.org/T178224EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 384204 merged by ArielGlenn: [operations/puppet@production] Test different batch sizes in dumpwikidatajson.sh https://gerrit.wikimedia.org/r/384204TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 383414 merged by ArielGlenn: [operations/puppet@production] Increase the shard count for Wikidata entity dumps from 5 to 6 https://gerrit.wikimedia.org/r/383414TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL

Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-15 Thread Federico Leva (Nemo)
This is an area where I would very much like to see some important properties created and populated, to the benefit e.g. of various infoboxes on Wikipedias which contain data in need of frequent updates (especially income, revenue, market capitalization, number of employees, links to most

Re: [Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-15 Thread Yaroslav Blanter
Hi Sebastian, I would say the best way is to file a request for the permissions for the bot https://www.wikidata.org/wiki/Wikidata:Requests_for_permissions/Bot and possibly leave a message on the Project Chat https://www.wikidata.org/wiki/Wikidata:Project_chat Cheers Yaroslav On Sun, Oct 15,

[Wikidata-bugs] [Maniphest] [Created] T178255: Calendar type changer link in Wikidata does not allow saving without another edit

2017-10-15 Thread agray
agray created this task.agray added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONGregorian calendar dates between 1582 and c. 1920 in Wikidata have a "change to Julian" link in the drop-down menu. If I open one of these dates to change it to Julian, and click "change

[Wikidata-bugs] [Maniphest] [Commented On] T167788: [Task] Dates written as 9/7/2017 should not always be parsed as American MM/DD/YYYY

2017-10-15 Thread agray
agray added a comment. [Apologies - forgot to ever put in a response to this. Thanks for looking into it.] I agree that 07/09/2017 is always a bit ambiguous and we can never reliably say what the user means. But I guess what's confusing me here is that 07-09-2017 or 07 09 2017 are also a bit

[Wikidata-bugs] [Maniphest] [Commented On] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

2017-10-15 Thread hoo
hoo added a comment. I just ran a patched version of dumpJson along with an unmodified version (on mwdebug1001/mwdebug1002). While both servers have the same specs, the runs might not be totally comparable and I only did one run. I ran sudo -u www-data timeout 1800 php

[Wikidata-bugs] [Maniphest] [Updated] T113468: [Task] Use compact representation of diffs in EntityChange.

2017-10-15 Thread eranroz
eranroz added a subtask: T176413: Make AffectedPagesFinder take STATEMENT_USAGE into account. TASK DETAILhttps://phabricator.wikimedia.org/T113468EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, eranrozCc: PokestarFan, hoo, gerritbot, aude, Aklapper,

[Wikidata-bugs] [Maniphest] [Updated] T176413: Make AffectedPagesFinder take STATEMENT_USAGE into account

2017-10-15 Thread eranroz
eranroz added a parent task: T113468: [Task] Use compact representation of diffs in EntityChange.. TASK DETAILhttps://phabricator.wikimedia.org/T176413EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranrozCc: daniel, DixonD, Aklapper, Bianjiang, aude,

[Wikidata-bugs] [Maniphest] [Updated] T64005: Using the language link tool in the sidebar when inside VisualEditor loses the edit without warning

2017-10-15 Thread eranroz
eranroz added projects: Wikimedia-Israel-Hackers, Easy.Herald added a subscriber: TerraCodes. TASK DETAILhttps://phabricator.wikimedia.org/T64005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranrozCc: TerraCodes, eranroz, Aklapper, Wikidata-bugs,

[Wikidata-bugs] [Maniphest] [Changed Project Column] T174043: Deploy Multi-Content Revisions

2017-10-15 Thread CCicalese_WMF
CCicalese_WMF moved this task from Inbox to MWPT-Q3-Jan-Mar-2018 on the MediaWiki-Platform-Team board.CCicalese_WMF edited projects, added MediaWiki-Platform-Team (MWPT-Q3-Jan-Mar-2018); removed MediaWiki-Platform-Team. TASK

[Wikidata-bugs] [Maniphest] [Edited] T86517: [Story] Add a new datatype for multilingual text

2017-10-15 Thread matej_suchanek
matej_suchanek updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONWe need to provide a way to save the same statement in multiple languages. Examples for its usage are : the motto of a country that has several primary languages, usage notes and comments ([[

[Wikidata-bugs] [Maniphest] [Commented On] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread hoo
hoo added a comment. T178247: Use a retrieve only CachingEntityRevisionLookup for dumps should give us another few percent, as it makes loading and unserializing entities up to 15% faster. I haven't specifically tested that in the context of the dumps, but based on old profiling data, this should

[Wikidata-bugs] [Maniphest] [Edited] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[] https://gerrit.wikimedia.org/r/384204 [] https://gerrit.wikimedia.org/r/384322 (T178247)TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL

[Wikidata-bugs] [Maniphest] [Edited] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

2017-10-15 Thread hoo
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...This suggests a **speedup of over 15%** when accessing random entities, which is a workload that should be rather similar to what the dumpers do (they need to access all entities in the end)TASK

[Wikidata-bugs] [Maniphest] [Commented On] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

2017-10-15 Thread gerritbot
gerritbot added a comment. Change 384322 had a related patch set uploaded (by Hoo man; owner: Hoo man): [mediawiki/extensions/Wikibase@master] Introduce retrieve-only CachingEntityRevisionLookups and make use https://gerrit.wikimedia.org/r/384322TASK

[Wikidata-bugs] [Maniphest] [Updated] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

2017-10-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T178247EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, daniel, Aklapper, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe,

[Wikidata-bugs] [Maniphest] [Retitled] T178249: Parameter for linking a new page to the Wikidata

2017-10-15 Thread putnik
putnik renamed this task from "Parameter for linking a new article to the Wikidata" to "Parameter for linking a new page to the Wikidata". TASK DETAILhttps://phabricator.wikimedia.org/T178249EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: putnikCc: putnik,

[Wikidata-bugs] [Maniphest] [Created] T178249: Parameter for linking a new article to the Wikidata

2017-10-15 Thread putnik
putnik created this task.putnik added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONWe need to create a GET parameter that will allow us to specify the ID of the Wikidata item when creating a new page in wiki projects. In case this parameter is specified, then the

[Wikidata-bugs] [Maniphest] [Block] T177486: Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-10-15 Thread hoo
hoo created subtask T178247: Use a retrieve only CachingEntityRevisionLookup for dumps. TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, thiemowmde, Aklapper, ezachte, daniel,

[Wikidata-bugs] [Maniphest] [Created] T178247: Use a retrieve only CachingEntityRevisionLookup for dumps

2017-10-15 Thread hoo
hoo created this task.hoo added projects: Datasets-General-or-Unknown, Wikidata, Wikibase-DataModel, Wikidata-Sprint.Herald added a subscriber: Aklapper. TASK DESCRIPTIONWe aren't currently making use of the normal entity caching mechanism when dumping entities, as we don't want to pollute the

[Wikidata] Kickstartet: Adding 2.2 million German organisations to Wikidata

2017-10-15 Thread Sebastian Hellmann
Hi all, the German business registry contains roughly 2.2 million organisations. Some information is paid, but other is public, i.e. the info you are searching for at and clicking on UT (see example below): https://www.handelsregister.de/rp_web/mask.do?Typ=e I would like to add this to

[Wikidata-bugs] [Maniphest] [Closed] T177269: Is `altitude` in `globe-coordinate` still in use?

2017-10-15 Thread CXuesong
CXuesong closed this task as "Resolved".CXuesong claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T177269EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CXuesongCc: CXuesong, Aklapper, GoranSMilovanovic, QZanden, Wikidata-bugs, aude,

[Wikidata-bugs] [Maniphest] [Commented On] T177269: Is `altitude` in `globe-coordinate` still in use?

2017-10-15 Thread CXuesong
CXuesong added a comment. Jeroen De Dauw replied in the mailing list: It is not in use and never really was. (Code indicating it is not in use: https://github.com/DataValues/Geo/blob/2d8e852d04318b13bd0db39b24afe7c56c61dc3e/src/Values/GlobeCoordinateValue.php#L193-L195 ) I'm not entirely sure