[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

2017-03-29 Thread hoo
hoo added a comment. HHVM on snapshot1007: 22079 datasets 20 0 10.522g 9.948g 22216 R 88.5 15.8 78:49.10 php /srv/mediawiki/multiversion/MWScript.php extensions/Wikidata/extensions/Wikibase/repo/maintenance/dumpRdf.php --wiki wikidatawiki --sharding-factor 5 --shard 0 --snippet Processed 4247

[Wikidata-bugs] [Maniphest] [Commented On] T128724: [Bug] Using wbeditentity, properties with arbitrary data type id can be created

2017-03-29 Thread gerritbot
gerritbot added a comment. Change 345132 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Don't allow creating properties with arbitrary datatypes https://gerrit.wikimedia.org/r/345132TASK DETAILhttps://phabricator.wikimedia.org/T128724EMAIL PREFERENCEShttps://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

2017-03-29 Thread ArielGlenn
ArielGlenn added a comment. Sorry, I didn't see your replies @hoo until after I posted my comment. Let's see what your test run shows.TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlennCc: gerritbot, h

[Wikidata-bugs] [Maniphest] [Commented On] T128724: [Bug] Using wbeditentity, properties with arbitrary data type id can be created

2017-03-29 Thread gerritbot
gerritbot added a comment. Change 345296 had a related patch set uploaded (by Thiemo Mättig (WMDE)): [mediawiki/extensions/Wikibase@master] Minimize DataTypeDefinitions usage in EditEntity further https://gerrit.wikimedia.org/r/345296TASK DETAILhttps://phabricator.wikimedia.org/T128724EMAIL PREFER

[Wikidata-bugs] [Maniphest] [Assigned] T161631: [Task] Remove "all" option for Special:EntitiesWithout*"

2017-03-29 Thread thiemowmde
thiemowmde assigned this task to daniel. TASK DETAILhttps://phabricator.wikimedia.org/T161631EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, thiemowmdeCc: hoo, thiemowmde, aude, gerritbot, daniel, Aklapper, Lydia_Pintscher, Adik2382, Th3d3v1ls, Ramalep

[Wikidata-bugs] [Maniphest] [Changed Project Column] T161631: [Task] Remove "all" option for Special:EntitiesWithout*"

2017-03-29 Thread thiemowmde
thiemowmde added subscribers: thiemowmde, hoo.thiemowmde moved this task from incoming to in current sprint on the Wikidata board.thiemowmde added a project: MediaWiki-extensions-WikibaseRepository. TASK DETAILhttps://phabricator.wikimedia.org/T161631WORKBOARDhttps://phabricator.wikimedia.org/proje

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

2017-03-29 Thread hoo
hoo added a comment. I just started one Rdf shard dump (to /dev/null) with Zend and one with HHVM. Let's see how that goes.TASK DETAILhttps://phabricator.wikimedia.org/T161577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, hoo, ArielGlenn, Ge

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

2017-03-29 Thread ArielGlenn
ArielGlenn added a comment. In addition, snapshot1007 is used for other things simultaneously (e.g. xml/sql dump generation, like the other snapshot hosts). We leave some cores and memory unused for cron jobs like the wikidata dumps, but 30 processes at once is not manageable. 5 or 6 is what we'd

[Wikidata-bugs] [Maniphest] [Commented On] T161577: OOM problems with snapshot1007 due to wikidata dumpRdf jobs taking all 60GB+ of main memory

2017-03-29 Thread hoo
hoo added a comment. this dump spawns 30 php processes It shouldn't and probably doesn't: It spawns 5 processes, though these processes might have multiple threads each (this is HHVM in the end). To rule out a memory leak in hhvm we might also want to run the script with Zend once.TASK DETAILhttp

[Wikidata-bugs] [Maniphest] [Commented On] T97018: [Story] Integrate violations into Wikidata UI

2017-03-29 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. {icon thumbs-up}TASK DETAILhttps://phabricator.wikimedia.org/T97018EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Lydia_Pintscher, Jan_Dittrich, abian, Bene, Jonas, Ricordisamoa, dominic.sauer, Liuxinyu97022

[Wikidata-bugs] [Maniphest] [Commented On] T97018: [Story] Integrate violations into Wikidata UI

2017-03-29 Thread Jan_Dittrich
Jan_Dittrich added a comment. Some remarks from a usability perspective: We have few space (Which makes icons attractive) …but no one understands Icons we think up ourselves …in particular, simple traffic-light metaphors are to be avoided, since in their full-traffic-light they use up much space

[Wikidata-bugs] [Maniphest] [Edited] T161592: Account for foreign repositories in RDF mapping

2017-03-29 Thread WMDE-leszek
WMDE-leszek edited the task description. (Show Details) EDIT DETAILSWhen entities for the foreign repository are mapped to RDF, the base of the concept URI defined for the repository should be used to derive relevantconcept and description URIs of entities should take the repository into considerat

[Wikidata-bugs] [Maniphest] [Changed Project Column] T160522: [Story] List for Forms

2017-03-29 Thread WMDE-leszek
WMDE-leszek moved this task from Done to Doing on the Wikidata-Sprint board.WMDE-leszek added a comment. From Backlog straight to Done, that's quite a progress :) More seriously: I can't see browser tests covering the functionality mentioned here (a.k.a. "acceptance criteria"), so this should be ba

[Wikidata-bugs] [Maniphest] [Updated] T160524: [Story] Add Form to list of Forms

2017-03-29 Thread Jan_Dittrich
Jan_Dittrich added a subscriber: thiemowmde.Jan_Dittrich added a comment. M210 is my first draft – @thiemowmde @Jonas any concerns with that direction? (Proper font sizes etc. still missing)TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settin

[Wikidata-bugs] [Pholio] [Updated] M210: Mockup for adding a form to a forms list of a lexeme in strctured data/Wikidata for wiktionary

2017-03-29 Thread Jan_Dittrich
Jan_Dittrich added a task: T160524: [Story] Add Form to list of Forms.MOCK DETAILhttps://phabricator.wikimedia.org/M210EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: thiemowmde, Jonas, Charlie_WMDE, QZanden, D3r1ck01, Izno, Wikidata-bugs, aude

[Wikidata-bugs] [Maniphest] [Updated] T160524: [Story] Add Form to list of Forms

2017-03-29 Thread Jan_Dittrich
Jan_Dittrich added a mock: M210: Mockup for adding a form to a forms list of a lexeme in strctured data/Wikidata for wiktionary. TASK DETAILhttps://phabricator.wikimedia.org/T160524EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: Jan_Dittrich, J

[Wikidata-bugs] [Pholio] [Updated] M210: Mockup for adding a form to a forms list of a lexeme in strctured data/Wikidata for wiktionary

2017-03-29 Thread Jan_Dittrich
Jan_Dittrich created "Mockup for adding a form to a forms list of a lexeme in strctured data/Wikidata for wiktionary". Jan_Dittrich added subscribers: Charlie_WMDE, Jonas, thiemowmde. Jan_Dittrich added an image: AddLexemeForm.png. Jan_Dittrich added a project: Wikidata.MOCK DETAILhttps://phabricat

[Wikidata-bugs] [Maniphest] [Closed] T155990: Framework for CI testing of EditEntity API for Lexeme

2017-03-29 Thread WMDE-leszek
WMDE-leszek closed this task as "Resolved".WMDE-leszek moved this task from Review to Done on the Wikidata-Sprint board.WMDE-leszek removed WMDE-leszek as the assignee of this task.WMDE-leszek removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T155990WORKBOARDhttps://

[Wikidata-bugs] [Maniphest] [Unblock] T155699: Integrate WikibaseLexeme with EditEntity API module

2017-03-29 Thread WMDE-leszek
WMDE-leszek closed subtask T155990: Framework for CI testing of EditEntity API for Lexeme as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T155699EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Aleksey_WMDE, gerritbot, Aklapper, Ladsg

[Wikidata-bugs] [Maniphest] [Updated] T161674: Implement LexemeFieldDefinitions (for search) and register with LexemeHandler

2017-03-29 Thread WMDE-leszek
WMDE-leszek added a project: Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T161674EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: gerritbot, aude, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, D

[Wikidata-bugs] [Maniphest] [Triaged] T161674: Implement LexemeFieldDefinitions (for search) and register with LexemeHandler

2017-03-29 Thread WMDE-leszek
WMDE-leszek triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T161674EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: gerritbot, aude, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maatha

<    1   2