[Wikidata-bugs] [Maniphest] [Edited] T125500: Index Wikidata labels and descriptions as separate fields in ElasticSearch

2017-05-01 Thread Smalyshev
Smalyshev added a subscriber: dcausse.Smalyshev edited the task description. (Show Details)
EDIT DETAILSThis task is for adding labels & descriptions into ElasticSearch and enabling prefix search to use them. Current progress plan:

[] Implement the code for creating & indexing label fields
[] Reindex testwiki and check that index looks sane 
[] Reindex wikidata and check that index looks sane (T162292)
[] Add code that allows wbsearchentities to use search engine depending on query flag
[] Setup test page comparing two searches and make an announcement on the list to gather user feedback.
[] Collect feedback and bikeshed about search profiles, weights and result ranking, hopefully arriving to some workable weights profile.
[] Set up the config above in production and enable CirrusSearch on wbsearchentities by default.
[] Discuss & resolve question of how to display entity & title search together
[] Refactor code more to allow opensearch and other code using completionSearch() use the same code as wbsearchentities, in service of the results of the discussion above.
[] Implement the GUI part of the two items above.
[] Figure out how to properly index descriptions (may require some work with analyzers due to different languages, probably need to discuss with @dcausse)
[] Make code to allow fulltext search to use entity search when appropriate. 
[] Enable Cirrus searching for Special:SearchTASK DETAILhttps://phabricator.wikimedia.org/T125500EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Jonas, gerritbot, JanZerebecki, daniel, thiemowmde, Tobi_WMDE_SW, Smalyshev, Aklapper, StudiesWorld, Deskana, aude, Ricordisamoa, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Avner, Lewizho99, Maathavan, debt, Gehel, Jdrewniak, FloNight, Izno, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers

2017-05-01 Thread Multichill
Multichill added a comment.
I haven't done anything yet, but quite a few pages already have the page_prop:

MariaDB [wikidatawiki_p]> SELECT COUNT(*) FROM page_props WHERE pp_propname='wb-identifiers' LIMIT 1;
+--+


COUNT(*)


+--+


673659


+--+
1 row in set (0.66 sec)

Some heavy job running that is updating a lot of pages? I'll take it easy with the run.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T164219: LDF server fails on large page numbers

2017-05-01 Thread Smalyshev
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONIf LDF server is given a large page number for a big dataset - like https://query.wikidata.org/bigdata/ldf?page=1856001 - it takes a lot of time and ultimately fails with this error message:

May 01 20:07:40 wdqs1001 bash[5645]: WARN : RWStore.java:6868: WriteCacheDebug: 33469317120 - No WriteCache debug info
May 01 20:07:40 wdqs1001 bash[5645]: WARN : FixedAllocator.java:205: Physical address 33469317120 not accessible for Allocator of size 8192TASK DETAILhttps://phabricator.wikimedia.org/T164219EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T145050: Wikibase API should use the modern JSON syntax in API response on formatversion=2

2017-05-01 Thread Fomafix
Fomafix added projects: MediaWiki-extensions-WikibaseRepository, MediaWiki-API.
TASK DETAILhttps://phabricator.wikimedia.org/T145050EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FomafixCc: Aklapper, Fomafix, QZanden, Sethakill, dg711, Izno, Wikidata-bugs, aude, jayvdb, Anomie, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers

2017-05-01 Thread Ladsgroup
Ladsgroup added a comment.
Given codfw database being under pressure right now, I suggest starting the process tomorrow. Especially if it's going to be intense purging. If the speed is low or you are not doing it in peak time, I'd say go ahead.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T164207: deploy new datatype for linking to tabular data on Commons

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher created this task.Lydia_Pintscher added a project: Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONWe now have the code for the new datatype to link to tabular data sets on Commons. We need to activate it.TASK DETAILhttps://phabricator.wikimedia.org/T164207EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Lea_Lacroix_WMDE, aude, hoo, Jonas, Ladsgroup, Micru, Aklapper, Lydia_Pintscher, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T160048: [Story] datatype to link to tabular data sets on Commons

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher created subtask T164207: deploy new datatype for linking to tabular data on Commons.
TASK DETAILhttps://phabricator.wikimedia.org/T160048EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, Lydia_PintscherCc: Micru, gerritbot, Ladsgroup, Jonas, Aklapper, Lydia_Pintscher, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T123867: Repeated reports of wikidatawiki (s5) API going read only

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as "Resolved".Lydia_Pintscher claimed this task.Lydia_Pintscher added a comment.
I think so too :)TASK DETAILhttps://phabricator.wikimedia.org/T123867EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: jcrespo, Marostegui, Ladsgroup, Aklapper, StudiesWorld, aaron, daniel, aude, Lydia_Pintscher, Multichill, hoo, QZanden, Izno, Wikidata-bugs, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163923: Create Special:PageData as a canonical entry point for machine readable page data.

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher added a project: Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T163923EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Aklapper, daniel, Lsherwinforone, 45Jayjay1969, QZanden, Ptolusque, Sethakill, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher added a comment.
@Multichill You can go ahead with the bot run. The feature is deployed.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T87327: [Story] Group statements within statement group by ranks

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher added subscribers: Nikki, Pigsonthewing, StudiesWorld, Mineo, Liuxinyu970226, Ricordisamoa.Lydia_Pintscher merged a task: T115112: Hide deprecated statements by default.
TASK DETAILhttps://phabricator.wikimedia.org/T87327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Ricordisamoa, Liuxinyu970226, Mineo, StudiesWorld, Pigsonthewing, Nikki, Izno, MGChecker, aude, Bene, Lydia_Pintscher, Tobi_WMDE_SW, Aklapper, Snaterlicious, thiemowmde, adrianheine, Soteriaspace, JakeTheDeveloper, QZanden, Wikidata-bugs, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T87327: [Story] Group statements within statement group by ranks

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher added a subscriber: Izno.Lydia_Pintscher merged a task: T115054: [Story] Sort statements (within property group) at least by rank, with preferred at the top and deprecated at the bottom.
TASK DETAILhttps://phabricator.wikimedia.org/T87327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Izno, MGChecker, aude, Bene, Lydia_Pintscher, Tobi_WMDE_SW, Aklapper, Snaterlicious, thiemowmde, adrianheine, Soteriaspace, JakeTheDeveloper, QZanden, Wikidata-bugs, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Merged] T115054: [Story] Sort statements (within property group) at least by rank, with preferred at the top and deprecated at the bottom

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as a duplicate of T87327: [Story] Group statements within statement group by ranks.
TASK DETAILhttps://phabricator.wikimedia.org/T115054EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Izno, Lydia_Pintscher, MGChecker, aude, Aklapper, QZanden, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T115112: Hide deprecated statements by default

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher added a subscriber: Pigsonthewing.Lydia_Pintscher merged a task: T164110: Give priority to "preferred rank" values, and de-prioritse deprecated values, when listing them.
TASK DETAILhttps://phabricator.wikimedia.org/T115112EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Pigsonthewing, Izno, StudiesWorld, Lydia_Pintscher, Mineo, Nikki, Aklapper, Snaterlicious, thiemowmde, adrianheine, Liuxinyu970226, Bene, MGChecker, Ricordisamoa, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Merged] T164110: Give priority to "preferred rank" values, and de-prioritse deprecated values, when listing them

2017-05-01 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as a duplicate of T115112: Hide deprecated statements by default.
TASK DETAILhttps://phabricator.wikimedia.org/T164110EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Pigsonthewing, Aklapper, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T162124: Not-notable placeholders should not be indexable by search engines

2017-05-01 Thread Nemo_bis
Nemo_bis added a comment.
It seems you mean something else, but the main case of "non-notable placeholders" I currently see is covered by T158507: Consider translations and tweak the "notability" requirement for placeholders to be indexable (placeholders with mostly-untranslated content).TASK DETAILhttps://phabricator.wikimedia.org/T162124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Nemo_bisCc: Nemo_bis, Lydia_Pintscher, Lucie, Aklapper, hoo, QZanden, Izno, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T148005: BabelUserLanguageLookup is in Wikibase, should be in Babel

2017-05-01 Thread gerritbot
gerritbot added a comment.
Change 350569 had a related patch set uploaded (by Amire80; owner: Amire80):
[mediawiki/extensions/Babel@master] Cache the result of getUserLanguageInfo()

https://gerrit.wikimedia.org/r/350569TASK DETAILhttps://phabricator.wikimedia.org/T148005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Nemo_bis, jeblad, Aklapper, TheDragonFire, QZanden, Izno, Wikidata-bugs, aude, SPQRobin, Arrbee, KartikMistry, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T148005: BabelUserLanguageLookup is in Wikibase, should be in Babel

2017-05-01 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T148005EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Nemo_bis, jeblad, Aklapper, TheDragonFire, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, SPQRobin, Arrbee, KartikMistry, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T97018: [Story] Integrate violations into Wikidata UI

2017-05-01 Thread Sannita
Sannita added a comment.

In T97018#3217658, @Lucas_Werkmeister_WMDE wrote:
@Sannita: Thanks for your feedback!

The violation in P​569 is because of this constraint on P​569’s talk page:

Difference with “date of birth (P​569)” within range [30, 150]: the difference with property “date of birth (P​569)” should be in the range from “30” to “150”.

Read: a date of birth should be at least 30 years away from itself. In my opinion, that makes no sense, and I don’t know who added it… but the constraint is there, we imported it, and now the API reports violations for it on practically every human with a date of birth :/


Got it. I already saw somebody contacted the user who added that restriction. The *very* strange thing is that I get the same violation twice - it's still the very same of the image I posted before.

However, the constraint on P​570 is more sensible (within 0-150 years of date of birth), so I don’t know why that would report a violation. Did you get violations for P​570 as well, or only for P​569?

I have a "Range ⧼wbqc-violation-message-range-parameters-needed⧽" violation on p570, but only once. It seems to be either a malfunction or we didn't still described that violation.

And can you please elaborate on the malfunction with P​27?

It disappeared since my last comment, so we can ignore it, I think.TASK DETAILhttps://phabricator.wikimedia.org/T97018EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SannitaCc: Sannita, Lea_Lacroix_WMDE, Lucas_Werkmeister_WMDE, gerritbot, Pintoch, Lydia_Pintscher, Jan_Dittrich, abian, Bene, Jonas, Ricordisamoa, dominic.sauer, Liuxinyu970226, Aklapper, Tamslo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, SamanthaNguyen, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T137065: Language "norsk" ("no") added in the signature section, but only "nynorsk" ("nn") and "bokmål" ("nb") should be used

2017-05-01 Thread Verdy_p
Verdy_p added a comment.
Wikipedia initially had a single edition for Bokmal and Nynorsk, using "no" for both. But the content was mostly in Bokmal, so "no" turned there to be an alias of "nb" (Bokmal), and "nn" was to be used for the other Nynorsk variant.
Could we simply make "no" and "nb" aliased in interwikis prefixes and domain names, as well as in translation resources of MediaWiki ?

Keeping "nn" separated and keeping a primary language fallback between no=nb and nn like these proposed fallback chains:


no -> nb; nn; (others?); default(en)
nb -> no; nn; (others?); default(en)
nn -> no; nb; (others?); default(en)
TASK DETAILhttps://phabricator.wikimedia.org/T137065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Verdy_pCc: Verdy_p, jhsoby, Liuxinyu970226, adrianheine, Danmichaelo, Aklapper, jeblad, Zppix, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163048: Showing wrong colors in the Wikidata logo

2017-05-01 Thread abian
abian added a project: Wikimedia-Site-requests.
TASK DETAILhttps://phabricator.wikimedia.org/T163048EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: abianCc: gerritbot, ori, Zppix, Lydia_Pintscher, Reedy, Framawiki, abian, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, SamanthaNguyen, Urbanecm, JGirault, JEumerus, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs