date:20180727

Smalyshev added a project: Need-volunteer.
TASK DETAILhttps://phabricator.wikimedia.org/T181319EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: NavinoEvans, Pasleim, Lucas_Werkmeister_WMDE, Smalyshev, Aklapper, Yurik, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, merbst, LawExplorer, Avner, debt, Reasno, Gehel, Jonas, FloNight, Xmlizer, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Base, aude, Tobias1984, Manybubbles, jayvdb, zhuyifei1999, TheDJ, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T192843: Crowdsourced evaluation of Upload Wizard caption/description instructions

2018-07-27 Thread DarTar

DarTar edited projects, added Research-Archive; removed Research.DarTar closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T192843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Capt_Swing, DarTarCc: Abit, matthiasmullie, SandraF_WMF, Ramsey-WMF, PDrouin-WMF, Capt_Swing, Lahi, Gq86, E1presidente, Cparle, Anooprao, Sksvdbvd, Youssefalli1, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Avner, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, Base, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T167154: Delete wikidata-ldf project on wmflabs

2018-07-27 Thread Harej

Harej edited projects, added Cloud-VPS (Project-requests); removed Cloud-Services.
TASK DETAILhttps://phabricator.wikimedia.org/T167154EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HarejCc: CristianCantoro, Aklapper, AndyTan, sietec, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, bd808, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200594: Add client identifier to requests sent from Kartotherian to WDQS

Smalyshev created this task.Smalyshev triaged this task as "Normal" priority.Smalyshev added projects: Wikidata-Query-Service, Maps (Kartotherian), Wikidata.
TASK DESCRIPTIONIt would be nice if Kartotherian when calling WDQS on behalf of the client would identify which client requested it. Since WDQS is an internal WMF service, there should be no PII proliferation concern about it, and we could have more efficient load controls and throttling for it.

Possible ways, in order of preference:


X-Client-IP (unless varnish would kill it)
Adding client IP to the User Agent
Adding another header
Adding client IP to request string as extra parameter
something else?
TASK DETAILhttps://phabricator.wikimedia.org/T200594EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, MaxSem, Pnorman, Mholloway, Smalyshev, Amatissart, Lahi, Gq86, Looniverse, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Orienteerix, merbst, LawExplorer, debt, JGirault, Jonas, phabyogi, Xmlizer, Susannaanas, lxbarth, jkroll, Planemad, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Yurik, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T196859: Querying prohibited endpoint with SERVICE SILENT still produces an error

Smalyshev added a project: Upstream.
TASK DETAILhttps://phabricator.wikimedia.org/T196859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Esc3300, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T166139: Query optimizer for labels should be using sub queries

Smalyshev added a project: WDQS-Optimizer.
TASK DETAILhttps://phabricator.wikimedia.org/T166139EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: abian, Base, PokestarFan, Smalyshev, Aklapper, Lucas_Werkmeister_WMDE, Jonas, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T196872: Make xpath-functions/math available on Wikidata Query Server

Smalyshev added a project: Need-volunteer.
TASK DETAILhttps://phabricator.wikimedia.org/T196872EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Esc3300, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T197598: MWAPI query with LIMIT ignores MINUS

Smalyshev closed this task as "Invalid".Smalyshev added a comment.
I think there's two problems with the query:


You probably want "FILTER NOT EXISTS", not "MINUS", to do what you want. See: https://www.w3.org/TR/2013/REC-sparql11-query-20130321/#neg-notexists-minus



Note that wdt: would capture only preferred ones if there's preferred one. So if you want to capture all subjects, not only preferred one, use p:P921/ps:P921.


With these corrections, the query seems to work fine.TASK DETAILhttps://phabricator.wikimedia.org/T197598EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Daniel_Mietchen, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Indexing all item properties in ElasticSearch

Hi!

> * I would really like dates (mainly, born/died), especially if they work
> for "greater units", that is, I search for a year and get an item back,
> even though the statament is month- or day-precise

This is something I've been thinking about for a while, mainly because
the way we index dates now does not serve some important use cases. Even
in the Query Service we treat dates as fixed instants on the time scale,
whereas some dates are not instants but intervals (which in captured in
wikidata Precision but we are currently not paying any attention to it),
in fact many of the dates we use are more of interval-y nature than
instant-y.

This makes searching for "somebody that was born in 1820" possible but
laborious (you need to do intervals manually) and inefficient since we
can't just look up by year.

There are certainly improvement possible in this area, not yet sure how
to do it though.

-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Indexing all item properties in ElasticSearch

Hi!

> I could definitely see a usecase for 1) and maybe for 2). For example,
> let's say i remember that one movie that Rutger Hauer played in, just
> searching for 'movie rutger hauer' gives back nothing:
> 
> https://www.wikidata.org/w/index.php?search=movie+rutger+hauer
> 
> While Wikipedia gives back quite a nice list of options:
> 
> https://en.wikipedia.org/w/index.php?search=movie+rutger+hauer

Well, this is not going to change with the work we're discussing. The
reason you don't get anything from Wikidata is because "movie" and
"rutger hauer" are labels from different documents and ElasticSearch
does not do joins. We only index each document in itself, and possibly
some additional data, but indexing labels from other documents is now
beyond what we're doing. We could certainly discuss it but that would be
separate (and much bigger) discussion.

> If we would index item properties as well, you could get back Blade
> Runner (Q184843) which has Rutger Hauer as one of its 'cast member'
> values.

You could, but not by asking something like "movie rutger hauer", at
least not without a lot of additional work. Indexing "cast member" would
get you a step closer, but only a tiny step and there are a number of
other steps to take before that can work.
-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] [discovery-private] Indexing all item properties in ElasticSearch

Hi!

> The top 1000
> is: 
> https://docs.google.com/spreadsheets/d/1E58W_t_o6vTNUAx_TG3ifW6-eZE4KJ2VGEaBX_74YkY/edit?usp=sharing

This one is pretty interesting, how do I extract this data? It may be
useful independently of what we're discussing here.
-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Commented On] T200568: Make API query modules aware of MCR

gerritbot added a comment.
Change 413223 had a related patch set uploaded (by Cicalese; owner: Anomie):
[mediawiki/core@master] API: Update query modules for MCR

https://gerrit.wikimedia.org/r/413223TASK DETAILhttps://phabricator.wikimedia.org/T200568EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200568: Make API query modules aware of MCR

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T200568EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200569: Make ApiComparePages API module aware of MCR

gerritbot added a comment.
Change 448160 had a related patch set uploaded (by Cicalese; owner: Anomie):
[mediawiki/core@master] ApiComparePages: Update for MCR

https://gerrit.wikimedia.org/r/448160TASK DETAILhttps://phabricator.wikimedia.org/T200569EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200569: Make ApiComparePages API module aware of MCR

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T200569EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, gerritbotCc: gerritbot, daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T174032: Make relevant API modules aware of MCR

CCicalese_WMF edited projects, added Epic; removed MW-1.32-release-notes (WMF-deploy-2018-05-22 (1.32.0-wmf.5)), Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T174032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: Tgr, Fjalapeno, gerritbot, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Lewizho99, Maathavan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T109705: [Task] Consistently and correctly get target or 'cached' language in ParserOptions when userlang option is used

gerritbot added a comment.
Change 232826 abandoned by Aude:
Set target language in ParserOptions when calling getUserLangObj

Reason:
this is stale

https://gerrit.wikimedia.org/r/232826TASK DETAILhttps://phabricator.wikimedia.org/T109705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Liuxinyu970226, Lydia_Pintscher, gerritbot, aude, Aklapper, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, Arlolra, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T162555: Stop using MockTermIndex

gerritbot added a comment.
Change 347228 abandoned by Aude:
Replace use of MockTermIndex in TermPropertyLabelResolverTest

https://gerrit.wikimedia.org/r/347228TASK DETAILhttps://phabricator.wikimedia.org/T162555EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, aude, Aklapper, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Wikidata-bugs, Dinoguy1000, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T125500: [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch

gerritbot added a comment.
Change 287161 abandoned by Aude:
Introduce FieldDefinitions for search

https://gerrit.wikimedia.org/r/287161TASK DETAILhttps://phabricator.wikimedia.org/T125500EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: K4-713, Nikki, Lydia_Pintscher, Lea_Lacroix_WMDE, Stashbot, PokestarFan, Ladsgroup, Sjoerddebruin, dcausse, Jonas, gerritbot, JanZerebecki, daniel, thiemowmde, Tobi_WMDE_SW, Smalyshev, Aklapper, StudiesWorld, aude, Ricordisamoa, hoo, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Wikidata-bugs, jayvdb, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T109705: [Task] Consistently and correctly get target or 'cached' language in ParserOptions when userlang option is used

gerritbot added a comment.
Change 232757 abandoned by Aude:
Move Parser::setTargetLanguage code logic to ParserOptions

https://gerrit.wikimedia.org/r/232757TASK DETAILhttps://phabricator.wikimedia.org/T109705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Liuxinyu970226, Lydia_Pintscher, gerritbot, aude, Aklapper, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, JJMC89, Maathavan, Nirmos, Cwek, Wikidata-bugs, Dinoguy1000, Arlolra, Jackmcbarn, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Indexing all item properties in ElasticSearch

2018-07-27 Thread James Heald


On 27/07/2018 18:34, Stas Malyshev wrote:

Hi!


* I would really like dates (mainly, born/died), especially if they work
for "greater units", that is, I search for a year and get an item back,
even though the statament is month- or day-precise


What would be the use case for this?



The use case is to be able to look up  "John Smith 1820 1897" and have 
some hope of finding the one you want...




---
This email has been checked for viruses by AVG.
https://www.avg.com


___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Commented On] T145932: [Bug] Special:NewItem does not validate maximum label length

2018-07-27 Thread thiemowmde

thiemowmde added a comment.
Are we really checking characters? I seem to remember something else but am not entirely sure.

The StringLengthValidator responsible for these checks allows to specify if it should count bytes (strlen) or characters (mb_strlen). In the current code it counts bytes for URLs (including URL values, calendar models, globes, and units), and characters for everything else.TASK DETAILhttps://phabricator.wikimedia.org/T145932EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, thiemowmdeCc: gerritbot, Addshore, Gstupp, Liuxinyu970226, Thryduulf, Mbch331, Sjoerddebruin, Aklapper, hoo, aude, daniel, Lydia_Pintscher, thiemowmde, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Jonas, Wikidata-bugs, Dinoguy1000, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T174035: Allow the view action to show multiple slots [MCR]

CCicalese_WMF added a parent task: T200572: Make ApiParse API module aware of MCR.
TASK DETAILhttps://phabricator.wikimedia.org/T174035EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tgr, CCicalese_WMFCc: gerritbot, Aklapper, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200572: Make ApiParse API module aware of MCR

CCicalese_WMF created this task.CCicalese_WMF triaged this task as "Normal" priority.CCicalese_WMF added projects: Structured-Data-Commons, Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2), Core-Platform-Team (CPT-Q1-Jul-Sep-2018).Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output.

For ApiParse, we need to first figure out T174035: Allow the view action to show multiple slots [MCR].TASK DETAILhttps://phabricator.wikimedia.org/T200572EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: Aklapper, daniel, Fjalapeno, Tgr, CCicalese_WMF, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200572: Make ApiParse API module aware of MCR

CCicalese_WMF added a subtask: T174035: Allow the view action to show multiple slots [MCR].
TASK DETAILhttps://phabricator.wikimedia.org/T200572EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: Aklapper, daniel, Fjalapeno, Tgr, CCicalese_WMF, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T200570: Make ApiEditPage and ApiStashEdit API modules aware of MCR

CCicalese_WMF renamed this task from "Make ApiEditPage and ApiStashEdit API module aware of MCR" to "Make ApiEditPage and ApiStashEdit API modules aware of MCR".
TASK DETAILhttps://phabricator.wikimedia.org/T200570EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T200569: Make ApiComparePages API module aware of MCR

CCicalese_WMF updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output.

For ApiComparePages, we need to first figure out {T174036}.TASK DETAILhttps://phabricator.wikimedia.org/T200569EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200570: Make ApiEditPage and ApiStashEdit API module aware of MCR

CCicalese_WMF created this task.CCicalese_WMF triaged this task as "Normal" priority.CCicalese_WMF added projects: Structured-Data-Commons, Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2), Core-Platform-Team (CPT-Q1-Jul-Sep-2018).Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output.

For ApiEditPage and ApiStashEdit, we need to first figure out what editing looks like. See also T174033: Refactor EditPage to allow multiple slots to be edited atomically [MCR].TASK DETAILhttps://phabricator.wikimedia.org/T200570EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200570: Make ApiEditPage and ApiStashEdit API module aware of MCR

CCicalese_WMF added a subtask: T174033: Refactor EditPage to allow multiple slots to be edited atomically [MCR].
TASK DETAILhttps://phabricator.wikimedia.org/T200570EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200569: Make ApiComparePages API module aware of MCR

CCicalese_WMF created this task.CCicalese_WMF triaged this task as "Normal" priority.CCicalese_WMF added projects: Structured-Data-Commons, Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2), Core-Platform-Team (CPT-Q1-Jul-Sep-2018).Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONFor ApiComparePages, we need to first figure out T174036: Diffs page should show diffs and content from multiple slots [MCR].TASK DETAILhttps://phabricator.wikimedia.org/T200569EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200569: Make ApiComparePages API module aware of MCR

CCicalese_WMF added a subtask: T174036: Diffs page should show diffs and content from multiple slots [MCR].
TASK DETAILhttps://phabricator.wikimedia.org/T200569EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T174036: Diffs page should show diffs and content from multiple slots [MCR]

CCicalese_WMF added a parent task: T200569: Make ApiComparePages API module aware of MCR.
TASK DETAILhttps://phabricator.wikimedia.org/T174036EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tgr, CCicalese_WMFCc: Anomie, Liuxinyu970226, TomT0m, Smalyshev, Lokal_Profil, -jem-, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200568: Make API query modules aware of MCR

CCicalese_WMF created this task.CCicalese_WMF triaged this task as "Normal" priority.CCicalese_WMF added projects: Structured-Data-Commons, Multi-Content-Revisions (MCR-SDC File Caption Support - phase 2), Core-Platform-Team (CPT-Q1-Jul-Sep-2018).Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONAny API module that outputs revision (meta-)data needs to become aware of MCR, and must support multiple content objects per revision in the output.

ApiQueryRevisionsBase and its subclasses need a "slots" parameter, both to select which slots should have content-related metadata returned and to indicate that the existing, main-only content format should no longer be used. A new prop to list the available roles per revision is also useful.TASK DETAILhttps://phabricator.wikimedia.org/T200568EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Anomie, CCicalese_WMFCc: daniel, Fjalapeno, Tgr, CCicalese_WMF, Aklapper, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Ltrlg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T194101: Add more metrics to WDQS

Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T194101EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T187424: Support queued SPARQL request

Smalyshev added a comment.
@Addshore interesting idea, certainly can be a base for something quarry-like.TASK DETAILhttps://phabricator.wikimedia.org/T187424EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Addshore, Smalyshev, abian, Lucas_Werkmeister_WMDE, Aklapper, Bugreporter, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T194101: Add more metrics to WDQS

Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T194101EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T154017: compile number of http uses for http://www.wikidata.org/entity

Smalyshev closed this task as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T154017EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Aklapper, Lydia_Pintscher, Esc3300, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Gehel, Jonas, FloNight, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, faidon, Seb35, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T153563: Consider switching to HTTPS for Wikidata query service links

Smalyshev closed subtask T154017: compile number of http uses for http://www.wikidata.org/entity  as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T153563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Kghbln, Dalba, Lydia_Pintscher, Jonas, Ricordisamoa, Lokal_Profil, DSGalaktos, MisterSynergy, Esc3300, Smalyshev, MZMcBride, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Gehel, FloNight, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, faidon, Seb35, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Declined] T154015: announce breaking change: http > https for entities in rdf

Smalyshev closed this task as "Declined".Smalyshev added a comment.
Since parent is declined, declining this too.TASK DETAILhttps://phabricator.wikimedia.org/T154015EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Smalyshev, Ottomata, Ricordisamoa, Boshomi, Lydia_Pintscher, Aklapper, Esc3300, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Gehel, Jonas, FloNight, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, faidon, Seb35, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T153563: Consider switching to HTTPS for Wikidata query service links

Smalyshev closed subtask T154015: announce breaking change: http > https for entities in rdf as "Declined".
TASK DETAILhttps://phabricator.wikimedia.org/T153563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Kghbln, Dalba, Lydia_Pintscher, Jonas, Ricordisamoa, Lokal_Profil, DSGalaktos, MisterSynergy, Esc3300, Smalyshev, MZMcBride, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Gehel, FloNight, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, faidon, Seb35, Mbch331, Jay8g, Krenair, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T153546: monitor Listeria botstatus

Smalyshev removed projects: Wikidata-Query-Service, Discovery.
TASK DETAILhttps://phabricator.wikimedia.org/T153546EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Esc3300, SmalyshevCc: Cyberpower678, Framawiki, PokestarFan, Multichill, Lydia_Pintscher, Magnus, Smalyshev, TerraCodes, Aklapper, Esc3300, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, merbst, LawExplorer, Wikidata-bugs, aude, TheDJ, Mbch331, Darkminds3113, Lucas_Werkmeister_WMDE, EBjune, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Jdouglas, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T173214: Support GraphQL Queries

Smalyshev removed a project: Wikidata-Query-Service.Smalyshev added a comment.
Sounds very interesting but probably not part of any work for #wikidata-query-service, so I am removing the tag.TASK DETAILhttps://phabricator.wikimedia.org/T173214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Lydia_Pintscher, Addshore, larsgw, Saerdnaer, simon04, bearND, Siznax, Tpt, Jonas, Ricordisamoa, hoo, Lucas_Werkmeister_WMDE, Aklapper, dbarratt, PokestarFan, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331, EBjune, merbst, Xmlizer, jkroll, Jdouglas, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200202: WDQS disk usage increase is correlated with reloading of categories

Smalyshev added a comment.
Also, once T198356 is implemented, we won't need to reload category namespace (at least not too often) so that issue should be eliminated.TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200202: WDQS disk usage increase is correlated with reloading of categories

Smalyshev added a parent task: T198356: Generate daily diffs for recently changed categories.
TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T198356: Generate daily diffs for recently changed categories

Smalyshev added a subtask: T200202: WDQS disk usage increase is correlated with reloading of categories.
TASK DETAILhttps://phabricator.wikimedia.org/T198356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, Lydia_Pintscher, daniel, Aklapper, gerritbot, ArielGlenn, EBernhardson, Lea_WMDE, Smalyshev, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200202: WDQS disk usage increase is correlated with reloading of categories

Smalyshev added a comment.
Generally since new categories are loaded before old ones are deleted, the space bump is expected - and Blazegraph allocates disk space in big chunks, so it can be noticeable. What is also expected is that when old categories namespace is removed, the space is freed up and then reused for the newly incoming data. However, I am not sure how to check that. There might be fragmentation or leak issues.

We probably need to look into internal Blazegraph metrics and see how actual disk memory usage vs. number of triples vs. allocated memory looks like.

Blazegraph also has space compacting tool, but it requires database shutdown and I am not sure how long it would take to process. I can experiment on that.TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200563: wdq1003 is anomalous

Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONIf we look at the graph of the high lag for last 30 days:

https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?refresh=1m=8=1=now-30d=now

it is clear that wdqs1003 has highest instance of lag problems. This is weird, since three servers 1003, 1004 and 1005 should be sharing load & updates equally, and thus if there is a problem, either with query load or update load, it should be evenly distributed.

However, it is clear that 1003 has problems more often, and they are usually more severe (higher lag, longer duration). If could be:


1003 has some hardware/software issue that makes it slower
our load balancing is not balanced between hosts
some other reason?
just a coincidence?


I think we need to investigate this and see if there's some issue we could fix.TASK DETAILhttps://phabricator.wikimedia.org/T200563EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T200558: Write a formal description of pending WDQS tasks suitable for contractor/hire

Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T200558EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: EBjune, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200558: Write a formal description of pending WDQS tasks suitable for contractor/hire

Smalyshev added a project: User-Smalyshev.Smalyshev edited subscribers, added: EBjune; removed: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T200558EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: EBjune, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, User-Smalyshev___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200558: Write a formal description of pending WDQS tasks suitable for contractor/hire

Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONWe need to write out which tasks are pending for WDQS and we don't currently have resources to work on. This will help us evaluate whether we need to hire/contract somebody to help with it and what is the extent of the work we need.TASK DETAILhttps://phabricator.wikimedia.org/T200558EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: User-Smalyshev, Aklapper, Smalyshev, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T189739: [Epic] Implement fulltext search for Lexemes

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T189739EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Aklapper, daniel, Lydia_Pintscher, Smalyshev, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, LawExplorer, Avner, Lewizho99, Maathavan, Gehel, FloNight, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T189739: [Epic] Implement fulltext search for Lexemes

gerritbot added a comment.
Change 448633 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[mediawiki/extensions/WikibaseLexeme@master] Render form features the same way Form UI does

https://gerrit.wikimedia.org/r/448633TASK DETAILhttps://phabricator.wikimedia.org/T189739EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Aklapper, daniel, Lydia_Pintscher, Smalyshev, Mringgaard, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, LawExplorer, Avner, Gehel, FloNight, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Claimed] T172380: Query constraint violations with WDQS

Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Agabi10, Jonas, Lucas_Werkmeister_WMDE, Smalyshev, Esc3300, Aklapper, PokestarFan, MisterSynergy, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T173214: Support GraphQL Queries

2018-07-27 Thread Tpt

Tpt added a comment.
Indeed the set of property and their datatypes is very static and cachable so we could use them as keys of a StatementByProperty object and then have StringStatement, StringSnak... types. The object would just be huge and maybe raise some performance problems of the various GraphQL tools (we would have 4K+ keys).

A simple simplification we could do is to add to the Snak interface a nulllable version of the "value" key and keep the not-nullable version to the PropertyValueSnak type. It would allow to avoid most of the ...on PropertyValueSnak checks. But it has the disadvantages of making the output less safe (more possible nulls) and do not highlighting the fact that some snak do not have a value.

For statement filtering by qualifier a good solution is maybe to add an extra parameter "hasStatement" to the statements field and give to it a value of type SnakInput (a GraphQL input type that would be used to encode a snak provided by the GraphQL client). What do you think about it?TASK DETAILhttps://phabricator.wikimedia.org/T173214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TptCc: Lydia_Pintscher, Addshore, larsgw, Saerdnaer, simon04, bearND, Siznax, Tpt, Jonas, Ricordisamoa, hoo, Lucas_Werkmeister_WMDE, Aklapper, dbarratt, PokestarFan, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread Krinkle

Krinkle added a comment.

In T197616#4429492, @Krinkle wrote:

In T197616#4297600, @daniel wrote:
The beta setup is probably not going to cover all the angles for e.g. wikibase change propagation.



@Krinkle Can you clarify what angles you think aren't going to covered and [..]

This was a statement from @daniel, not me. I don’t have a stake in terms of what needs to be covered.

Reading the rest of Daniel’s comment, I believe his main concern is that “changeprop” is not installed on Beta Cluster currently. I was saying, we should consider installing it if that’s the case, and therefore use the existing Commons in Beta, instead of creating a test-commons in production.

Mainly because doing it in prod would demand on-going maintenance from lots of teams, and create technical debt as result of having two commons’ in the same realm. The Beta Commons on the other hand naturally matches the production configuration without any manual labour.TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Tgr, Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197666: OAuth extension not working in Mediawiki

2018-07-27 Thread LJ

LJ added a comment.
@Tarrow

Hi! I have indeed tried to follow those steps, but didn't get very far. When I log in as myself, a user with admin powers, I can go to http:///Special:OAuthConsumerRegistration, but I get this: 
F24218786: image.png

But then when I click on this first link, I get this:
F24218793: image.png

My user permissions look like this:
F24218895: image.png
and my email address was confirmed a week ago.

Could there be some other settings that are preventing me from completing the OAuth consumer registration?TASK DETAILhttps://phabricator.wikimedia.org/T197666EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tarrow, LJCc: LJ, Aklapper, Addshore, Tarrow, despens, Lahi, Gq86, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Abbe98, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] [discovery-private] Indexing all item properties in ElasticSearch

Hi!

> I think we already index way more than P31 and P279.

Oh yes, all the string properties.

> So I think that the increase is smaller than what you anticipate.
> What I'd try to avoid in general is indexing terms that have only doc
> since they are pretty useless.

For unique string properties, that would be a frequent occurrence. But I
am not sure why it's useless - won't it be a legit use case to look up
something by external ID?

> I think we should investigate what kind of data we may have here, and at
> least for statement_keywords I would not index data that contain random
> text (esp. natural language) since they are prone to be unique and
> impossible to search. 

Yes, we definitely should not do that. I tried to exclude such
properties but if you notice more of them, let's add them to exclusion
config.

-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] Indexing all item properties in ElasticSearch

Hi!

> * I would really like dates (mainly, born/died), especially if they work
> for "greater units", that is, I search for a year and get an item back,
> even though the statament is month- or day-precise

What would be the use case for this?

-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread greg

greg added a comment.

In T197616#4456742, @CCicalese_WMF wrote:

In T197616#4456657, @Fjalapeno wrote:

In T197616#4409174, @greg wrote:
(if it blocks then it should be a sub-task of the SDC deployment, not the other way around, right? ;) )


@CCicalese_WMF can you make sure the task tree is correct here?


Yes, it is.


Sorry, forgot to mention before you had to check: James F already fixed it :)TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gregCc: Tgr, Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

CCicalese_WMF added a comment.

In T197616#4456657, @Fjalapeno wrote:

In T197616#4409174, @greg wrote:
(if it blocks then it should be a sub-task of the SDC deployment, not the other way around, right? ;) )


@CCicalese_WMF can you make sure the task tree is correct here?


Yes, it is.TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CCicalese_WMFCc: Tgr, Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200202: WDQS disk usage increase is correlated with reloading of categories

gerritbot added a comment.
Change 448597 merged by Gehel:
[operations/puppet@production] wdqs: fix ensure of reload categories cron

https://gerrit.wikimedia.org/r/448597TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200202: WDQS disk usage increase is correlated with reloading of categories

gerritbot added a comment.
Change 448597 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: fix ensure of reload categories cron

https://gerrit.wikimedia.org/r/448597TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200202: WDQS disk usage increase is correlated with reloading of categories

gerritbot added a comment.
Change 448591 merged by Gehel:
[operations/puppet@production] wdqs: disable categories reload

https://gerrit.wikimedia.org/r/448591TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T200202: WDQS disk usage increase is correlated with reloading of categories

gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200202: WDQS disk usage increase is correlated with reloading of categories

gerritbot added a comment.
Change 448591 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: disable categories reload

https://gerrit.wikimedia.org/r/448591TASK DETAILhttps://phabricator.wikimedia.org/T200202EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, Gehel, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T198078: Extra xsd:decimal triples for some(?) globe coordinate values

Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment.
I've cleaned the database and it should not happen anymore. Please reopen if you find more instances.TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Pasleim, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread Fjalapeno

Fjalapeno added a subscriber: Tgr.Fjalapeno added a comment.
From what is being said, it sounds like the main question that needs to be answered is:

"Why not do this in beta instead of as part of group 0?"

@greg @Krinkle is this right?

@daniel @Anomie @Tgr do you have thoughts on this?TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FjalapenoCc: Tgr, Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread greg

greg added a comment.

In T197616#4456665, @Anomie wrote:

In T197616#4456657, @Fjalapeno wrote:

In T197616#4445656, @greg wrote:
Additional question: how would this test commons receive sufficient traffic to expose any potential issues?


@Anomie I believe you have some thoughts here… can you provide some info for @greg?


I don't have any thoughts on that matter, beyond asking "How do we get testwiki to have enough traffic to expose issues there?".


That's pretty much the issue: we don't :) That's why group0 only really catches extreme situations (unmet dependencies not caught before). It's usually the least impactful/bug finding group.TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gregCc: Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread Anomie

Anomie added a comment.

In T197616#4456657, @Fjalapeno wrote:

In T197616#4445656, @greg wrote:
Additional question: how would this test commons receive sufficient traffic to expose any potential issues?


@Anomie I believe you have some thoughts here… can you provide some info for @greg?


I don't have any thoughts on that matter, beyond asking "How do we get testwiki to have enough traffic to expose issues there?".

@daniel is supposed to be back from his vacation on Monday, he might have thoughts.TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T197616: Create a production test wiki in group0 to parallel Wikimedia Commons

2018-07-27 Thread Fjalapeno

Fjalapeno added a subscriber: Anomie.Fjalapeno added a comment.

In T197616#4409174, @greg wrote:
(if it blocks then it should be a sub-task of the SDC deployment, not the other way around, right? ;) )

@CCicalese_WMF can you make sure the task tree is correct here?

In T197616#4445656, @greg wrote:
Additional question: how would this test commons receive sufficient traffic to expose any potential issues?

@Anomie I believe you have some thoughts here… can you provide some info for @greg?

In T197616#4409248, @greg wrote:
High because due by end of August (and summer is busy).

@greg Just to confirm, yes we need this end of august.

In T197616#4429492, @Krinkle wrote:

In T197616#4297600, @daniel wrote:
The beta setup is probably not going to cover all the angles for e.g. wikibase change propagation.

@Krinkle Can you clarify what angles you think aren't going to covered and why they may be important. Also please say whether each angle is a blocker or not in your opinion.

I don't know the internals of Wikibase changeprop, but if it is a blocker to gaining confidence in SDC testing, it is probably also significant for general testing in Beta Cluster. Continued absence of it, would decrease value of overall QA efforts, and the efforts from other teams currently operating their services in Beta Cluster.

Task description:
Database: testcommonswiki
Config: as similar to commonswiki as possible

I think we should formally recognise this as technical debt, and plan for it accordingly. Manually maintaining this set-up of another wiki inside prod will require effort, and probably also from other teams at unexpected times. I don't think we can guarantee it will always be in sync, and never cause issues with something else in prod?

If we do go this route, I'd recommend setting a deadline to delete the wiki (e.g. after 6 months, or 12 months).

Note that between prod and beta, settings and conditionals for commonswiki are naturally in sync.

In T197616#4448548, @greg wrote:
Setting back to To Triage until we clarify use cases (the above questions from Timo and I).

@Krinkle can you provide some questions that we need to answer in regards to the above. I think we are having trouble doing anything actionable here because it isn't clear what we need to answer or turn into tickets baed on your feedback. Since @greg is saying your concerns a blocker to triaging this task, I want to make sure we have your needs clearly defined so we can move forward. (Sorry for being pedantic, but just want to make sure we understand fully what is being asked since we are on a deadline - thanks for taking the time to provide this info)TASK DETAILhttps://phabricator.wikimedia.org/T197616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FjalapenoCc: Anomie, Krinkle, Liuxinyu970226, Jdforrester-WMF, Fjalapeno, Abit, Aklapper, greg, Reedy, CCicalese_WMF, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, JunaidHafeez, Ramsey-WMF, Cparle, BJ6123C7BTD, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, Liudvikas, JEumerus, StevenJ81, Susannaanas, Tulsi_Bhagat, Wong128hk, Luke081515, SimmeD, Aschroet, Jane023, Wikidata-bugs, Snowolf, Base, matthiasmullie, aude, Dcljr, Ebe123, Koavf, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, zeljkofilipin, Rschen7754, Steinsplitter, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T200534: Delete "User:Zyksnowy/sandbox", a page with more than 5000 edits on Wikidata

2018-07-27 Thread Mahir256

Mahir256 created this task.Mahir256 added a project: Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI cannot seem to delete the page mentioned in the title of this task on my own. The software tells me that there would be a disruption if a page with more than 5000 edits is deleted, but this particular page has been determined to be very clearly out of scope due to its editor pasting and removing, rather frequently, many snippets small and large, some of which are very likely copyvios.

More discussion is happening on RFD and on the affected user's talk page.TASK DETAILhttps://phabricator.wikimedia.org/T200534EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mahir256Cc: Zyksnowy, Bugreporter, Mahir256, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] Indexing all item properties in ElasticSearch

2018-07-27 Thread Sylvain Boissel

Le ven. 27 juil. 2018 à 14:00, James Heald  a écrit :

> +1 with Magnus on years of birth and death
> (but perhaps /only/ years of birth and death, or close surrogates eg
> years of baptism and burial, and inception or publication date for
> things, otherwise the search specificity would become useless with too
> many other 'significant event' dates)
>
Maybe just dates as declarations on the item? On 'significant event', dates
are qualifiers.

Ash.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Created] T200521: WikibaseLexeme cannot be loaded when CirrusSearch is not enabled

2018-07-27 Thread WMDE-leszek

WMDE-leszek created this task.WMDE-leszek added projects: Wikidata, Lexicographical data.
TASK DESCRIPTIONAfter https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikibaseLexeme/+/437820/ when "entity type definitions" are loaded on the setup without CirrusSearch extension, loading "fulltext-search-context" fails as it references a constant from LexemeFullTextQueryBuilder which in turn implements CirrusSearch\Query\FullTextQueryBuilder interface, which is not there without CirrusSearch.

https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikibaseLexeme/+/448524/ has been a quick fix by repeating the string literal instead referencing the constant.

@Addshore suggested https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/448531/ which is probably going to allow conditional referencing the constant.

Also note that with what T190022 suggests, this part of entity type definitions would probably be moved out of WikibaseLexeme extensionTASK DETAILhttps://phabricator.wikimedia.org/T200521EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: WMDE-leszek, Addshore, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T157014: CONSULTATION/PLAN: Managing Complex State and GUI on MediaWiki (e.g. for Wikidata/Wikibase UI)

Addshore added a project: User-Addshore.
TASK DETAILhttps://phabricator.wikimedia.org/T157014EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Cavila, Addshore, PokestarFan, Afnecors, Kiailandi, Rfarrand, Jakob_WMDE, Mooeypoo, Catrope, dr0ptp4kt, GWicke, Aleksey_WMDE, daniel, Niedzielski, Magnus, Milimetric, Prtksxna, Fjalapeno, phuedx, Jdlrobson, Capt_Swing, TheDJ, Jdforrester-WMF, SBisson, WMDE-leszek, Volker_E, Krinkle, gabriel-wmde, Jonas, thiemowmde, Lydia_Pintscher, Jan_Dittrich, Jhernandez, Jdrewniak, Aklapper, A.S.Kochergin, Lahi, Gq86, GoranSMilovanovic, QZanden, Orienteerix, LawExplorer, Flycatchr, Puik, JGirault, D3r1ck01, Envlh, Susannaanas, Wikidata-bugs, aude, Tobias1984, Nikerabbit, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T157014: CONSULTATION/PLAN: Managing Complex State and GUI on MediaWiki (e.g. for Wikidata/Wikibase UI)

Addshore added a comment.
So, an update to this ticket. WikibaseLexeme is deployed to production using a handful of vuejs templates & widgets with PHP based server side rendering using https://github.com/wmde/php-vuejs-templating

We are now looking to move forward with deciding if PHP SSR using something in V8JS would make sense or if we should instead go for a node service (nuxt).

There are various ticket open around our efforts, some new, some old, and they can currently be found at #wikidata-frontend


In T157014#3369615, @Jan_Dittrich wrote:
@Fjalapeno: Good to know. I think @daniel had some concerns about rendering in JS – I sadly can't tell what they are because I am not deep into the infrastructural concerns here.


@daniel do you have a list of concerns anywhere?TASK DETAILhttps://phabricator.wikimedia.org/T157014EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Cavila, Addshore, PokestarFan, Afnecors, Kiailandi, Rfarrand, Jakob_WMDE, Mooeypoo, Catrope, dr0ptp4kt, GWicke, Aleksey_WMDE, daniel, Niedzielski, Magnus, Milimetric, Prtksxna, Fjalapeno, phuedx, Jdlrobson, Capt_Swing, TheDJ, Jdforrester-WMF, SBisson, WMDE-leszek, Volker_E, Krinkle, gabriel-wmde, Jonas, thiemowmde, Lydia_Pintscher, Jan_Dittrich, Jhernandez, Jdrewniak, Aklapper, A.S.Kochergin, Lahi, Gq86, GoranSMilovanovic, QZanden, Orienteerix, LawExplorer, Flycatchr, Puik, JGirault, D3r1ck01, Envlh, Susannaanas, Wikidata-bugs, aude, Tobias1984, Nikerabbit, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T197691: Clarify requirements for third-party Wikibase installation in the scope of the question "Could Wikibase require the ability to run a node service as the

Addshore triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T197691EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Aklapper, WMDE-leszek, RazShuty, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T197690: Check the status of v8.js PHP extension, and assess its applicability for the needs of service-side rendering of Wikibase UI

Addshore triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T197690EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Aklapper, RazShuty, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Triaged] T197692: Define what are the product requirements for non JS users on our installations

Addshore triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T197692EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T167139: Preliminary performance evaluation of vue.js

Addshore added a comment.
@Jan_Dittrich does this ticket refer to the JS bit of vue JS only?
If so, can we close this as done?TASK DETAILhttps://phabricator.wikimedia.org/T167139EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Volker_E, Krinkle, Aklapper, Jonas, thiemowmde, Aleksey_WMDE, Jan_Dittrich, daniel, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, enigmaeth, rohitt, LawExplorer, Vali.matei, Dixtosa, Wikidata-bugs, aude, GWicke, Dinoguy1000, Lydia_Pintscher, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T197690: Check the status of v8.js PHP extension, and assess its applicability for the needs of service-side rendering of Wikibase UI

Addshore added a comment.
V8JS for PHP is a PHP7+ extensions, using this in Wikibase would require WMF production to be on PHP7, see T176370: Migrate to PHP 7 in WMF production.

Then we would also have to raise the question to #operations #security and probably #performance to see if the V8JS https://pecl.php.net/package/v8js could be installed on the mediawiki hosts.
It's also possible that this need not be run on all hosts, and instead of splitting of our own node service we could run our own mediawiki endpoint on some service allowing SSR from PHP using V8JS (but thats really trying to think around the problem)

The V8JS pecl package is listed as stable and apparently has been since version 0.3.0 released back in 2015.
The package is now at version 2.1.0 released in Jan 2018.

There are various blog posts about using V8JS for SSR in PHP:


https://medium.com/js-dojo/advanced-server-side-rendering-with-laravel-vue-multi-page-app-486b706e654
http://www.beingyesterday.com/server-side-rendering-with-phpv8-v8js-on-ubuntu/


This is something that we could test with our current code.TASK DETAILhttps://phabricator.wikimedia.org/T197690EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Aklapper, RazShuty, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T199313: Implement LexemeMergeInteractor

gerritbot added a comment.
Change 448538 had a related patch set uploaded (by Jakob; owner: Jakob):
[mediawiki/extensions/WikibaseLexeme@master] Add LexemeMergeInteractor

https://gerrit.wikimedia.org/r/448538TASK DETAILhttps://phabricator.wikimedia.org/T199313EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Lydia_Pintscher, Pablo-WMDE, Mringgaard, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T167144: Find out where vue.js is already in use (or planned to be used) in the Wikimedia universe

Addshore closed this task as "Resolved".Addshore claimed this task.Addshore added a comment.Herald added a project: User-Addshore.
I flicked through https://github.com/search?p=1=org%3Awikimedia+vue=Code

The only occurrences of vue usage that I really found were in WikibaseLexeme and in wikistats2.
I also fond 2 references to vue relating to code mirror.

Looking at https://phabricator.wikimedia.org/search/query/xVRuAOx6o8NG/#R all of the vue related tickets relate to WikibaseLexeme and wikistats2 alsoTASK DETAILhttps://phabricator.wikimedia.org/T167144EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Milimetric, Aklapper, Jonas, thiemowmde, Aleksey_WMDE, Jan_Dittrich, daniel, Lahi, Gq86, GoranSMilovanovic, QZanden, enigmaeth, rohitt, LawExplorer, Dixtosa, Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T167134: Blockers for using the vue.js framework for Wikibase on the Wikimedia cluster

Addshore closed subtask T167144: Find out where vue.js is already in use (or planned to be used) in the Wikimedia universe as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T167134EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Jdforrester-WMF, Addshore, He7d3r, SBisson, Volker_E, Ricordisamoa, PokestarFan, Jan_Dittrich, Aleksey_WMDE, thiemowmde, Jonas, Aklapper, daniel, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, Orienteerix, enigmaeth, rohitt, LawExplorer, Puik, Dixtosa, Susannaanas, Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Darkdadaah, Nikerabbit, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unblock] T193720: Provide a web form to allow wikibase docker users to setup a docker file by answering simple question without having node / others.

Addshore closed subtask T194469: Discover vue.js as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T193720EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Matthias_Geisler_WMDE, AddshoreCc: Aklapper, Addshore, Tarrow, Nunomn, Andrawaag, Jonas, Matthias_Geisler_WMDE, Daniel_Mietchen, RazShuty, LJ, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Salgo60, Abbe98, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T194469: Discover vue.js

Addshore closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T194469EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Matthias_Geisler_WMDE, AddshoreCc: Aklapper, Addshore, Orienteerix, Nikerabbit, RazShuty, Daniel_Mietchen, Jonas, Andrawaag, Nunomn, Tarrow, Matthias_Geisler_WMDE, LJ, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Salgo60, Puik, Abbe98, Susannaanas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197689: Figure out service "externalization" with WMF (i.e. whether is possible, and what it takes to get service X running at WMF infrastructure, not being

Addshore added a comment.
For reference for the person that ends up completing this task:


https://wikitech.wikimedia.org/wiki/Services
https://wikitech.wikimedia.org/wiki/Services/FirstDeployment#New_Service_Request
TASK DETAILhttps://phabricator.wikimedia.org/T197689EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RazShuty, AddshoreCc: TheDJ, Jdforrester-WMF, Aklapper, Addshore, WMDE-leszek, RazShuty, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T186006: References aren't readable to logged-out users on Wikidata when an item is protected

2018-07-27 Thread Pablo-WMDE

Pablo-WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...https://en.wikipedia.org/wiki/Wikipedia_talk:Wikidata/2018_State_of_affairs/Archive_1#References_invisible_on_protected_Wikidata_items_when_not_logged_in?TASK DETAILhttps://phabricator.wikimedia.org/T186006EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDECc: Pablo-WMDE, matej_suchanek, Lydia_Pintscher, Aklapper, Mike_Peel, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, Jrbranaa, JakeTheDeveloper, QZanden, merbst, LawExplorer, Wong128hk, Wikidata-bugs, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T186006: References aren't readable to logged-out users on Wikidata when an item is protected

2018-07-27 Thread Pablo-WMDE

Pablo-WMDE added a comment.
Just encountered this today: https://www.wikidata.org/wiki/Q39259TASK DETAILhttps://phabricator.wikimedia.org/T186006EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Pablo-WMDECc: Pablo-WMDE, matej_suchanek, Lydia_Pintscher, Aklapper, Mike_Peel, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, Jrbranaa, JakeTheDeveloper, QZanden, merbst, LawExplorer, Wong128hk, Wikidata-bugs, aude, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T200508: Changes in Wikibase that break WikibaseLexeme are not visible before merge

Addshore closed this task as "Resolved".Addshore added a comment.
The patch linked above fixes the 1 issueTASK DETAILhttps://phabricator.wikimedia.org/T200508EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Stashbot, Addshore, WMDE-leszek, gerritbot, Jakob_WMDE, Aklapper, Tarrow, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Re: [Wikidata] [discovery-private] Indexing all item properties in ElasticSearch

2018-07-27 Thread David Causse

On Fri, Jul 27, 2018 at 3:31 PM David Causse  wrote:

> What I'd try to avoid in general is indexing terms that have only doc
> since they are pretty useless.
>

I meant:  that have only *one* doc
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Re: [Wikidata] [discovery-private] Indexing all item properties in ElasticSearch

2018-07-27 Thread David Causse

Hi,

I think we already index way more than P31 and P279.
For instance we have 102.301.706 (approximation) distinct values in the
term lexicon for statement_keywords.
Sadly I can't extract the list of unique PIDs used (we'd have to enable
field_data on statement_keywords.property).
The top 1000 is:
https://docs.google.com/spreadsheets/d/1E58W_t_o6vTNUAx_TG3ifW6-eZE4KJ2VGEaBX_74YkY/edit?usp=sharing
I think this is because we not only index statements by PID but also by
data type.
So I think that the increase is smaller than what you anticipate.
What I'd try to avoid in general is indexing terms that have only doc since
they are pretty useless.
I think we should investigate what kind of data we may have here, and at
least for statement_keywords I would not index data that contain random
text (esp. natural language) since they are prone to be unique and
impossible to search.

On Thu, Jul 26, 2018 at 11:48 PM Stas Malyshev 
wrote:

> Hi!
>
> Today we are indexing in ElasticSearch almost all string properties
> (except a few) and select item properties (P31 and P279). We've been
> asked to extend this set and index more item properties
> (https://phabricator.wikimedia.org/T199884). We did not do it from the
> start because we did not want to add too much data to the index at once,
> and wanted to see how the index behaves. To evaluate what this change
> would mean, some statistics:
>
> All usage of item properties in statements is about 231 million uses
> (according to sqid tool database). Of those, about 50M uses are
> "instance of" which we are already indexing. Another 98M uses belong to
> two properties - published in (P1433) and cites (P2860). Leaving about
> 86M for the rest of the properties.
>
> So, if we index all the item properties except P2860 and P1433, we'll be
> a little more than doubling the amount of data we're storing for this
> field, which seems OK. But if we index those too, we'll be essentially
> quadrupling it - which may be OK too, but is bigger jump and one that
> may potentially cause some issues.
>
> So, we have two questions:
> 1. Do we want to enable indexing for all item properties? Note that if
> you just want to find items with certain statement values, Wikidata
> Query Service matches this use case best. It's only in combination with
> actual fulltext search where on-wiki search is better.
>
> 2. Do we need to index P2860 and P1433 at all, and if so, would it be ok
> if we omit indexing for now?
>
> Would be glad to hear thoughts on the matter.
>
> Thanks,
> --
> Stas Malyshev
> smalys...@wikimedia.org
>
> ___
> discovery-private mailing list
> discovery-priv...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/discovery-private
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

[Wikidata-bugs] [Maniphest] [Commented On] T200508: Changes in Wikibase that break WikibaseLexeme are not visible before merge

Addshore added a comment.
https://gerrit.wikimedia.org/r/448510TASK DETAILhttps://phabricator.wikimedia.org/T200508EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Stashbot, Addshore, WMDE-leszek, gerritbot, Jakob_WMDE, Aklapper, Tarrow, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200508: Changes in Wikibase that break WikibaseLexeme are not visible before merge

gerritbot added a comment.
Change 448511 abandoned by Addshore:
phpcs ignore phan stubs

https://gerrit.wikimedia.org/r/448511TASK DETAILhttps://phabricator.wikimedia.org/T200508EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Stashbot, Addshore, WMDE-leszek, gerritbot, Jakob_WMDE, Aklapper, Tarrow, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200508: Changes in Wikibase that break WikibaseLexeme are not visible before merge

gerritbot added a comment.
Change 448511 had a related patch set uploaded (by Addshore; owner: Addshore):
[mediawiki/extensions/Wikibase@master] phpcs ignore phan stubs

https://gerrit.wikimedia.org/r/448511TASK DETAILhttps://phabricator.wikimedia.org/T200508EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, gerritbotCc: Stashbot, Addshore, WMDE-leszek, gerritbot, Jakob_WMDE, Aklapper, Tarrow, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T195906: Phan fails for Wikibase on wmf.x branches

Addshore added a comment.
The patch actually now caused T200508#4455993

We might have to switch to checking if the file exists rather than the directory?
But that also sounds brittle..TASK DETAILhttps://phabricator.wikimedia.org/T195906EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Legoktm, AddshoreCc: Addshore, gerritbot, Aklapper, Jdforrester-WMF, TerraCodes, Stashbot, Legoktm, Lucas_Werkmeister_WMDE, thcipriani, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T200508: Changes in Wikibase that break WikibaseLexeme are not visible before merge

Addshore added a comment.
https://integration.wikimedia.org/ci/job/wmf-quibble-vendor-mysql-hhvm-docker/1899/console

11:49:20 FILE: .../phpunit/includes/Search/Elastic/DispatchingQueryBuilderTest.php
11:49:20 --
11:49:20 FOUND 0 ERRORS AND 1 WARNING AFFECTING 1 LINE
11:49:20 --
11:49:20  12 | WARNING | Duplicate interface name
11:49:20 | | "CirrusSearch\Query\FullTextQueryBuilder" found; first
11:49:20 | | defined in
11:49:20 | | /workspace/src/extensions/Wikibase/tests/phan/stubs/cirrussearch.php
11:49:20 | | on line 193 (Generic.Classes.DuplicateClassName.Found)
11:49:20 --
11:49:20 
11:49:20 Time: 2 mins, 29.15 secs; Memory: 17.52MbTASK DETAILhttps://phabricator.wikimedia.org/T200508EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Stashbot, Addshore, WMDE-leszek, gerritbot, Jakob_WMDE, Aklapper, Tarrow, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, God, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T196188: Implement Lexeme-only fulltext search