[Wikidata-bugs] [Maniphest] [Commented On] T171027: "2062 Read timeout is reached" DBQueryError when trying to load specific users' watchlists (with +1000 articles) on several wikis
Catrope added a comment. Thanks for the detailed analysis @Bawolff and @jcrespo . My $0.02: Given the overwhelming number of Wikidata entries in the RC table (95% or more on some wikis, I was very surprised by that), I think that's the main problem that we should tackle. @Bawolff's split query approach is also promising, but it's kind of orthogonal as it speeds up the whole query more or less independent of the Wikidata issue, and I'm a bit concerned that the code is kind of scary and possibly fragile. There are four main ways that I can see us tackling the Wikidata flood problem: Reducing wasteful Wikidata entires (unused languages, unused properties) Segregating Wikidata RC entries (and possibly categorization too, since that's significant on some wikis) into a separate table Adding rc_type or rc_source (which one? these two fields seem largely redundant with each other) to the start of some indexes, so that queries that don't need to look at Wikidata rows can filter them out efficiently Disable Wikidata RC on large wikis until we have a more scalable implementation of the feature #1 is something that should be done regardless because it would make users happy (people already complain about being spammed with updates to languages they don't speak), and it sounds like it's already being worked on. I don't know how hard that is or how long it would take, but AFAIK the Wikidata team started working on it a month ago, so it might take a while yet. Every reduction in wasteful entries would only affect new entries, so it would slowly improve query performance over days or weeks after deployment, as the older generation of wasteful entries falls off the time horizons of these queries. And a very large reduction would need to be achieved to address the issue properly. Right now, Wikidata is 95% of the RC table on commons; if the number of Wikidata rows were reduced by a factor of 10, it would still be 67%, and we'd need a 21x reduction just to get below 50%. So while this seems like a good long-term plan, I worry that it wouldn't make a dent for quite some time. #2 would require creating a new table, and would require changing the code that generates RC entries (to write them to the right table) and all the code that queries the RC table (to query the right table, or when needed to query both tables with a UNION). The latter could be done in a similar way to @Bawolff's proof of concept for the split query, by rewriting the query right before it's executed. It'd require some trickery and could be a bit fragile, but we'd get an immediate performance boost for queries that exclude Wikidata (they'd need to scan 20x fewer rows on the worst-flooded wikis) and hopefully still decent performance for queries that don't. #3 should in theory (AIUI) have the same performance benefits as #2, but without having to change any code: if an index starting with rc_type is used, the query should behave roughly as if every type of query is in its own table. I wonder if this would work in practice though, because I don't expect that MySQL would use an index to satisfy a != condition (even if that value is 95% of the table); but maybe rc_type IN (all, other, values) would work? @jcrespo: How well do you think an index could approximate the effect of a separate table? Would a PARTITION like we use on the revision table work, perhaps? As for #4, that should be pretty easy to do (IIRC Wikidata RC generation is disableable, and a background script could delete old rows starting with the most recent ones) and should alleviate the issue pretty quickly too, but it would also be disruptive to people who use the feature; on the other hand, query timeouts on the watchlist are also disruptive, to a different group of people. So I think we should only do this if there isn't another way that we can get the issue under control in a reasonable amount of time.TASK DETAILhttps://phabricator.wikimedia.org/T171027EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: CatropeCc: Ankry, Ladsgroup, Lsanabria, Josve05a, Bawolff, greg, Dominicbm, Vriullop, Jmabel, Fae, IKhitron, Johan, Herzi.Pinki, jmatazzoni, Trizek-WMF, Mattflaschen-WMF, KTC, Framawiki, zhuyifei1999, Marostegui, aaron, Andrei_Stroe, Turbojet, Rsocol, Strainu, Jwh, Pyb, Darwinius, Arbnos, Jdforrester-WMF, TheDJ, gerritbot, VladXe, Kf8, Liuxinyu970226, Jay8g, TerraCodes, Iniquity, jcrespo, Reedy, Catrope, Vicpeters, Demidenko, MaxBioHazard, Aklapper, Waytogoeducation, GoranSMilovanovic, Abiyoyo, QZanden, Vali.matei, Jack_who_built_the_house, Poyekhali, Volker_E, Izno, Wong128hk, Luke081515, Wikidata-bugs, Base, aude, GWicke, El_Grafo, Gryllida, putnik, Steinsplitter, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T171274: Security review of wikiba.se
Reedy closed this task as "Resolved".Reedy claimed this task.Reedy added a comment. There's nothing really scary here other than the dependancy tree of vendor/composer libs. But that's not a production issue. The 3rd party loading of fonts was fixed recently, so that's good. TBH, I don't think this really needed a security review; the resultant files are mostly static html, with a bit of (standard 3rd party) js reedy@ubuntu64-web-esxi:~/wikiba.se/output_prod$ tree . ├── applications │ └── index.html ├── components │ ├── bootstrap │ │ ├── bootstrap-built.css │ │ ├── bootstrap-built.js │ │ └── dist │ │ ├── css │ │ │ ├── bootstrap.css │ │ │ ├── bootstrap.min.css │ │ │ ├── bootstrap-theme.css │ │ │ └── bootstrap-theme.min.css │ │ ├── fonts │ │ │ ├── glyphicons-halflings-regular.eot │ │ │ ├── glyphicons-halflings-regular.svg │ │ │ ├── glyphicons-halflings-regular.ttf │ │ │ ├── glyphicons-halflings-regular.woff │ │ │ └── glyphicons-halflings-regular.woff2 │ │ └── js │ │ ├── bootstrap.js │ │ └── bootstrap.min.js │ ├── font-awesome │ │ ├── css │ │ │ ├── font-awesome.css │ │ │ ├── font-awesome.css.map │ │ │ └── font-awesome.min.css │ │ ├── font-awesome-built.css │ │ └── fonts │ │ ├── FontAwesome.otf │ │ ├── fontawesome-webfont.eot │ │ ├── fontawesome-webfont.svg │ │ ├── fontawesome-webfont.ttf │ │ ├── fontawesome-webfont.woff │ │ └── fontawesome-webfont.woff2 │ ├── index.html │ ├── jquery │ │ ├── jquery-built.js │ │ ├── jquery.js │ │ ├── jquery-migrate.js │ │ ├── jquery-migrate.min.js │ │ ├── jquery.min.js │ │ └── jquery.min.map │ ├── require-built.js │ ├── require.config.js │ ├── require.css │ └── require.js ├── css │ └── style.css ├── images │ ├── droidwiki.png │ ├── eagle-project.png │ ├── favicon.ico │ ├── logo.png │ └── wikidata.png ├── index.html ├── ontology-1.0.owl ├── projects │ └── index.html └── resources └── index.htmlTASK DETAILhttps://phabricator.wikimedia.org/T171274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, Bawolff, PokestarFan, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, Ladsgroup, faidon, GoranSMilovanovic, QZanden, dpatrick, Izno, Luke081515, Wikidata-bugs, aude, csteipp, Mbch331, Jay8g, Legoktm___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster
Reedy closed subtask T171274: Security review of wikiba.se as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dzahn, ReedyCc: Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T171274: Security review of wikiba.se
Reedy added a comment. Package operations: 79 installs, 0 updates, 0 removals Yeah... That's definitely not being run in prod. lolTASK DETAILhttps://phabricator.wikimedia.org/T171274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, Bawolff, PokestarFan, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, Ladsgroup, faidon, GoranSMilovanovic, QZanden, dpatrick, Izno, Luke081515, Wikidata-bugs, aude, csteipp, Mbch331, Jay8g, Legoktm___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T171274: Security review of wikiba.se
Reedy added a comment. https://github.com/wikimedia/wikiba.se/blob/master/composer.json#L6 - Why are you including dflydev/embedded-composer yourself? https://packagist.org/packages/sculpin/sculpin adds the same version. I was trying to work out what it was used for; and the answer seems to be nothing directly What's the deployment strategy going to be? Commit the generated files (from vendor/bin/sculpin generate --env=prod) into another repo (wikiba.se-deploy or similar?)... As we're presumably not going to be running composer and then sculpin on the misc servers and then serving those files?TASK DETAILhttps://phabricator.wikimedia.org/T171274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReedyCc: Reedy, Bawolff, PokestarFan, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, Ladsgroup, faidon, GoranSMilovanovic, QZanden, dpatrick, Izno, Luke081515, Wikidata-bugs, aude, csteipp, Mbch331, Jay8g, Legoktm___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176391: remove and prevent spam on lexeme test system
Ladsgroup added a comment. Okay, everything should be cleaned up now.TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, matej_suchanek, Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T175948: Add normalized predicates to Blazegraph vocabulary
Smalyshev added a comment. The list of the things missing: Prefixes: PREFIX psn: PREFIX pqn: PREFIX prn: Predicates and URIs: schema:name schema:isPartOf wikibase:quantityNormalized wikibase:statementValueNormalized wikibase:qualifierValueNormalized wikibase:referenceValueNormalized wikibase:TimeValue wikibase:QuantityValue wikibase:GlobecoordinateValue wikibase:badge wikibase:Property wikibase:wikiGroup For categories: mediawiki:Category mediawiki:isInCategoryTASK DETAILhttps://phabricator.wikimedia.org/T175948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T174794: [Task] investigate emails about Wikidata changes from Wikipedia
IKhitron added a comment. Hi. I started to get such letters from ruwiki only three days ago, about one letter every hour, and I have about ten watched pages in this wiki. So, something was a trigger, and only for this wiki - I do not get anything from other wikis where I have watched pages, including the same pages in another language.TASK DETAILhttps://phabricator.wikimedia.org/T174794EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, IKhitronCc: IKhitron, matej_suchanek, Aklapper, Lydia_Pintscher, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T175014: Analyse the most frequent errors on Wikidata Query Service
Smalyshev closed subtask T175016: WDQS - ChunkedRunningQuery / Query is done as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T175014EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Gehel, Aklapper, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T175016: WDQS - ChunkedRunningQuery / Query is done
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment. Looks like this is normal, as a consequence of query timing out while some operations are still in progress.TASK DETAILhttps://phabricator.wikimedia.org/T175016EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T176239: WDQS updater should have a keep running after error mode
Smalyshev added projects: Easy, Need-volunteer.Smalyshev triaged this task as "Normal" priority.Herald added a subscriber: TerraCodes. TASK DETAILhttps://phabricator.wikimedia.org/T176239EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: TerraCodes, Smalyshev, Aklapper, Yurik, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Soteriaspace, JakeTheDeveloper, QZanden, EBjune, Zoranzoki21, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, MuhammadShuaib, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Merged] T175148: uppercase schema:inLanguage on Wikidata Query Service
Smalyshev closed this task as a duplicate of T168295: Some language codes for sitelinks are capitalised differently from labels. TASK DETAILhttps://phabricator.wikimedia.org/T175148EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Esc3300, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T168295: Some language codes for sitelinks are capitalised differently from labels
Smalyshev added a subscriber: Esc3300.Smalyshev merged a task: T175148: uppercase schema:inLanguage on Wikidata Query Service. TASK DETAILhttps://phabricator.wikimedia.org/T168295EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Esc3300, Smalyshev, Nikki, Aklapper, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T169133: WDQS testing setup platform sizing
Smalyshev closed this task as "Resolved".Smalyshev added a comment. I think it's ok for now with bigdisk template.TASK DETAILhttps://phabricator.wikimedia.org/T169133EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Andrew, SmalyshevCc: daniel, Lydia_Pintscher, bd808, chasemp, Gehel, Aklapper, Smalyshev, IMBLUESKY, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tbscho, merbst, Avner, debt, Jonas, FloNight, Xmlizer, anirudh24seven, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176312: Don’t check format constraint via SPARQL (safely evaluating user-provided regular expressions)
Anomie added a comment. Lua’s regexes One item of note is that Lua's patterns don't support basic regex features such as general alternation (only alternation over a set of single characters) or applying the Kleene star to arbitrary subpatterns (only to single characters or character sets). There's no straightforward way to do something like /foo(abc|def)bar/ or /f(oo)*/ in Lua patterns.TASK DETAILhttps://phabricator.wikimedia.org/T176312EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AnomieCc: Anomie, Smalyshev, tstarling, daniel, GWicke, Joe, Lucas_Werkmeister_WMDE, Krinkle, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Izno, SBisson, Wikidata-bugs, aude, jayvdb, fbstj, RobLa-WMF, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
EBernhardson added a comment. In T173710#3625333, @Daimona wrote: Today on it.wiki I noticed a massive increase in search results for some queries related to errors that I'm currently trying to fix. This search: https://it.wikipedia.org/w/index.php?search=insource%3A%2F%27%27parlate+prego%27%27%5C%3C%5C%2F%2F=Speciale:Ricerca=""> now has 6 results, but they're all fixed since yesterday. The weird thing is, today at 11AM the search only returned something like 4 results, while the other (already fixed) pages were added at around 4PM. We suppose that this is still due to troubles with job queue, is that right? Delays with pushing updates into search could potentially be related to the job queue. More than 12 hours is pretty exceptional for processing these, but the refreshLinks job has to run and on completion that triggers the search index update jobs. refresh links is one of the ones that we've been seeing backup from time to time.TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: Daimona, YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
Daimona added a comment. Today on it.wiki I noticed a massive increase in search results for some queries related to errors that I'm currently trying to fix. This search: https://it.wikipedia.org/w/index.php?search=insource%3A%2F%27%27parlate+prego%27%27%5C%3C%5C%2F%2F=Speciale:Ricerca=""> now has 6 results, but they're all fixed since yesterday. The weird thing is, today at 11AM the search only returned something like 4 results, while the other (already fixed) pages were added at around 4PM. We suppose that this is still due to troubles with job queue, is that right?TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DaimonaCc: Daimona, YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T174028: Finalize DB schema for content meta-data
daniel added a comment. @jcrespo After some discussion on https://www.mediawiki.org/wiki/Talk:Multi-Content_Revisions/Database_Schema, on https://gerrit.wikimedia.org/r/#/c/378724/4, and on the mailing list, there are a few questions that require a judgement call from a DBA. Ideally of course we would test and measure. But I'm afraid at least some of these decisions need to be made beforehand, so an assessment from experience would be very helpful. So here are the most pressing questions: Should we introduce content_sha1? The content table is going to be tall (initially, as tall as revision, but two or three times taller later), so I want to keep it narrow. If we have it, we probably want to have an index on it (this would clash with sharding, though, see below) If we don't have it, we need to load the content of all slots to calculate rev_sha1 for each new revision. ...or we drop rev_sha1, and calculate the hash for use in API results and XML dumps on the fly. If we introduce content_sha1 now, we can still write empty strings to it later to reduce size. We could choose a more compact representation than base36 used for rev_sha1 Should we build in support for sharing (partitioning) on the page ID? we would need slot_page and content_page all (unique/primary) indexes would have to start with the page id all selects and joins will have to use the page ID (this needs some changes in the code, but not much) it's two integer (or bigint) columns in two very tall tables queries across pages will be inefficient, or need a separate table (note that we don't need a contributions table unless we also partition the revision table) in some (rare) cases (e.g. undelete of a very old revision, or a history split), page ids would have to be re-written or content rows would have to be duplicated with different page ids. Should slot_revision be declared BIGINT right away? we will need to convert rev_id to BIGIN soonish until then, is it bad to join an int to a bigint in queries? if we declare it INT for now, we'll have to convert it when we convert rev_id. What is your opinion on these trade-offs? What additional information do you need to decide these? What should be the next steps be towards a decision?TASK DETAILhttps://phabricator.wikimedia.org/T174028EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: cicalese, Abit, brion, Anomie, jcrespo, gerritbot, Aklapper, daniel, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, Lewizho99, Maathavan, Susannaanas, Izno, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176312: Don’t check format constraint via SPARQL (safely evaluating user-provided regular expressions)
Smalyshev added a comment. I don't think there are many other regex libraries which have been verified as safe for arbitrary user input, with limited time and memory. PCRE is probably not one, especially pcre+PHP, I've seen a bunch of issues there. Also I think full PCRE is way over-powered for what we need here, and subsequently the attack area is much wider. It is also not too hard to get PCRE into pathological behavior time- and memory-wise, given control over regexp and string. Java regexps also suffer from the same problems, but I've added mitigation for it to WDQS lately. If we run PCRE on user-supplied regexps, we should either sanitize them (no idea how), or run them in very tightly sequestered environment, if we're running PHP+PCRE essentially assuming we're running a hostile code. That seems to be kind of dangerous, so we should be very careful here.TASK DETAILhttps://phabricator.wikimedia.org/T176312EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, tstarling, daniel, GWicke, Joe, Lucas_Werkmeister_WMDE, Krinkle, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Izno, SBisson, Wikidata-bugs, aude, jayvdb, fbstj, RobLa-WMF, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T168041: Assign different favicons to query.wikidata.org and test.wikidata.org
Smalyshev added a comment. @Charlie_WMDE I've tried the ico file, it seems OK except for one issue which I'm not sure if it's ok or not: it has white (not transparent) background, which makes it look like white box, unlike wikidata icon. F9704937: screen.png Is it ok?TASK DETAILhttps://phabricator.wikimedia.org/T168041EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Hanna_Petruschat_WMDE, gerritbot, Esc3300, PokestarFan, Smalyshev, James_Budday, Jonas, Jan_Dittrich, Charlie_WMDE, Lydia_Pintscher, Aklapper, MisterSynergy, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Gehel, JGirault, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T121274: Provide an RDF mapping for external identifiers
Smalyshev added a comment. OK, so let's switch the patch to use psn and wdtn (new) prefixes and otherwise it seems to be pretty close to being ready.TASK DETAILhttps://phabricator.wikimedia.org/T121274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, SmalyshevCc: mkroetzsch, Denny, Ladsgroup, Lucas_Werkmeister_WMDE, Jonas, Esc3300, abian, gerritbot, Lydia_Pintscher, Aklapper, daniel, hoo, thiemowmde, JanZerebecki, aude, Liuxinyu970226, Ricordisamoa, Micru, Sannita, Laddo, Smalyshev, Tobi_WMDE_SW, Bugreporter, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T55619: API module to copy a claim from one item to another
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T55619EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, PokestarFan, Liuxinyu970226, Snipre, Lydia_Pintscher, Esc3300, Nikki, Gareth, Aklapper, Ricordisamoa, Wikidata-bugs, Legoktm, Micru, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T55619: API module to copy a claim from one item to another
gerritbot added a comment. Change 379582 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [mediawiki/extensions/Wikibase@master] [WIP] Add CopyClaim API module https://gerrit.wikimedia.org/r/379582TASK DETAILhttps://phabricator.wikimedia.org/T55619EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, PokestarFan, Liuxinyu970226, Snipre, Lydia_Pintscher, Esc3300, Nikki, Gareth, Aklapper, Ricordisamoa, Wikidata-bugs, Legoktm, Micru, JohnLewis, GoranSMilovanovic, QZanden, Izno, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T176391: remove and prevent spam on lexeme test system
Ladsgroup claimed this task.Ladsgroup added a project: Wikidata-Sprint.Herald added a project: User-Ladsgroup. TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, matej_suchanek, Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176391: remove and prevent spam on lexeme test system
Ladsgroup added a comment. I disabled editing main, user and user talk namespace except for admins, I'm deleting everything. If you need to edit any page, just let me know and I give you admin rights.TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, matej_suchanek, Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T69915: Make galleries a searchable field for File entries
debt edited projects, added Structured-Data-Commons; removed Discovery-Search, Discovery.Herald added a project: Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T69915EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: StudiesWorld, Aklapper, Deskana, Manybubbles, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Izno, Wong128hk, Yann, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, jayvdb, Ricordisamoa, Fabrice_Florin, Raymond, Matanya, Mbch331, Krenair, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T143486: [feature request] remove sitelinks / update sitelinks on Wikidata when pages are deleted/moved on client wikis (all users)
Ladsgroup added a comment. A dummy user like what https://www.mediawiki.org/wiki/Extension:NewUserMessage or https://www.mediawiki.org/wiki/Extension:MassMessage does sounds good to me.TASK DETAILhttps://phabricator.wikimedia.org/T143486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, PokestarFan, ArthurPSmith, Liuxinyu970226, Izno, hoo, Aklapper, Esc3300, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176327: Special:GoToLinkedPage implicitly shows an error message
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T176327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, Ladsgroup, matej_suchanek, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176327: Special:GoToLinkedPage implicitly shows an error message
Ladsgroup added a project: Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T176327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: gerritbot, Ladsgroup, matej_suchanek, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176327: Special:GoToLinkedPage implicitly shows an error message
gerritbot added a comment. Change 379575 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani): [mediawiki/extensions/Wikibase@master] Fix error in SpecialGoToLinkedPage https://gerrit.wikimedia.org/r/379575TASK DETAILhttps://phabricator.wikimedia.org/T176327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, Ladsgroup, matej_suchanek, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T175741: Set ElasticSearch implementation as default for wbsearchentites on Wikidata
debt edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAILhttps://phabricator.wikimedia.org/T175741EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: gerritbot, Sjoerddebruin, Aklapper, EBernhardson, dcausse, Lydia_Pintscher, daniel, Smalyshev, Lea_Lacroix_WMDE, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176404: Item merging should be possible without remembering Q-IDs
Jan_Dittrich added a comment. Is the merge gadget "ours" or does it belong to someone else?TASK DETAILhttps://phabricator.wikimedia.org/T176404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: daniel, Lydia_Pintscher, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T44325: Prevent creation of items having the same sitelinks (duplicates)
matej_suchanek removed a project: TestMe.matej_suchanek added a comment. I've just fixed another occurrence of this: Q37637657 and Q37637661.TASK DETAILhttps://phabricator.wikimedia.org/T44325EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Nikki, Liuxinyu970226, TerraCodes, aude, Aklapper, AnjaJentzsch, Abraham, jeblad, Legoktm, He7d3r, Merl, jayvdb, Denny, revi, matej_suchanek, Lydia_Pintscher, Beta16, daniel, hoo, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T176327: Special:GoToLinkedPage implicitly shows an error message
Ladsgroup claimed this task.Herald added a project: User-Ladsgroup. TASK DETAILhttps://phabricator.wikimedia.org/T176327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, matej_suchanek, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T121274: Provide an RDF mapping for external identifiers
daniel added subscribers: Denny, mkroetzsch.daniel added a comment. In T121274#3619944, @Smalyshev wrote: My point was: expanding IDs to resource references is not really the same thing as normalizing values That depends on normalization I'd guess. But that's a good point. In any case, how we make a decision here? We asked @Denny and @mkroetzsch, and they agree with each other that we don't need to distinguish. @Lucas_Werkmeister_WMDE is also happy with just one prefix, and you also seem to be arguing for that solution. I was never opposed to it, just wary of unforeseen consequences. What if we do need both expansion and normalization for some data type eventually? But the RDF experts agree, and YAGNI applies, so the decision is made: treat URI expansion like value normalization. No need for separate prefixes.TASK DETAILhttps://phabricator.wikimedia.org/T121274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: mkroetzsch, Denny, Ladsgroup, Lucas_Werkmeister_WMDE, Jonas, Esc3300, abian, gerritbot, Lydia_Pintscher, Aklapper, daniel, hoo, thiemowmde, JanZerebecki, aude, Liuxinyu970226, Ricordisamoa, Micru, Sannita, Laddo, Smalyshev, Tobi_WMDE_SW, Bugreporter, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T96040: Wikibase special pages (tracking)
matej_suchanek added subtasks: T176321: Allow Special:GoToLinkedPage to use site=enwiki,* - open anything, T117159: uselang parameter doesn't work for labels/descriptions on Special:Nearby, T149616: Prevent duplicate properties and items from getting created, T176327: Special:GoToLinkedPage implicitly shows an error message. TASK DETAILhttps://phabricator.wikimedia.org/T96040EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: PokestarFan, Luke081515, Liuxinyu970226, aude, Aklapper, Lsherwinforone, GoranSMilovanovic, QZanden, Ptolusque, Sethakill, Izno, Wong128hk, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176321: Allow Special:GoToLinkedPage to use site=enwiki, * - open anything
matej_suchanek added a parent task: T96040: Wikibase special pages (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T176321EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Aklapper, Smalyshev, daniel, Lydia_Pintscher, Yurik, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T117159: uselang parameter doesn't work for labels/descriptions on Special:Nearby
matej_suchanek added a parent task: T96040: Wikibase special pages (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T117159EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Nikki, Aklapper, mojoaxel, GoranSMilovanovic, QZanden, Winter, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176327: Special:GoToLinkedPage implicitly shows an error message
matej_suchanek added a parent task: T96040: Wikibase special pages (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T176327EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Ladsgroup, matej_suchanek, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T149616: Prevent duplicate properties and items from getting created
matej_suchanek added a parent task: T96040: Wikibase special pages (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T149616EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Nikki, Pigsonthewing, Aklapper, ChristianKl, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T121274: Provide an RDF mapping for external identifiers
gerritbot added a comment. Change 377765 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Replace $this->getSettings() with $this->settings https://gerrit.wikimedia.org/r/377765TASK DETAILhttps://phabricator.wikimedia.org/T121274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: daniel, gerritbotCc: Ladsgroup, Lucas_Werkmeister_WMDE, Jonas, Esc3300, abian, gerritbot, Lydia_Pintscher, Aklapper, daniel, hoo, thiemowmde, JanZerebecki, aude, Liuxinyu970226, Ricordisamoa, Micru, Sannita, Laddo, Smalyshev, Tobi_WMDE_SW, Bugreporter, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T46529: Wikidata search problems (tracking)
matej_suchanek updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...I'm adding this in lucene-search-2 component because wikidata has a keyword, but search doesn't have that nor a tracking bug. -- **Version**: unspecified **Severity**: normalTASK DETAILhttps://phabricator.wikimedia.org/T46529EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: PokestarFan, Smalyshev, Wikidata-bugs, Nemo_bis, Aklapper, GoranSMilovanovic, QZanden, Izno, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176389: Searching for properties using "p:" hack is no longer useful
matej_suchanek added a parent task: T46529: Wikidata search problems (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T176389EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, GoranSMilovanovic, Jrbranaa, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T152944: Allow searching a person by their initials in the search engine
matej_suchanek added a parent task: T46529: Wikidata search problems (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T152944EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Sylvain_WMFr, Lea_Lacroix_WMDE, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T156344: Property: namespace as content
matej_suchanek added a parent task: T46529: Wikidata search problems (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T156344EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Lydia_Pintscher, EBernhardson, aude, dcausse, daniel, Aklapper, Smalyshev, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T46529: Wikidata search problems (tracking)
matej_suchanek added subtasks: T176389: Searching for properties using "p:" hack is no longer useful, T152944: Allow searching a person by their initials in the search engine, T156344: Property: namespace as content. TASK DETAILhttps://phabricator.wikimedia.org/T46529EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: PokestarFan, Smalyshev, Wikidata-bugs, Nemo_bis, Aklapper, GoranSMilovanovic, QZanden, Izno, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T46529: Wikidata search problems (tracking)
Sjoerddebruin added a subtask: T86923: Entity suggester should show the exact match as first result. TASK DETAILhttps://phabricator.wikimedia.org/T46529EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SjoerddebruinCc: PokestarFan, Smalyshev, Wikidata-bugs, Nemo_bis, Aklapper, GoranSMilovanovic, QZanden, Izno, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T86923: Entity suggester should show the exact match as first result
Sjoerddebruin added a parent task: T46529: Wikidata search problems (tracking). TASK DETAILhttps://phabricator.wikimedia.org/T86923EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SjoerddebruinCc: adrianheine, thiemowmde, Snaterlicious, Lydia_Pintscher, Sjoerddebruin, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unassigned] T176321: Allow Special:GoToLinkedPage to use site=enwiki, * - open anything
Sjoerddebruin removed Lydia_Pintscher as the assignee of this task. TASK DETAILhttps://phabricator.wikimedia.org/T176321EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SjoerddebruinCc: Aklapper, Smalyshev, daniel, Lydia_Pintscher, Yurik, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T176408: Run MediaInfo tests on jenkins (post-merge job for Wikibase)
Addshore triaged this task as "High" priority. TASK DETAILhttps://phabricator.wikimedia.org/T176408EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: aude, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T70567: Make EntityView UI aware of redirects
gerritbot added a comment. Change 379545 had a related patch set uploaded (by Matěj Suchánek; owner: Matěj Suchánek): [mediawiki/extensions/Wikibase@master] Add CSS class to item redirects in UI https://gerrit.wikimedia.org/r/379545TASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T70567: Make EntityView UI aware of redirects
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T70567EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, PokestarFan, thiemowmde, adrianheine, aude, Snaterlicious, Lydia_Pintscher, daniel, JohnLewis, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo created subtask T176417: Make AffectedPagesFinder take DESCRIPTION_USAGE into account. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Izno, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176417: Make AffectedPagesFinder take DESCRIPTION_USAGE into account
hoo created this task.hoo added projects: Wikidata, MediaWiki-extensions-WikibaseClient. TASK DESCRIPTIONAffectedPagesFinder should take the new description usage (D) into account when identifying relevant pages for a change. This is needed if we want to stop also tracking all (X) or other (O) usages along with statement usages. This probably requires T113468: [Task] Use compact representation of diffs in EntityChange. to work.TASK DETAILhttps://phabricator.wikimedia.org/T176417EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, Bianjiang, aude, jeremyb, liangent, Wikidata-bugs, greg, Abraham, Legoktm, Tobi_WMDE_SW, Daniel_Mietchen, jayvdb, Micru, Ricordisamoa, MZMcBride, Liuxinyu970226, Ainali, Sannita, Lydia_Pintscher, Eloquence, zhuyifei1999, daniel, jmadler, PokestarFan, eranroz, hoo, GoranSMilovanovic, QZanden, Izno, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176416: Save Wikidata's properties that link to Commons pages in a uniform format
Jarekt created this task.Jarekt added projects: Wikidata, Commons.Herald added a subscriber: Aklapper. TASK DESCRIPTIONCurrently properties that link to non-file Commons pages , like Commons category (P373), Commons gallery (P935), Commons Creator page (P1472), or Commons Institution page (P1612), are saved as string type properties. As a result a link to a single page can be saved in numerous valid but different formats that point to the same page. For example Commons Creator page (P1472) can be set to "Stanisław Lem", "Stanisław_Lem" or "Stanis%C5%82aw_Lem" and they will all point to c:Creator:Stanisław Lem. Wikidata should accept inputs in any of those forms but save it in a uniform format. Otherwise we can have multiple links from a single item to the same page, it also makes it hard to write a query which compares such properties to sitelinks or to each other. One solution would be to either extend commonsMedia property type to allow links to other pages on commons. Other solution would be to create property type specifically designed for linking to pages on commons and other projects. F9701730: New Picture.pngTASK DETAILhttps://phabricator.wikimedia.org/T176416EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JarektCc: Jarekt, Aklapper, GoranSMilovanovic, QZanden, Poyekhali, Izno, Wong128hk, Wikidata-bugs, aude, El_Grafo, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T176404: Item merging should be possible without remembering Q-IDs
Lydia_Pintscher triaged this task as "Lowest" priority.Lydia_Pintscher added a comment. Marking this as lowest because people are supposed to use the merge gadget and as far as I can tell they are.TASK DETAILhttps://phabricator.wikimedia.org/T176404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: daniel, Lydia_Pintscher, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo added a parent task: T90436: Improve usage tracking granularity to avoid irrelevant changes showing in the watchlist.. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Izno, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T90436: Improve usage tracking granularity to avoid irrelevant changes showing in the watchlist.
hoo added a subtask: T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D"). TASK DETAILhttps://phabricator.wikimedia.org/T90436EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Raymond, FriedhelmW, AndrewSu, Capankajsmilyo, Fuzheado, Bawolff, Tbayer, jeremyb, Agabi10, RP88, Halfak, Doc_James, hoo, PokestarFan, IKhitron, eranroz, Izno, Oliv0, Ltrlg, Scott_WUaS, Danmichaelo, CennoxX, Liuxinyu970226, aude, Lydia_Pintscher, daniel, Aklapper, GoranSMilovanovic, Rafisamra2016, QZanden, Tal-WMIL, Avner, Tzafrir, Wikidata-bugs, Amire80, Matanya, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T151717: Usage tracking: record which statement group is used
hoo added a comment.
We still track Other ("O") and All usages ("X") on elwiki like we did before. If we conclude the test there ok, we can stop doing this and move forward here and with T172914.
Please note that no longer tracking O or X usages along also requires T176413: Make AffectedPagesFinder take STATEMENT_USAGE into account.TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176413: Make AffectedPagesFinder take STATEMENT_USAGE into account
hoo created this task.hoo added projects: MediaWiki-extensions-WikibaseClient, Wikidata. TASK DESCRIPTIONAffectedPagesFinder should take EntityUsage::STATEMENT_USAGE into account when identifying relevant pages for a change. This is needed if we want to stop also tracking all (X) or other (O) usages along with statement usages.TASK DETAILhttps://phabricator.wikimedia.org/T176413EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: daniel, DixonD, Aklapper, Bianjiang, aude, jeremyb, liangent, Wikidata-bugs, Abraham, Legoktm, Tobi_WMDE_SW, Daniel_Mietchen, jayvdb, Micru, Ricordisamoa, MZMcBride, Liuxinyu970226, Ainali, Sannita, Lydia_Pintscher, Eloquence, zhuyifei1999, Hall1467, TomT0m, jcrespo, Halfak, gerritbot, Stashbot, Ladsgroup, PokestarFan, Ottomata, eranroz, Bawolff, hoo, GoranSMilovanovic, QZanden, Izno, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T151717: Usage tracking: record which statement group is used
hoo created subtask T176413: Make AffectedPagesFinder take STATEMENT_USAGE into account. TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173818: [Epic] Kill the Wikidata build step
aude added a subtask: T176408: Run MediaInfo tests on jenkins (post-merge job for Wikibase). TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, audeCc: Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, GoranSMilovanovic, QZanden, Liudvikas, Izno, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176408: Run MediaInfo tests on jenkins (post-merge job for Wikibase)
aude added a parent task: T173818: [Epic] Kill the Wikidata build step. TASK DETAILhttps://phabricator.wikimedia.org/T176408EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176408: Run MediaInfo tests on jenkins (post-merge job for Wikibase)
aude created this task.aude added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONWe currently have MediaInfo in the Wikidata build so that tests run regularly and we are aware when it is broken (e.g. due to changes in Wikibase) we are getting rid of the build, but think it would still be useful to have MediaInfo tests run. Maybe we could have a post-merge job on jenkins that runs MediaInfo (and Lexeme, PropertySuggester, etc) tests when patches are merged into Wikibase. ideally the tests are in a way that we are notified when they are failing.TASK DETAILhttps://phabricator.wikimedia.org/T176408EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176405: Order of forms
Jan_Dittrich added a comment. @Lydia_Pintscher @daniel please supplement.TASK DETAILhttps://phabricator.wikimedia.org/T176405EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176405: Order of forms
Jan_Dittrich created this task.Jan_Dittrich added projects: Lexicographical data, Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONUser Story:: As a user, I want to create new forms of an lexeme As a user I want to find the form I am looking for quickly Context of use: ? Current Problems: Currently we order by _?_ Possible Solution: Order by: Order by time of creation Order alphabetically Order by grammatical feature (but how? Is that like "adverbs" are before "adjectives"? Will there be a table for the order somewhere?) Behaviour Create at end of list and keep it there after creation while loaded. On reload order the new item into the list properly. TASK DETAILhttps://phabricator.wikimedia.org/T176405EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: Lydia_Pintscher, daniel, Aklapper, Jan_Dittrich, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T176404: Item merging should be possible without remembering Q-IDs
Jan_Dittrich updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...**Possible Solution**: Use item selectors instead of plain text input.
Current screenshot:
{F9698574}
TASK DETAILhttps://phabricator.wikimedia.org/T176404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: daniel, Lydia_Pintscher, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176404: Item merging should be possible without remembering Q-IDs
Jan_Dittrich created this task.Jan_Dittrich added projects: WMDE-Design, Wikidata.Herald added a subscriber: Aklapper.Herald added a project: Design. TASK DESCRIPTIONUser Story:: As a user, I want to merge two items Context of use: The users will probably find two items that refer to the same thing. They want to merge them. Current Problems: Currently, "Merge two items" does not have item selectors but only plain text fields for inputting the QIDs directly. Possible Solution: Use item selectors instead of plain text input.TASK DETAILhttps://phabricator.wikimedia.org/T176404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: daniel, Lydia_Pintscher, Aklapper, Jan_Dittrich, GoranSMilovanovic, QZanden, JGirault, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used
daniel added a comment. In T151717#3623996, @Lydia_Pintscher wrote: I assume the latter also means we are not decreasing the number of irrelevant changes shown in the watchlist and recent changes yet? Potentially yes. How much impact this actually has is hard to predict. If most pages only use a small fraction of the statements on the items, and a lot of unused statements get added or edited, then the effect is large.TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used
Lydia_Pintscher added a comment. I assume the latter also means we are not decreasing the number of irrelevant changes shown in the watchlist and recent changes?TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T168041: Assign different favicons to query.wikidata.org and test.wikidata.org
Charlie_WMDE added a comment. Hi @Smalyshev, the file is a rectangle and has no margins. The whitespace you see is put there by Phabricator to make it look nicer I guess. If you take a look at the file on commons you can see it better. 220x200 is not the size for a favicon. Favicons vary in size, depending on the device and browser used etc. They are usually 16x16px but can go up to 64x64px and maybe even larger in other areas. Here's the icon as an ICO in hopefully all the sizes that you'll need: F9694582: WD_Favicon_color_Query.icoTASK DETAILhttps://phabricator.wikimedia.org/T168041EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Charlie_WMDECc: Hanna_Petruschat_WMDE, gerritbot, Esc3300, PokestarFan, Smalyshev, James_Budday, Jonas, Jan_Dittrich, Charlie_WMDE, Lydia_Pintscher, Aklapper, MisterSynergy, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Gehel, JGirault, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T119536: wikidata.org/entity/Q12345 should do content negotiation immediately, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first
elukey added a project: User-Elukey. TASK DETAILhttps://phabricator.wikimedia.org/T119536EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: elukey, PokestarFan, Ladsgroup, gerritbot, Esc3300, thiemowmde, hoo, elf-pavlik, JanZerebecki, Aklapper, StudiesWorld, daniel, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Zoranzoki21, Lewizho99, Maathavan, DatGuy, Devwaker, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, suriyaa, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Dcljr, Southparkfan, fbstj, Jdforrester-WMF, Matanya, Mbch331, Rxy, Jay8g, Glaisher, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T119536: wikidata.org/entity/Q12345 should do content negotiation immediately, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first
elukey added a comment. Hey @daniel, I have a couple of things to ask: I checked on deployment-mediawiki04/5 and I saw that an old version of the code was cherry picked, namely the solution with two rewrites (before the redirect=force). I removed it from puppetmaster02, I guess that we'd need to cherry pick https://gerrit.wikimedia.org/r/#/c/357985 and test again? It is a bit difficult to get the list of requirements from this task, would you mind to give us a list of redirects/rewrites/etc.. that this new change is supposed to do? One good thing that we could do is to test all the requests in 2) in labs with LogLevel for mod_rewrite to trace8, so apache will tell us exactly all the steps that the rewrite process do. After that we should be reasonably confident to merge :)TASK DETAILhttps://phabricator.wikimedia.org/T119536EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: elukeyCc: elukey, PokestarFan, Ladsgroup, gerritbot, Esc3300, thiemowmde, hoo, elf-pavlik, JanZerebecki, Aklapper, StudiesWorld, daniel, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Zoranzoki21, Lewizho99, Maathavan, DatGuy, Devwaker, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, suriyaa, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Dcljr, Southparkfan, fbstj, Jdforrester-WMF, Matanya, Mbch331, Rxy, Jay8g, Glaisher, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T44063: [Epic] Provide a plain linked data interface for accessing entities
thiemowmde added a project: Wikidata-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: gerritbot, PokestarFan, cscott, Liuxinyu970226, intracer, Aklapper, AnjaJentzsch, Abraham, Denny, Lydia_Pintscher, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T44063: [Epic] Provide a plain linked data interface for accessing entities
gerritbot added a comment. Change 379509 had a related patch set uploaded (by Thiemo Mättig (WMDE); owner: Thiemo Mättig (WMDE)): [purtle@master] Minor code structure clean ups in JsonLdRdfWriter https://gerrit.wikimedia.org/r/379509TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, PokestarFan, cscott, Liuxinyu970226, intracer, Aklapper, AnjaJentzsch, Abraham, Denny, Lydia_Pintscher, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T151717: Usage tracking: record which statement group is used
eranroz added a comment. wbc_entity_usage tracking for statement group - PASS As hoo showed in the previous comments, we get C records, and the table doesn't blowup too much. (currently 2037539 records in that table). only purge the page when that statement group changes - FAIL Keep in mind that the original goal of this ticket is: Similarly, we should record which statement group is used (by property ID), so we only purge the page when that statement group changes. Here I'm going to use recentchanges table with rc_source=wb as proxy to purges. While this works in the micro level, it doesn't yet look nice enough in the macro level. Micro level: Selecting a page for which we track on specific claim: select * from wbc_entity_usage wbc_a where wbc_a.eu_aspect like 'C%' and not exists(select * from wbc_entity_usage wbc_b where wbc_b.eu_page_id=wbc_a.eu_page_id and wbc_b.eu_aspect='X') limit 5; Doing some change in wikidata that doesn't affect that property indeed doesn't create rc record: select * from recentchanges where rc_source ='wb' and rc_title = 'Γιάννης_Μπουτάρης' and rc_namespace=0 limit 5;/*empty results */ Macro level - there are still many records from WB select left(rc_timestamp, 8), count(*) from recentchanges where rc_source ='wb' and rc_timestamp>2017091800 group by left(rc_timestamp, 8); +---+--+ | left(rc_timestamp, 8) | count(*) | +---+--+ | 20170918 |93493 | | 20170919 |31978 | | 20170920 |39313 | | 20170921 | 5753 | +---+--+ Or in hour resolution (since not much time passed since deployment): select left(rc_timestamp, 10), count(*) from recentchanges where rc_source ='wb' and rc_timestamp>2017091800 group by left(rc_timestamp, 10); | 2017091800 | 120 | | 2017091801 | 363 | | 2017091802 | 2098 | | 2017091803 | 284 | ... | 2017092000 | 336 | | 2017092001 | 389 | | 2017092002 | 169 | | 2017092003 | 188 | This is probably because there are still as many as X usages as there were previously. I guess the next step to get it fixed is to go on with T172914 ?TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranrozCc: Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176391: remove and prevent spam on lexeme test system
Lydia_Pintscher added a comment. Yeah agreed.TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: matej_suchanek, Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176391: remove and prevent spam on lexeme test system
matej_suchanek added a comment. Editing main and user namespace is probably pointless, so https://www.mediawiki.org/wiki/Manual:$wgNamespaceProtection should help.TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T168041: Assign different favicons to query.wikidata.org and test.wikidata.org
Jan_Dittrich added a subscriber: Hanna_Petruschat_WMDE.Jan_Dittrich added a comment. @Charlie_WMDE @Hanna_Petruschat_WMDE : Let's give this a proper review and post our decision + file then.TASK DETAILhttps://phabricator.wikimedia.org/T168041EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jan_DittrichCc: Hanna_Petruschat_WMDE, gerritbot, Esc3300, PokestarFan, Smalyshev, James_Budday, Jonas, Jan_Dittrich, Charlie_WMDE, Lydia_Pintscher, Aklapper, MisterSynergy, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Gehel, JGirault, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T176391: remove and prevent spam on lexeme test system
Lydia_Pintscher added a comment. http://wikidata-lexeme.wmflabs.org/index.php/Special:RecentChangesTASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176391: remove and prevent spam on lexeme test system
Lydia_Pintscher created this task.Lydia_Pintscher added a project: Lexicographical data.Herald added a subscriber: Aklapper.Herald added a project: Wikidata. TASK DESCRIPTIONThe lexeme test system is being spammed unfortunately. We need to nuke it and prevent future spam.TASK DETAILhttps://phabricator.wikimedia.org/T176391EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Aklapper, Lydia_Pintscher, Cinemantique, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Darkdadaah, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T176389: Searching for properties using "p:" hack is no longer useful
matej_suchanek created this task.matej_suchanek added projects: Wikidata, MediaWiki-extensions-WikibaseRepository, Regression.Herald added a subscriber: Aklapper. TASK DESCRIPTIONWhen you want to find all properties mentioning a specific word (eg. "language"), you need to search for the _expression_ "p:language". However, this doesn't work anymore (you can see a few results but there are much much more properties related to a language, like official language (P37)).TASK DETAILhttps://phabricator.wikimedia.org/T176389EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: matej_suchanek, Aklapper, GoranSMilovanovic, Jrbranaa, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173850: Possible WMF deployed extension PHP 7 issues
Paladox added a comment. I think they fixed most of the false positives now. Could someone re run the linter and update the description please?TASK DETAILhttps://phabricator.wikimedia.org/T173850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PaladoxCc: Paladox, Ottomata, gerritbot, Mattflaschen-WMF, Liuxinyu970226, WMDE-leszek, Anomie, Aklapper, Jdforrester-WMF, Addshore, MaxSem, Krenair, Reedy, anant-k-agrawal, Minilexikon, Timoavax79, Lordiis, GoranSMilovanovic, TheDragonFire, Maosef, Adik2382, 45Jayjay1969, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Orienteerix, EnricoCNC, Litanwei, Avner, Lewizho99, Ddproxy, Maathavan, debt, TerraCodes, Iniquity, SundanceRaphael, Reasno, Gehel, Debenben, Jseddon, JGirault, gabriel-wmde, phabyogi, FloNight, DStrine, Dixtosa, Trizek-WMF, GAllegre, Susannaanas, XenoRyet, Thibaut120094, Izno, SBisson, Matiia, ferdbold, lxbarth, Wong128hk, Luke081515, Nirmos, JAllemandou, Planemad, Wikidata-bugs, Snowolf, Prod, Hydriz, Base, aude, fredw, SPQRobin, AndyRussG, Ebe123, Pcoombe, Huji, Physikerwelt, Pkra, Dinoguy1000, Gryllida, jeblad, jayvdb, Ricordisamoa, MrStradivarius, Catrope, Lydia_Pintscher, Yurik, Darkdadaah, Arrbee, scfc, KartikMistry, Se4598, Jackmcbarn, Mbch331, Jay8g, Ltrlg, Joe, jeremyb, Legoktm, Tgr___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173710: Job queue is increasing non-stop
gerritbot added a comment. Change 378719 merged by jenkins-bot: [mediawiki/extensions/Wikibase@master] Refactor possibly fragile ChangeHandler/WikiPageUpdater hash calculations https://gerrit.wikimedia.org/r/378719TASK DETAILhttps://phabricator.wikimedia.org/T173710EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: YOUR1, Tbayer, mobrovac, Nikerabbit, Mholloway, Legoktm, ema, Joe, GWicke, Nemo_bis, Andreasmperu, BBlack, Peachey88, Liuxinyu970226, daniel, Stashbot, Agabi10, Daniel_Mietchen, XXN, Pasleim, Bugreporter, Sjoerddebruin, Magnus, Mr.Ibrahem, gerritbot, EBernhardson, Esc3300, jcrespo, WMDE-leszek, Jdforrester-WMF, Krinkle, aaron, fgiunchedi, Aklapper, Ladsgroup, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, Vali.matei, Avner, Lewizho99, Zppix, Maathavan, debt, Gehel, FloNight, Izno, Eevans, Hardikj, Wikidata-bugs, aude, jayvdb, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
