[Wikidata-bugs] [Maniphest] [Updated] T217425: Enable disabled phan checks in WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added a subtask: T215556: Enable phan checks for WikibaseLexeme extension. TASK DETAIL https://phabricator.wikimedia.org/T217425 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Ladsgroup, alaa_wmde, Nandana, Mringgaard, Lahi

[Wikidata-bugs] [Maniphest] [Updated] T215556: Enable phan checks for WikibaseLexeme extension

2019-03-13 Thread Smalyshev
Smalyshev added a parent task: T217425: Enable disabled phan checks in WikibaseLexeme. TASK DETAIL https://phabricator.wikimedia.org/T215556 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup, Smalyshev Cc: gerritbot, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Updated] T206175: mediawiki-vagrant role for WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added a project: Wikimedia-Hackathon-2019. TASK DETAIL https://phabricator.wikimedia.org/T206175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: awight, alaa_wmde, Ferenczy, sarhan.alaa, Samuditha24, IM3847, Dinadineke

[Wikidata-bugs] [Maniphest] [Updated] T206175: mediawiki-vagrant role for WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev removed a project: Wikimania-Hackathon-2019. TASK DETAIL https://phabricator.wikimedia.org/T206175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: awight, alaa_wmde, Dinadineke, Nandana, Mringgaard, tabish.shaikh91, Lahi

[Wikidata-bugs] [Maniphest] [Updated] T206175: mediawiki-vagrant role for WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added projects: Need-volunteer, Wikimania-Hackathon-2019. TASK DETAIL https://phabricator.wikimedia.org/T206175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: awight, alaa_wmde, Dinadineke, Nandana, Mringgaard

[Wikidata-bugs] [Maniphest] [Commented On] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added a comment. Patches for WBCS that we'd need to repeat for Lexeme: [ ] https://gerrit.wikimedia.org/r/c/integration/config/+/432923 [ ] https://gerrit.wikimedia.org/r/c/integration/config/+/486170 [ ] https://gerrit.wikimedia.org/r/c/mediawiki/tools/release/+/489362

[Wikidata-bugs] [Maniphest] [Updated] T212826: Create dedicated Updater service in Blazegraph

2019-03-12 Thread Smalyshev
Smalyshev added a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T212826 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Closed] T200558: Write a formal description of pending WDQS tasks suitable for contractor/hire

2019-03-12 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T200558 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBjune, Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, Lucas_Werkme

[Wikidata-bugs] [Maniphest] [Updated] T218174: Add metric for skip-ahead revisions

2019-03-12 Thread Smalyshev
Smalyshev added a comment. Related to discussion in T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater <https://phabricator.wikimedia.org/T217897>. TASK DETAIL https://phabricator.wikimedia.org/T218174 EMAIL PREFERENCES https://phabricator.wikimed

[Wikidata-bugs] [Maniphest] [Created] T218174: Add metric for skip-ahead revisions

2019-03-12 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Make a metric showing how many revision fetches fetched data with revisions ahead

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-12 Thread Smalyshev
Smalyshev added a comment. > Why do these remote clients need "realtime" (no staleness) fetches of Q items? Because that's what Query Service is - realtime (well, near-realtime, given update times) queryable representation of Wikidata content in RDF form. > What I h

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-12 Thread Smalyshev
Smalyshev added a comment. > it at least make sense to raise the issue so that the WDQS use case is addressed if it can be addressed For that, we better define "WDQS case". The best I have right now is the event aggregation idea described above. In theory, it could als

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-12 Thread Smalyshev
Smalyshev added a comment. > I'm not sure I understand why a If-Modified-Since: would not work. How would you see it working? In Varnish, it would be useless since Varnish has no way of knowing if Wikidata item changed since being cached. If we go to the backend, first we are alre

[Wikidata-bugs] [Maniphest] [Commented On] T217925: Keep global "last seen revision" map for Updater

2019-03-11 Thread Smalyshev
Smalyshev added a comment. > To clarify: this would all be internal to the updater, right? Right. TASK DETAIL https://phabricator.wikimedia.org/T217925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_W

[Wikidata-bugs] [Maniphest] [Triaged] T217945: Updater dashboards broken

2019-03-08 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T217945 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Mathew.onipe, Gehel, Smalyshev, alaa_wmde, Nandana,

[Wikidata-bugs] [Maniphest] [Created] T217945: Updater dashboards broken

2019-03-08 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION On https://grafana.wikimedia.org/d/00489/wikidata-query-service most Updater graphs now

[Wikidata-bugs] [Maniphest] [Updated] T217896: Make the user agent configurable for Wikidata Query Service Updater

2019-03-08 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T217896 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Base, Aklapper, Gehel, alaa_wmde, Legado_Shulgin

[Wikidata-bugs] [Maniphest] [Triaged] T217896: Make the user agent configurable for Wikidata Query Service Updater

2019-03-08 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T217896 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Base, Aklapper, Gehel, alaa_wmde, Legado_Shulgin, Nandana,

[Wikidata-bugs] [Maniphest] [Commented On] T217896: Make the user agent configurable for Wikidata Query Service Updater

2019-03-08 Thread Smalyshev
Smalyshev added a comment. Blazegraph accepts `http.userAgent` but looks like Updater does not. Probably makes sense to make it do the same. TASK DETAIL https://phabricator.wikimedia.org/T217896 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Closed] T216855: Set up Blazegraph test suite on CI

2019-03-08 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Seems to work now! TASK DETAIL https://phabricator.wikimedia.org/T216855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev

[Wikidata-bugs] [Maniphest] [Created] T217925: Keep global "last seen revision" map for Updater

2019-03-08 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION If we kept a map of all latest revision IDs for all items we've recently updated (not derived

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-08 Thread Smalyshev
Smalyshev added a comment. > don't do cache busting on events older than X This however gave me an idea. If we kept a map of all latest revision IDs for all items we've recently updated, we could eliminate a lot of stale updates - especially when we're catching up after the

[Wikidata-bugs] [Maniphest] [Updated] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-08 Thread Smalyshev
Smalyshev added a comment. > disable cache busting by default, enable it internally This would immediately break all external updaters. They'd just pick up the first update in a bunch and ignore the rest, because of the caching. > use the event date instead of the curren

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-08 Thread Smalyshev
Smalyshev added a comment. We've been around this topic a number of times, so I'll write a summary where we're at so far. I'm sorry it's going to be long, there's a bunch of issues at play. Also, if after reading this you think it's utter nonsense and I'm missing an obvious solution

[Wikidata-bugs] [Maniphest] [Commented On] T216855: Set up Blazegraph test suite on CI

2019-03-07 Thread Smalyshev
Smalyshev added a comment. We need to increase timeout, 30 mins is not enough. TASK DETAIL https://phabricator.wikimedia.org/T216855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel, Stashbot, gerritbot, Aklapper, Smalyshev

[Wikidata-bugs] [Maniphest] [Edited] T217276: Test WikibaseCirrusSearch on testwikidata

2019-03-07 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T217276 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, gerritbot, Aklapper, Smalyshev, alaa_wmde, ET4Eva, CucyNoiD, Nandana, NebulousIris

[Wikidata-bugs] [Maniphest] [Commented On] T157676: Provide access to category information from WDQS SPARQL

2019-03-06 Thread Smalyshev
Smalyshev added a comment. Yes we track category tree but not category membership for individual pages (much bigger data set, obviously). TASK DETAIL https://phabricator.wikimedia.org/T157676 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T190022: Separate the CirrusSearch/Elastic-specific code from Wikibase code base

2019-03-06 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T190022 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jony, Lucas_Werkmeister_WMDE, gerritbot, Addshore, Aleksey_WMDE, thiemowmde, RazShuty

[Wikidata-bugs] [Maniphest] [Commented On] T215684: Deploy & test WikibaseCirrusSearch on beta cluster

2019-03-01 Thread Smalyshev
Smalyshev added a comment. Seems to work just fine on beta cluster. TASK DETAIL https://phabricator.wikimedia.org/T215684 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, gerritbot, Aklapper, Smalyshev, ET4Eva, CucyNoiD

[Wikidata-bugs] [Maniphest] [Edited] T215684: Deploy & test WikibaseCirrusSearch on beta cluster

2019-03-01 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T215684 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, gerritbot, Aklapper, Smalyshev, ET4Eva, CucyNoiD, Nandana, NebulousIris, Gaboe420

[Wikidata-bugs] [Maniphest] [Updated] T211177: WDQ UI should support download of RDF formats

2019-02-28 Thread Smalyshev
Smalyshev added projects: Wikimedia-Hackathon-2019, Need-volunteer. TASK DETAIL https://phabricator.wikimedia.org/T211177 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, VladimirAlexiev, Ferenczy, sarhan.alaa

[Wikidata-bugs] [Maniphest] [Updated] T217285: commonswiki / wikibase: Postcondition failed: Namespace for entity type property must be defined!

2019-02-27 Thread Smalyshev
Smalyshev added a project: WikibaseMediaInfo. TASK DETAIL https://phabricator.wikimedia.org/T217285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: matthiasmullie, TerraCodes, Liuxinyu970226, Stashbot, gerritbot, Aklapper, hashar

[Wikidata-bugs] [Maniphest] [Created] T217276: Test WikibaseCirrusSearch on testwikidata

2019-02-27 Thread Smalyshev
Smalyshev created this task. Smalyshev triaged this task as "Normal" priority. Smalyshev added projects: Wikidata, User-Smalyshev, Discovery, CirrusSearch, Discovery-Search (Current work). Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Cu

[Wikidata-bugs] [Maniphest] [Edited] T215684: Deploy & test WikibaseCirrusSearch on beta cluster

2019-02-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T215684 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Smalyshev, ET4Eva, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo

[Wikidata-bugs] [Maniphest] [Updated] T46773: property search in entity selector should not be prefix-only

2019-02-27 Thread Smalyshev
Smalyshev added a project: Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T46773 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: CristianCantoro_SUL, Smalyshev, Wikidata-bugs, jeblad, thiemowmde, Denny, aude

[Wikidata-bugs] [Maniphest] [Commented On] T215967: Add keyword for filtering based on captions in specific language

2019-02-27 Thread Smalyshev
Smalyshev added a comment. @Lea_Lacroix_WMDE yes, but it will be deployed when WikibaseCirrusSearch extension is fully deployed, thus we might want to wait with the announcement until then. TASK DETAIL https://phabricator.wikimedia.org/T215967 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Closed] T217161: Wikidata Query Service short url function broken

2019-02-27 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T217161 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, MartinPoulter, gerritbot, Smalyshev

[Wikidata-bugs] [Maniphest] [Updated] T192871: Enable the query service updater to optionally use RecentChangesLinked for RC input

2019-02-26 Thread Smalyshev
Smalyshev removed a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T192871 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Gehel, Addshore, Daniel_Mietchen, Smalyshev, RazShuty, ET4Eva, Nandana, LJ

[Wikidata-bugs] [Maniphest] [Triaged] T192871: Enable the query service updater to optionally use RecentChangesLinked for RC input

2019-02-26 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T192871 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Gehel, Addshore, Daniel_Mietchen, Smalyshev, RazShuty, ET4Eva

[Wikidata-bugs] [Maniphest] [Triaged] T197530: [tracking] federation query issues on Wikidata Query Server

2019-02-26 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T197530 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Esc3300, ET4Eva, Nickleh, Nandana, Lahi, Gq86, Dar

[Wikidata-bugs] [Maniphest] [Triaged] T209020: "scanned from multiple locations" errors when launching Blazegraph

2019-02-26 Thread Smalyshev
Smalyshev triaged this task as "Low" priority. TASK DETAIL https://phabricator.wikimedia.org/T209020 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Gehel, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkme

[Wikidata-bugs] [Maniphest] [Triaged] T196872: Make xpath-functions/math available on Wikidata Query Server

2019-02-26 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T196872 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Esc3300, ET4Eva, Dinadineke, Nandana, tabish.shaikh91, L

[Wikidata-bugs] [Maniphest] [Closed] T211007: Dates returned by SPARQL queries are syntactically incorrect (lacks one leading zero for a negative four-digit year)

2019-02-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T211007 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Richa

[Wikidata-bugs] [Maniphest] [Updated] T216855: Set up Blazegraph test suite on CI

2019-02-26 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T216855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Redabr4, Zanziii, Sadisticturd, Nandana, A.S.Kochergin, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Commented On] T217161: Wikidata Query Service short url function broken

2019-02-26 Thread Smalyshev
Smalyshev added a comment. Looking at the HTML source, the iframe that is supposed to be in the popup does not even appear. I traced inside bootstrap code and looks like bootstrap popover code applies sanitizeHtml() to the content, which removes the iframe. Not sure if it's something new

[Wikidata-bugs] [Maniphest] [Updated] T217161: Wikidata Query Service short url function broken

2019-02-26 Thread Smalyshev
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T217161 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, Lydia_Pintscher, Nandana

[Wikidata-bugs] [Maniphest] [Commented On] T217161: Wikidata Query Service short url function broken

2019-02-26 Thread Smalyshev
Smalyshev added a comment. Also, "SPARQL endpoint" link appears to be broken too. But short URL works for me locally, doesn't work in deployed version. Strange... TASK DETAIL https://phabricator.wikimedia.org/T217161 EMAIL PREFERENCES https://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] [Triaged] T217161: Wikidata Query Service short url function broken

2019-02-26 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T217161 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, Nandana, Lahi, Gq86, Lucas_Werkme

[Wikidata-bugs] [Maniphest] [Updated] T189744: Add hints parameter to wbsearchentities

2019-02-26 Thread Smalyshev
Smalyshev edited projects, added Discovery-Search; removed Discovery-Search (Current work), Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T189744 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Nuria, Jonas

[Wikidata-bugs] [Maniphest] [Updated] T216855: Set up Blazegraph test suite on CI

2019-02-22 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T216855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Zanziii, Sadisticturd, Nandana, A.S.Kochergin

[Wikidata-bugs] [Maniphest] [Edited] T197777: potential issues with planned release of query logs (Wikidata Query Server)

2019-02-22 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T19 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Krenair, Bawolff, Lydia_Pintscher, APalmer_WMF, Smalyshev, EBjune, Aklapper, Esc3300, ET4Eva

[Wikidata-bugs] [Maniphest] [Changed Policy] T197777: potential issues with planned release of query logs (Wikidata Query Server)

2019-02-22 Thread Smalyshev
Smalyshev changed the visibility from "All Users" to "Public (No Login Required)". TASK DETAIL https://phabricator.wikimedia.org/T19 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Krenair, Bawolff, Lydia_Pi

[Wikidata-bugs] [Maniphest] [Commented On] T216701: Wikidata Query Service should have a proper high level error handler

2019-02-22 Thread Smalyshev
Smalyshev added a comment. > On our end we can run it and retrieve the stack trace. Provided it reproduces, which is not always the case - can be user error, can be intermittent factors, can be that by the time we get to triage the error, the data has changed. It's much better to

[Wikidata-bugs] [Maniphest] [Closed] T197777: potential issues with planned release of query logs (Wikidata Query Server)

2019-02-22 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. I don't think there's anything left to do for our team here. TASK DETAIL https://phabricator.wikimedia.org/T19 EMAIL PREFERENCES https://phabricator.wikimedia.org/sett

[Wikidata-bugs] [Maniphest] [Changed Policy] T197777: potential issues with planned release of query logs (Wikidata Query Server)

2019-02-22 Thread Smalyshev
Smalyshev changed the visibility from "Custom Policy" to "All Users". TASK DETAIL https://phabricator.wikimedia.org/T19 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Bawolff, Lydia_Pintscher, APalmer_WM

[Wikidata-bugs] [Maniphest] [Lowered Priority] T204045: Support GeoSPARQL in Wikidata Query Service

2019-02-22 Thread Smalyshev
Smalyshev lowered the priority of this task from "Normal" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T204045 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Aklapper,

[Wikidata-bugs] [Maniphest] [Lowered Priority] T165823: loadRestAPI.sh should ignore .good and .fail files

2019-02-22 Thread Smalyshev
Smalyshev lowered the priority of this task from "Normal" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T165823 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, Aklapper, Yurik, ET4Eva,

[Wikidata-bugs] [Maniphest] [Created] T216855: Set up Blazegraph test suite on CI

2019-02-22 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Continuous-Integration-Config. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Since original Blazegraph developers are no longer actively

[Wikidata-bugs] [Maniphest] [Triaged] T211007: Dates returned by SPARQL queries are syntactically incorrect (lacks one leading zero for a negative four-digit year)

2019-02-22 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T211007 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Richard-Degenne, CucyNoiD

[Wikidata-bugs] [Maniphest] [Triaged] T216855: Set up Blazegraph test suite on CI

2019-02-22 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T216855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, Zanziii, Sadisticturd, Nandana, A.S.Kochergin, L

[Wikidata-bugs] [Maniphest] [Commented On] T216701: Wikidata Query Service should have a proper high level error handler

2019-02-22 Thread Smalyshev
Smalyshev added a comment. @Nuria yes but here we're not talking about statistics and measuring errors. That can be done via logs. We're talking about triaging report of a single user that has a problem with specific query. Absent detailed error output, it's very hard for us to know what

[Wikidata-bugs] [Maniphest] [Commented On] T215684: Deploy & test WikibaseCirrusSearch on beta cluster

2019-02-21 Thread Smalyshev
Smalyshev added a comment. Deployed on Beta (http://wikidata.beta.wmflabs.org) in disabled state, if nothing breaks will continue on to Beta Commons & testwikidata. TASK DETAIL https://phabricator.wikimedia.org/T215684 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/p

[Wikidata-bugs] [Maniphest] [Updated] T216701: Wikidata Query Service should have a proper high level error handler

2019-02-21 Thread Smalyshev
Smalyshev merged a task: T115788: Wikidata query endpoint shouldnt return traceback when an error is encountered. Smalyshev added subscribers: Mvolz, abian, Lucas_Werkmeister_WMDE, dpatrick, csteipp, hoo. TASK DETAIL https://phabricator.wikimedia.org/T216701 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Triaged] T216701: Wikidata Query Service should have a proper high level error handler

2019-02-21 Thread Smalyshev
Smalyshev triaged this task as "Low" priority. TASK DETAIL https://phabricator.wikimedia.org/T216701 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: gerritbot, Smalyshev, Gehel, Aklapper, CucyNoiD, Nandana, Ne

[Wikidata-bugs] [Maniphest] [Merged] T115788: Wikidata query endpoint shouldn't return traceback when an error is encountered

2019-02-21 Thread Smalyshev
Smalyshev closed this task as a duplicate of T216701: Wikidata Query Service should have a proper high level error handler. TASK DETAIL https://phabricator.wikimedia.org/T115788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: abian

[Wikidata-bugs] [Maniphest] [Updated] T216701: Wikidata Query Service should have a proper high level error handler

2019-02-21 Thread Smalyshev
Smalyshev added a comment. While full stack trace is not always useful, at least exception details often are the only thing that allows to figure out what actually happened. I know there are logs, but they are quite hard to link to a specific user's action, so user capturing the output

[Wikidata-bugs] [Maniphest] [Commented On] T216662: WikibaseLexeme ApiUserBlockedTest is broken

2019-02-21 Thread Smalyshev
Smalyshev added a comment. > I thought Lexeme was now in gate? How did the core change land? I have no idea... Something seems to be wrong there. There was also a case recently where Lexeme had wrong class name and it wasn't detected. I think some CI config steps are miss

[Wikidata-bugs] [Maniphest] [Closed] T202764: Wikidata produces a lot of failed requests for recentchanges API

2019-02-20 Thread Smalyshev
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment. Doesn't seem to happen anymore, so closing it.TASK DETAILhttps://phabricator.wikimedia.org/T202764EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: S

[Wikidata-bugs] [Maniphest] [Triaged] T189513: WDQS cache returns invalid JSON

2019-02-20 Thread Smalyshev
Smalyshev triaged this task as "Low" priority. TASK DETAILhttps://phabricator.wikimedia.org/T189513EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Lucas_Werkmeister_WMDE, Fnielsen, Aklapper, ET4Eva, Nandana, Lahi, Gq86, Dar

[Wikidata-bugs] [Maniphest] [Updated] T215623: Problem with docker-compose2 (behind proxy)

2019-02-20 Thread Smalyshev
Smalyshev added a project: Wikibase-Containers. TASK DETAILhttps://phabricator.wikimedia.org/T215623EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Addshore, Aklapper, DD063520, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic

[Wikidata-bugs] [Maniphest] [Updated] T214032: query service should send a retry-after header with a 429 response

2019-02-20 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T214032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Smalyshev, Aklapper, Addshore, CucyNoiD

[Wikidata-bugs] [Maniphest] [Updated] T214032: query service should send a retry-after header with a 429 response

2019-02-20 Thread Smalyshev
Smalyshev removed projects: MW-1.33-notes (1.33.0-wmf.14; 2019-01-22), Patch-For-Review.Smalyshev added a comment. I tried with https://query.wikidata.org/sparql?throttleMe=1=SELECT%20*%20WHERE%20%7B%20?x%20?y%20?z%20%7D%20LIMIT%2010 which always produces 429, and indeed I do not see Retry-After

[Wikidata-bugs] [Maniphest] [Updated] T211007: Dates returned by SPARQL queries are syntactically incorrect (lacks one leading zero for a negative four-digit year)

2019-02-20 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T211007EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Richard-Degenne, CucyNoiD

[Wikidata-bugs] [Maniphest] [Created] T216662: WikibaseLexeme ApiUserBlockedTest is broken

2019-02-20 Thread Smalyshev
Smalyshev created this task.Smalyshev added a project: Lexicographical data.Restricted Application added a project: Wikidata. TASK DESCRIPTIONApiUserBlockedTest expects error messages like 'blockedtext', 'no-permission' to be produced on block. However, in ApiBase, addBlockInfoToStatus() replaces

[Wikidata-bugs] [Maniphest] [Triaged] T216662: WikibaseLexeme ApiUserBlockedTest is broken

2019-02-20 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAILhttps://phabricator.wikimedia.org/T216662EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplore

[Wikidata-bugs] [Maniphest] [Commented On] T210044: Data corruption when loading RDF data into WDQS

2019-02-20 Thread Smalyshev
Smalyshev added a comment. It almost sounds like rather than having a live stream of edit events, or at least acting entirely on a live stream of edit events, the updater should instead do internal batching I thought about it, the problem here is that the starting point can be anything, so

[Wikidata-bugs] [Maniphest] [Updated] T212550: Implement support for ChronologyProtection in RDF export

2019-02-20 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T212550EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, aaron, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden

[Wikidata-bugs] [Maniphest] [Commented On] T215684: Deploy & test WikibaseCirrusSearch on beta cluster

2019-02-20 Thread Smalyshev
Smalyshev added a comment. The repository seems to be checked out properly in 1.33.0-wmf.18 (not enabled, so nothing interesting actually is happening yet).TASK DETAILhttps://phabricator.wikimedia.org/T215684EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T216601: Allow download of Wikidata query results in GPS-friendly format(s)

2019-02-20 Thread Smalyshev
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service. TASK DETAILhttps://phabricator.wikimedia.org/T216601EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Salgo60, Pigsonthewing, Aklapper, Ferenczy, sarhan.alaa

[Wikidata-bugs] [Maniphest] [Closed] T215980: Move LDFServer fork repo to gerrit

2019-02-19 Thread Smalyshev
Smalyshev closed this task as "Resolved".Smalyshev added a comment. Moved to wikidata/query/LDFServer gerrit repo: https://gerrit.wikimedia.org/r/admin/projects/wikidata/query/LDFServerTASK DETAILhttps://phabricator.wikimedia.org/T215980EMAIL PREFERENCEShttps://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] [Created] T216587: Unable to push third-party changes to gerrit repo

2019-02-19 Thread Smalyshev
Smalyshev created this task.Smalyshev triaged this task as "Normal" priority.Smalyshev added projects: Wikidata-Query-Service, Wikidata, User-Smalyshev, Gerrit, Release-Engineering-Team. TASK DESCRIPTIONI have a repository which is a fork of third-party repo with some WMF-relat

[Wikidata-bugs] [Maniphest] [Unassigned] T216587: Unable to push third-party changes to gerrit repo

2019-02-19 Thread Smalyshev
Smalyshev removed Smalyshev as the assignee of this task. TASK DETAILhttps://phabricator.wikimedia.org/T216587EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, NebulousIris, A.S.Kochergin, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T215980: Move LDFServer fork repo to gerrit

2019-02-19 Thread Smalyshev
Smalyshev updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONWe're using slightly modified [[ https://www.mediawiki.org/wiki/Wikidata_Query_Service/Implementation#Rebuilding_LDFServer | version of LDF Server ]] for Blazegraph in WDQS. Right now it is hosted in private

[Wikidata-bugs] [Maniphest] [Closed] T215751: Make vagrant support WikibaseCirrusSearch

2019-02-19 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T215751EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, ET4Eva, CucyNoiD, Nandana, NebulousIris, Gaboe420

[Wikidata-bugs] [Maniphest] [Unblock] T190022: Separate the CirrusSearch/Elastic-specific code from Wikibase code base

2019-02-19 Thread Smalyshev
Smalyshev closed subtask T215751: Make vagrant support WikibaseCirrusSearch as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T190022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Jony, Lucas_Werkmeister_WMDE, gerritbot

[Wikidata-bugs] [Maniphest] [Commented On] T210044: Data corruption when loading RDF data into WDQS

2019-02-19 Thread Smalyshev
Smalyshev added a comment. It might make sense to remove this and instead pass in either the oldid or revision param No, this has horrible performance impact if several edits happen in a row, since it only fetches the oldid, not the latest one, so instead of one update with the latest ID you get

[Wikidata-bugs] [Maniphest] [Updated] T215980: Move LDFServer fork repo to gerrit

2019-02-18 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T215980EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune

[Wikidata-bugs] [Maniphest] [Commented On] T210044: Data corruption when loading RDF data into WDQS

2019-02-18 Thread Smalyshev
Smalyshev added a comment. @Floatingpurr I have fixed some problematic data but still didn't find the root cause yet. Do you have some specific issues you think are related to this?TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T215967: Add keyword for filtering based on captions in specific language

2019-02-18 Thread Smalyshev
Smalyshev added a comment. But here since we have multiple languages I feel that one may ask for a word in two different languages and prefer having a OR between the two Yes, this is possible, but I wonder how frequent it would be that somebody needs a label in Russian or Portuguese? I can invent

[Wikidata-bugs] [Maniphest] [Commented On] T215967: Add keyword for filtering based on captions in specific language

2019-02-17 Thread Smalyshev
Smalyshev added a comment. I have a feeling we're overdesigning it a little. I think it should be simple and cover 80% of cases, and if you need more complex things you'd probably be better with using generic boolean syntax like OR/AND. inlabel:foo@en may be ok, though obviously we'd have trouble

[Wikidata-bugs] [Maniphest] [Commented On] T215967: Add keyword for filtering based on captions in specific language

2019-02-14 Thread Smalyshev
Smalyshev added a comment. I like the structure of the syntax but would probably bikeshed the exact delimiters a bit if possible (later). Also, are we following fallback chains or only seeking exact language match? If we match exactly we may want to also think about allowing fallbacks. inlabel

[Wikidata-bugs] [Maniphest] [Updated] T215967: Add keyword for filtering based on captions in specific language

2019-02-14 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T215967EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardson, SmalyshevCc: Smalyshev, dcausse, Nuria, Abit, Cparle, Ramsey-WMF, Aklapper, JKSTNK, Lahi, PDrouin-WMF

[Wikidata-bugs] [Maniphest] [Updated] T190022: Separate the CirrusSearch/Elastic-specific code from Wikibase code base

2019-02-14 Thread Smalyshev
Smalyshev removed a project: MW-1.33-notes (1.33.0-wmf.17; 2019-02-12). TASK DETAILhttps://phabricator.wikimedia.org/T190022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lucas_Werkmeister_WMDE, gerritbot, Addshore, Aleksey_WMDE, thiemowmde

[Wikidata-bugs] [Maniphest] [Changed Project Column] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-02-14 Thread Smalyshev
Smalyshev moved this task from needs triage to Current work on the Discovery-Search board.Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAILhttps://phabricator.wikimedia.org/T216206WORKBOARDhttps://phabricator.wikimedia.org/project/board/1849

[Wikidata-bugs] [Maniphest] [Created] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-02-14 Thread Smalyshev
Smalyshev created this task.Smalyshev triaged this task as "Normal" priority.Smalyshev added projects: Wikidata, User-Smalyshev, Discovery, CirrusSearch, Discovery-Search (Current work).Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current w

[Wikidata-bugs] [Maniphest] [Commented On] T213318: Wikibase Front-End Architecture

2019-02-14 Thread Smalyshev
Smalyshev added a comment. Another thought about docker and similar technologies. PHP applications - and Mediawiki in particular - can be used on stacks way beyond Linux. I've seen PHP run on HP-UX, AIX, in mainframe containers, other weird setups. As long as our base requirement remains more

[Wikidata-bugs] [Maniphest] [Commented On] T213318: Wikibase Front-End Architecture

2019-02-14 Thread Smalyshev
Smalyshev added a comment. Are our target demographics (and the reason why we are targeting them) documented somewhere? I am of course speaking out of my personal experience with (some) people running small wikis (including myself many years ago). It may be we're not targeting them or caring

[Wikidata-bugs] [Maniphest] [Commented On] T213318: Wikibase Front-End Architecture

2019-02-14 Thread Smalyshev
Smalyshev added a comment. I am not sure what requirement you refer to, to be made explicit. Well, I now realize I am actually looking at two requirements: Being able to run Mediawiki with basic functionality (reasonably defined by us) on a common LAMP stack, without root access. Does Wikibase

[Wikidata-bugs] [Maniphest] [Commented On] T213318: Wikibase Front-End Architecture

2019-02-14 Thread Smalyshev
Smalyshev added a comment. Another solution to this problem would be to require Docker and Kuberneties which are both free and trivial to setup I am not sure setting up and maintaining a set of Docker containers would be "trivial" for a person we're talking about. It's not targeting

[Wikidata-bugs] [Maniphest] [Commented On] T216160: Update wikidata-entities dump generation to fixed day-of-month instead of fixed weekday

2019-02-14 Thread Smalyshev
Smalyshev added a comment. I don't have a real opinion on this one. Generally for dump users the only concern is for the dump to be recent enough to be useful (wikidata is rather volatile, and linked nature of it means that volatility in one area can influence results in bigger area). That said, I

<    3   4   5   6   7   8   9   10   11   12   >