[Wikidata-bugs] [Maniphest] [Commented On] T200612: Wikidata's SPARQL endpoint doesn't escape commas in IRIs in CSV output

2019-04-08 Thread Smalyshev
Smalyshev added a comment. This seems to be a change in Sesame - before, LiteralImpl(String) produced null as datatype, now it produces `XMLSchema.STRING`. It was changed in this commit: https://bitbucket.org/openrdf/sesame/commits/675015e6b996cc8609fa735730baa49edf27d2e7 TASK DETAIL

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T200612: Wikidata's SPARQL endpoint doesn't escape commas in IRIs in CSV output

2019-04-08 Thread Smalyshev
Smalyshev added a subscriber: Igorkim78. Smalyshev added a comment. Getting this in the CI run <https://integration.wikimedia.org/ci/job/wikidata-query-blazegraph-maven-java8-docker/9/console>: 8:59:10 SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".

[Wikidata-bugs] [Maniphest] [Created] T220437: Allow force-push for wikidata-query on wikidata/query/blazegraph

2019-04-08 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Gerrit-Privilege-Requests. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION wikidata/query/blazegraph repo is our private fork of Blazegraph

[Wikidata-bugs] [Maniphest] [Edited] T220046: Set up developer account for Igor Kim

2019-04-04 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Nuria, Smalyshev, Igorkim78, alaa_wmde, ET4Eva, Nandana, Jony, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T218716: Remove Elastic/Cirrus code from Wikibase repo

2019-04-04 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T218716 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, thiemowmde, Aleksey_WMDE, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev added a comment. @Aklapper also, could you do the necessary magic to make Igor's phabricator account approved? TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper

[Wikidata-bugs] [Maniphest] [Triaged] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Nuria, Smalyshev, Igorkim78, alaa_wmde, ET4Eva, Nandana, Jony,

[Wikidata-bugs] [Maniphest] [Commented On] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev added a comment. @Aklapper: I see there that: > Admins can create an account while specifying the password, then mail it to the user who can log in with that and use the password change form Can it be done in this case? TASK DETAIL https://phabricator.wikimedia.

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-04-03 Thread Smalyshev
Smalyshev added a comment. I've also made a counter to check how many "forward skips" - i.e. loading revision further than we've asked in change - we get. The averages are between 0.1 and 0.5, sometimes going to 1 - i.e. we're saving up to one item fetch/update per second, or s

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-04-03 Thread Smalyshev
Smalyshev added a subscriber: Lucas_Werkmeister_WMDE. Smalyshev added a comment. Looks like we have problem with redirects - they can not be fetched by-revision. E.g.: https://www.wikidata.org/wiki/Special:EntityData/Q33044800.ttl?flavor=dump=901802292 produces 400. Since @Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T219749: WDQS GUI test broken after merging 2144a682d48168555368d8aa5df1bd9dfa369fb2

2019-04-03 Thread Smalyshev
Smalyshev added a comment. GUI is still not mergeable, so I think I'll disable running wdio test on CI for now. TASK DETAIL https://phabricator.wikimedia.org/T219749 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc

[Wikidata-bugs] [Maniphest] [Edited] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Nuria, Smalyshev, Igorkim78, alaa_wmde, ET4Eva, Nandana, Jony, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev added a project: LDAP-Access-Requests. TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Nuria, Smalyshev, Igorkim78, alaa_wmde, ET4Eva, Nandana, Jony, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Created] T220046: Set up developer account for Igor Kim

2019-04-03 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Discovery. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Since we're starting to work with @Igorkim78 we need to set up developer access

[Wikidata-bugs] [Maniphest] [Updated] T112715: Enable different URL shorteners for WDQS

2019-04-03 Thread Smalyshev
Smalyshev added a subtask: T219968: Enable the URLshortener for WDQS. TASK DETAIL https://phabricator.wikimedia.org/T112715 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Pigsonthewing, Lucas_Werkmeister_WMDE, Ladsgroup

[Wikidata-bugs] [Maniphest] [Triaged] T219968: Enable the URLshortener for WDQS

2019-04-03 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T219968 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: B20180, Pigsonthewing, Smalyshev, Aklapper, Ladsgroup, Lydia

[Wikidata-bugs] [Maniphest] [Updated] T219968: Enable the URLshortener for WDQS

2019-04-03 Thread Smalyshev
Smalyshev added a parent task: T112715: Enable different URL shorteners for WDQS. TASK DETAIL https://phabricator.wikimedia.org/T219968 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: B20180, Pigsonthewing, Smalyshev, Aklapper

[Wikidata-bugs] [Maniphest] [Updated] T219749: WDQS GUI test broken after merging 2144a682d48168555368d8aa5df1bd9dfa369fb2

2019-04-02 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T219749 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Greta_Doci_WMDE, Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

2019-04-02 Thread Smalyshev
Smalyshev added a comment. It's a 4 year old task, so I myself is not 100% clear which one it was back then. So I think having it here is fine. TASK DETAIL https://phabricator.wikimedia.org/T87283 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

2019-04-02 Thread Smalyshev
Smalyshev added a comment. OK it seems to be a bit unclear whether this was asking for revision IDs on particular entity or on the dump as a whole. I think that we need both, but the patch above seems to add the revision ID to entities. I think it makes sense. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

2019-04-02 Thread Smalyshev
Smalyshev added a comment. I think, if I can recall correctly (this is 4+ years old by now :) that the idea was to have means to quickly identify that one dump is more recent than the other one, or less recent, and where in the sequence of dumps the particular dump falls. Individual

[Wikidata-bugs] [Maniphest] [Triaged] T219749: WDQS GUI test broken after merging 2144a682d48168555368d8aa5df1bd9dfa369fb2

2019-04-02 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T219749 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Greta_Doci_WMDE, Aklapper, Smalyshev, alaa_wmde,

[Wikidata-bugs] [Maniphest] [Changed Project Column] T218716: Remove Elastic/Cirrus code from Wikibase repo

2019-04-02 Thread Smalyshev
Smalyshev moved this task from Wikidata Search to Current work on the Discovery-Search board. Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T218716 WORKBOARD https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] [Commented On] T219749: WDQS GUI test broken after merging 2144a682d48168555368d8aa5df1bd9dfa369fb2

2019-04-01 Thread Smalyshev
Smalyshev added a comment. Now I get this: 17:42:14 [INFO] Selenium started 17:42:14 [ERROR] 17:42:14.826 INFO [ActiveSessionFactory.apply] - Capabilities are: { 17:42:14 [ERROR] "browserName": "firefox", 17:42:14 [ERROR] "handlesAlerts&qu

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-04-01 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Created] T219749: WDQS GUI test broken after merging 2144a682d48168555368d8aa5df1bd9dfa369fb2

2019-04-01 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata Query UI. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION After merging 2144a682d48168555368d8aa5df1bd9dfa369fb2 <https://phabricator.wikimedia.

[Wikidata-bugs] [Maniphest] [Updated] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-28 Thread Smalyshev
Smalyshev removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-28 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-28 Thread Smalyshev
Smalyshev added a comment. @Addshore btw do I understand right that constraints can not be fetched per-revision? In this case, do we still need cache-busting there? Or constrains manage their caches? I am not sure what to do here. TASK DETAIL https://phabricator.wikimedia.org/T217897

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-28 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-28 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-28 Thread Smalyshev
Smalyshev added a comment. > WDQS does know what the latest version of the entity that it is trying to get updates for is, But "last version that WDQS knows of" can be very different from "last version that Wikidata has". That's the whole issue. I had an idea

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-28 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T219452: Cannot add a Wikidata sitelink [2019-03-27]

2019-03-27 Thread Smalyshev
Smalyshev added a comment. I don't think I did any changes to Wikidata related to sitelinks in any way... Could be wrong of course but nothing comes to mind. TASK DETAIL https://phabricator.wikimedia.org/T219452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Updated] T219455: AdvancedSearch extension changes behaviour of default namespaces to be search for anon and logged in users

2019-03-27 Thread Smalyshev
Smalyshev changed the subtype of this task from "Task" to "Bug Report". TASK DETAIL https://phabricator.wikimedia.org/T219455 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: IKhitron, EBernhardson, dcausse,

[Wikidata-bugs] [Maniphest] [Created] T219477: Automatic detection of distributed bots

2019-03-27 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION We've had a number of times where bots evaded throttling mechanisms of WDQS by using either

[Wikidata-bugs] [Maniphest] [Edited] T219455: wikidata.org search uses tons of namespaces by default

2019-03-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T219455 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBernhardson, dcausse, Aklapper, Smalyshev, alaa_wmde, CucyNoiD, Nandana, NebulousIris

[Wikidata-bugs] [Maniphest] [Edited] T219455: wikidata.org search uses tons of namespaces by default

2019-03-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T219455 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBernhardson, dcausse, Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic

[Wikidata-bugs] [Maniphest] [Updated] T219455: wikidata.org search uses tons of namespaces by default

2019-03-27 Thread Smalyshev
Smalyshev added a project: Advanced-Search. Restricted Application added a project: TCB-Team. TASK DETAIL https://phabricator.wikimedia.org/T219455 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: EBernhardson, dcausse, Aklapper

[Wikidata-bugs] [Maniphest] [Created] T219455: wikidata.org search uses tons of namespaces by default

2019-03-27 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION If I open wikidata.org with clean environment and go to Special:Search and search, I get lots of namespaces searched

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-27 Thread Smalyshev
Smalyshev added a comment. > the cache we are talking about there would be unnecessary if the wdqs just hit varnish. It is problematic for WDQS to "just hit varnish", because varnish does not know if certain revision is the latest one available or not. Wikidata on the ot

[Wikidata-bugs] [Maniphest] [Updated] T190022: Separate the CirrusSearch/Elastic-specific code from Wikibase code base

2019-03-27 Thread Smalyshev
Smalyshev removed projects: MW-1.33-notes (1.33.0-wmf.22; 2019-03-19), Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T190022 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jony, Lucas_Werkmeister_WMDE, gerritbot

[Wikidata-bugs] [Maniphest] [Updated] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-27 Thread Smalyshev
Smalyshev removed a project: MW-1.33-notes (1.33.0-wmf.22; 2019-03-19). Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-27 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Jdforrester-WMF, gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Closed] T218174: Add metric for skip-ahead revisions

2019-03-27 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Metric name is `wdqs_updater_updates_skip`. TASK DETAIL https://phabricator.wikimedia.org/T218174 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-26 Thread Smalyshev
Smalyshev added a comment. Looking at the distribution of Special:EntityData fetches, if we cache entities under 10K, we will capture about 90% of them. Most frequent sizes are 1 to 4K. So caching probably worth trying. TASK DETAIL https://phabricator.wikimedia.org/T217897 EMAIL

[Wikidata-bugs] [Maniphest] [Closed] T197598: MWAPI query with LIMIT ignores MINUS

2019-03-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T197598 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Daniel_Mietchen,

[Wikidata-bugs] [Maniphest] [Closed] T217896: Make the user agent configurable for Wikidata Query Service Updater

2019-03-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T217896 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Smalyshev, Base, Aklapper, Gehel, alaa_wmde, Legado_Shulgin, CucyNoi

[Wikidata-bugs] [Maniphest] [Closed] T218457: Move category dump files to /srv/wdqs/data

2019-03-26 Thread Smalyshev
Smalyshev closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T218457 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Smalyshev, alaa_wmde, CucyNoiD, Nandana, NebulousIris,

[Wikidata-bugs] [Maniphest] [Commented On] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-25 Thread Smalyshev
Smalyshev added a comment. > I'm still a bit confused about this logic inside the updater, especially with this id validation checking if we have the revision already etc? Not sure what you mean "already". You can have revision ID in the change, and revision ID in Wiki

[Wikidata-bugs] [Maniphest] [Closed] T219052: Blazegraph and updater failed on wdqs1009

2019-03-23 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Sorry, my fault - I checked broken commit into deploy repo, and wdq9 deploys automatically from it. So everything worked as intended - wdq9 detected my fat fingers, and I fixed the r

[Wikidata-bugs] [Maniphest] [Commented On] T218954: Default to article search on commons + wikibase (aka SDC)

2019-03-22 Thread Smalyshev
Smalyshev added a comment. Not sure you need duplicate to Wikibase as everything in production is supposed to run on WikibaseCirrusSearch now, and Wikibase hooks are planned to be removed soon (for varying definitions of soon depending on how Lexeme deployment is progressing). Wouldn't hurt

[Wikidata-bugs] [Maniphest] [Commented On] T218954: Default to article search on commons + wikibase (aka SDC)

2019-03-21 Thread Smalyshev
Smalyshev added a comment. TLDR of the above: if we want to disable entity fulltext searching, we need to add variable that shuts off `onCirrusSearchFulltextQueryBuilderComplete` hook. TASK DETAIL https://phabricator.wikimedia.org/T218954 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-20 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-20 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Claimed] T218714: Move WikibaseMediaInfo dependencies to WikibaseCirrusSearch

2019-03-20 Thread Smalyshev
Smalyshev claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T218714 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, Addshore, Smalyshev, alaa_wmde, CucyNoiD

[Wikidata-bugs] [Maniphest] [Updated] T218715: Deploy WikibaseCirrusSearch in production and run all searches through it

2019-03-20 Thread Smalyshev
Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T218715 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek

[Wikidata-bugs] [Maniphest] [Closed] T218746: Release WDQS stable version

2019-03-20 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. 0.3.1 released. TASK DETAIL https://phabricator.wikimedia.org/T218746 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel

[Wikidata-bugs] [Maniphest] [Closed] T209198: WDQS tests produce a lot of junk logging

2019-03-20 Thread Smalyshev
Smalyshev closed this task as "Resolved". Smalyshev claimed this task. Smalyshev added a comment. Fixed now. TASK DETAIL https://phabricator.wikimedia.org/T209198 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel

[Wikidata-bugs] [Maniphest] [Updated] T218714: Move WikibaseMediaInfo dependencies to WikibaseCirrusSearch

2019-03-20 Thread Smalyshev
Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery. TASK DETAIL https://phabricator.wikimedia.org/T218714 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty

[Wikidata-bugs] [Maniphest] [Triaged] T217925: Keep global "last seen revision" map for Updater

2019-03-20 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T217925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Sm

[Wikidata-bugs] [Maniphest] [Triaged] T218746: Release WDQS stable version

2019-03-20 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T218746 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Gehel

[Wikidata-bugs] [Maniphest] [Updated] T218714: Move WikibaseMediaInfo dependencies to WikibaseCirrusSearch

2019-03-19 Thread Smalyshev
Smalyshev removed a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T218714 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, Addshore, Smalyshev

[Wikidata-bugs] [Maniphest] [Updated] T197598: MWAPI query with LIMIT ignores MINUS

2019-03-19 Thread Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T197598 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Commented On] T217557: Socket timeout on wdqs.svc.eqiad.wmnet

2019-03-19 Thread Smalyshev
Smalyshev added a comment. Not sure what is to be done for this task. Do we want to investigate what caused it (i.e. which queries, why socket timeout happened - was it OOM, CPU exhaustion, too many threads, etc)? I think it needs to be clearer what is the actionable part of this task

[Wikidata-bugs] [Maniphest] [Triaged] T218522: SPARQL incorrectly changes URI's from http to https

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T218522 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Base, Aklapper, Lydia_Pintscher, Smalyshev, Multichill, alaa_wmde, Nand

[Wikidata-bugs] [Maniphest] [Triaged] T218457: Move category dump files to /srv/wdqs/data

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T218457 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, Lucas_Werkme

[Wikidata-bugs] [Maniphest] [Changed Status] T199228: Define an SLO for Wikidata Query Service public endpoint and communicate it

2019-03-19 Thread Smalyshev
Smalyshev changed the task status from "Open" to "Stalled". TASK DETAIL https://phabricator.wikimedia.org/T199228 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Smalyshev Cc: Alexsdutton, WMDE-leszek, Multichill, a

[Wikidata-bugs] [Maniphest] [Triaged] T218174: Add metric for skip-ahead revisions

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAIL https://phabricator.wikimedia.org/T218174 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Addsh

[Wikidata-bugs] [Maniphest] [Created] T218746: Release WDQS stable version

2019-03-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION We have quite a lot of developments in WDQS since last release of 0.3.0. It is time to make

[Wikidata-bugs] [Maniphest] [Updated] T218568: Allow CORS from query.wikidata.org to production wikis

2019-03-19 Thread Smalyshev
Smalyshev added a comment. Moving from email here: > Does the Query Service needs to, in any way, act on the UrlShortener API as the user who is currently logged-in? Trusted or not, that Well, that was kinda my question from the start. Right now, WDQS UI does not know anyth

[Wikidata-bugs] [Maniphest] [Lowered Priority] T213210: WDQS is hitting allocator limit on Blazegraph

2019-03-19 Thread Smalyshev
Smalyshev lowered the priority of this task from "High" to "Normal". TASK DETAIL https://phabricator.wikimedia.org/T213210 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Stashbot, Gehel, Aklapper, Smalyshev, alaa

[Wikidata-bugs] [Maniphest] [Triaged] T218716: Remove Elastic/Cirrus code from Wikibase repo

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T218716 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, thiemowmde, Al

[Wikidata-bugs] [Maniphest] [Created] T218716: Remove Elastic/Cirrus code from Wikibase repo

2019-03-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, User-Smalyshev, Discovery, CirrusSearch, Discovery-Search (Current work). Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). TASK DESCRIPTION Once the migration

[Wikidata-bugs] [Maniphest] [Triaged] T218715: Deploy WikibaseCirrusSearch in production and run all searches through it

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T218715 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, thiemowmde, Al

[Wikidata-bugs] [Maniphest] [Created] T218715: Deploy WikibaseCirrusSearch in production and run all searches through it

2019-03-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, User-Smalyshev, Discovery, CirrusSearch, Discovery-Search (Current work). Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). TASK DESCRIPTION Making this a separate subtask

[Wikidata-bugs] [Maniphest] [Triaged] T218714: Move WikibaseMediaInfo dependencies to WikibaseCirrusSearch

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T218714 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Lydia_Pintscher, WMDE-leszek, RazShuty, Addshore, Smalyshev,

[Wikidata-bugs] [Maniphest] [Created] T218714: Move WikibaseMediaInfo dependencies to WikibaseCirrusSearch

2019-03-19 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata, User-Smalyshev, Discovery, Discovery-Search (Current work), WikibaseMediaInfo. TASK DESCRIPTION WikibaseMediaInfo currently depends on classed (and maybe configs) from Wikibase namespace Wikibase\Repo\Search\Elastic to work

[Wikidata-bugs] [Maniphest] [Commented On] T218683: extract throttling filter form wdqs so that it can be reused in other projects

2019-03-19 Thread Smalyshev
Smalyshev added a comment. Can't see T218636 but I assume it has to do with recent Gerrit vandalism incident. TASK DETAIL https://phabricator.wikimedia.org/T218683 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: mmodell, Smalyshev

[Wikidata-bugs] [Maniphest] [Triaged] T218683: extract throttling filter form wdqs so that it can be reused in other projects

2019-03-19 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority. Smalyshev added a comment. I am a little surprised such generic library doesn't exist already - as throttling is pretty common thing people do - but if other projects can benefit from our code, by all means we should set it up as

[Wikidata-bugs] [Maniphest] [Commented On] T218456: mwselenium-quibble-docker test broken for WikibaseLexeme

2019-03-18 Thread Smalyshev
Smalyshev added a comment. Setting `Depends-On: I9bbea3d13460ed44755d77fc61ff23fb906cf71e` seems to cure all my failing patches. TASK DETAIL https://phabricator.wikimedia.org/T218456 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc

[Wikidata-bugs] [Maniphest] [Commented On] T218456: mwselenium-quibble-docker test broken for WikibaseLexeme

2019-03-18 Thread Smalyshev
Smalyshev added a comment. @Addshore the problem still happens: https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/10074/console TASK DETAIL https://phabricator.wikimedia.org/T218456 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T218456: mwselenium-quibble-docker test broken for WikibaseLexeme

2019-03-18 Thread Smalyshev
Smalyshev added a subscriber: EBernhardson. Smalyshev added a comment. @EBernhardson do you have any ideas about the failing job <https://phabricator.wikimedia.org/T218456#5033387> above? TASK DETAIL https://phabricator.wikimedia.org/T218456 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Commented On] T112715: Enable different URL shorteners for WDQS

2019-03-17 Thread Smalyshev
Smalyshev added a comment. I wonder does UrlShortener require login? If yes, we'd have to add OAuth setup to WDQS GUI I presume for this URL shortener - which means, the code needs to become way smarter with regard to how URL shorteners work, because some may require login and some

[Wikidata-bugs] [Maniphest] [Updated] T217925: Keep global "last seen revision" map for Updater

2019-03-17 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T217925 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lucas_Werkmeister_WMDE, Gehel, Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T218457: Move category dump files to /srv/wdqs/data

2019-03-17 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T218457 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Updated] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-17 Thread Smalyshev
Smalyshev added a project: User-Smalyshev. TASK DETAIL https://phabricator.wikimedia.org/T217897 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Addshore, Smalyshev, BBlack, Aklapper, Gehel, alaa_wmde, Legado_Shulgin, Nandana, thifranc

[Wikidata-bugs] [Maniphest] [Updated] T158031: WDQS timeline output should be translatable

2019-03-16 Thread Smalyshev
Smalyshev added a project: Need-volunteer. TASK DETAIL https://phabricator.wikimedia.org/T158031 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Lydia_Pintscher, PokestarFan, Jonas, Aklapper, geraki, alaa_wmde, ET4Eva, Dinadineke

[Wikidata-bugs] [Maniphest] [Commented On] T218378: Flaky test Wikibase\Repo SetAliasesTest::testUserCannotSetAliasesWhenTheyLackPermission

2019-03-15 Thread Smalyshev
Smalyshev added a comment. Unfortunately, this seems to be not the only flaky test: https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/9974/console 02:26:18 Failing Scenarios: 02:26:18 cucumber features/reference.feature:123 # Scenario: Add reference

[Wikidata-bugs] [Maniphest] [Created] T218457: Move category dump files to /srv/wdqs/data

2019-03-15 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION Right now category update scripts put category dumps

[Wikidata-bugs] [Maniphest] [Triaged] T218456: mwselenium-quibble-docker test broken for WikibaseLexeme

2019-03-15 Thread Smalyshev
Smalyshev triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T218456 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Pablo-WMDE, Lucas_Werkmeister_WMDE, Addshore, Smalyshev, alaa_wmde

[Wikidata-bugs] [Maniphest] [Created] T218456: mwselenium-quibble-docker test broken for WikibaseLexeme

2019-03-15 Thread Smalyshev
Smalyshev created this task. Smalyshev added projects: Lexicographical data, Wikidata. TASK DESCRIPTION See for example: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseLexeme/+/496994 and https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/9960

[Wikidata-bugs] [Maniphest] [Updated] T217897: Reduce / remove the aggessive cache busting behaviour of wdqs-updater

2019-03-15 Thread Smalyshev
Smalyshev added a comment. > After talking with Stas this apparently makes updating within the updater harder etc as it might result in more writes to sparql? ( Yes because it would have to do SPARQL Update for each individual revision. > I guess the wdqs internal machines

[Wikidata-bugs] [Maniphest] [Commented On] T218306: Creating tinyurl of huge query fills up RAM

2019-03-14 Thread Smalyshev
Smalyshev added a comment. In chrome, it doesn't OOM but also doesn't produce tiny URL, instead producing a string of console errors. TASK DETAIL https://phabricator.wikimedia.org/T218306 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T218306: Creating tinyurl of huge query fills up RAM

2019-03-14 Thread Smalyshev
Smalyshev added a comment. Generally we don't do anything special there with URLs, and this query, while being a healthy 276K (wow) still should be comfortably fitting in memory... I wonder if some browser URL handling routine there doesn't like huge URLs. TASK DETAIL https

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-14 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Edited] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-14 Thread Smalyshev
Smalyshev updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Updated] T216206: Set up WikibaseLexemeCirrusSearch extension for Elastic code in WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added a project: Lexicographical data. TASK DETAIL https://phabricator.wikimedia.org/T216206 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: gerritbot, Aklapper, Lydia_Pintscher, WMDE-leszek, thiemowmde, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T206175: mediawiki-vagrant role for WikibaseLexeme

2019-03-13 Thread Smalyshev
Smalyshev added a comment. We may also want to have it provision some basic items like languages and lexical categories, so that creating new lexemes would actually be possible. TASK DETAIL https://phabricator.wikimedia.org/T206175 EMAIL PREFERENCES https://phabricator.wikimedia.org

<    2   3   4   5   6   7   8   9   10   11   >