[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-10-02 Thread gerritbot
gerritbot added a comment. Change 463517 merged by Ottomata: [operations/puppet@production] Add chelsyx to analytics-search-users group https://gerrit.wikimedia.org/r/463517TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-28 Thread gerritbot
gerritbot added a comment. Change 463517 had a related patch set uploaded (by Bearloga; owner: Bearloga): [operations/puppet@production] Add chelsyx to analytics-search-users group https://gerrit.wikimedia.org/r/463517TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-27 Thread gerritbot
gerritbot added a comment. Change 463361 merged by Bearloga: [wikimedia/discovery/golden@master] Make generated reports be owned by analytics-search-users group https://gerrit.wikimedia.org/r/463361TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-27 Thread gerritbot
gerritbot added a comment. Change 463361 had a related patch set uploaded (by Bearloga; owner: Bearloga): [wikimedia/discovery/golden@master] Make generated reports be owned by analytics-search-users group https://gerrit.wikimedia.org/r/463361TASK

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-25 Thread Addshore
Addshore added a comment. WMDE wants to pull some data from this dashboard for some internal reporting (data needed for september). Any ETA on the fix and backfill? :)TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Ottomata
Ottomata added a comment. Ok, I've added the analytics-search system user to the analytics-search-users group. You should make your script chgrp analytics-search-users after it creates it.TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread gerritbot
gerritbot added a comment. Change 462580 merged by Ottomata: [operations/puppet@production] Add analytics-search system user to analytics-search-users group https://gerrit.wikimedia.org/r/462580TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread gerritbot
gerritbot added a comment. Change 462580 had a related patch set uploaded (by Ottomata; owner: Ottomata): [operations/puppet@production] Add analytics-search system user to analytics-search-users group https://gerrit.wikimedia.org/r/462580TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Ottomata
Ottomata added a comment. Oh sorry, misunderstood. Yes we should be able to make the output of the file writable by you somehow.TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopov, OttomataCc: gerritbot,

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Ottomata
Ottomata added a comment. @mpopov, since that file is managed by Puppet, you'll have to make a puppet patch to change it!TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mpopov, OttomataCc: gerritbot, Gehel,

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread mpopov
mpopov added a comment. @Ottomata @Gehel: I tried editing stat1005:/srv/published-datasets/discovery/metrics/wdqs/basic_usage.tsv but couldn't because the file belongs to group analytics-search, not analytics-search-users which sort of makes sense because of how we have it configured right now in

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread gerritbot
gerritbot added a comment. Change 462577 merged by Bearloga: [wikimedia/discovery/golden@master] Change which partition WDQS requests are counted from https://gerrit.wikimedia.org/r/462577TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread gerritbot
gerritbot added a comment. Change 462577 had a related patch set uploaded (by Bearloga; owner: Bearloga): [wikimedia/discovery/golden@master] Change which partition WDQS requests are counted from https://gerrit.wikimedia.org/r/462577TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread mpopov
mpopov added a comment. In T204415#4611729, @Nuria wrote: Assigned to @mpopov Again, our apologies that the data sources are hardcoded like this. As I mentioned on our meeting abetter path to go forward would be using the tags for wdqs to identify the requests:

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Nuria
Nuria added a comment. Assigned to @mpopov Again, our apologies that the data sources are hardcoded like this. As I mentioned on our meeting abetter path to go forward would be using the tags for wdqs to identify the requests:

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Ottomata
Ottomata added a comment. all the Hive queries (and related) should be using 'webrequest_text' from now on. e.g. WHERE webrequest_source = 'text'TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Nuria,

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread elukey
elukey added a comment. Yep exactly, cache misc (where query.wikidata.org was hosted) has been migrated to cache text, therefore all the Hive queries (and related) should be using 'webrequest_text' from now on.TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-24 Thread Nuria
Nuria added a comment. Misc is no longer in service, all requests have been migrated to 'text'TASK DETAILhttps://phabricator.wikimedia.org/T204415EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NuriaCc: Nuria, mpopov, chelsyx, Aklapper, Addshore, Smalyshev,

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-17 Thread Smalyshev
Smalyshev added a comment. But since August 10th, the SPARQL usage number is very small (even 0 for certain days) That can not be, the actual usage is definitely not 0. I see a lot of accesses on turnilo.wikimedia.org and in kibana. See for example:

[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

2018-09-17 Thread chelsyx
chelsyx added a comment. Hi @Smalyshev , the dashboard is updating. But since August 10th, the SPARQL usage number is very small (even 0 for certain days) and the LDF usage number is 0. Did we change the URI of the endpoint? Query: sql SELECT year, month, day, IF(uri_path = '/sparql',