[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

fgiunchedi added a project: observability. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: fgiunchedi Cc: RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a comment. In T246004#6567338 <https://phabricator.wikimedia.org/T246004#6567338>, @Zbyszko wrote: > Thank you all for swift (pun intended) action! haha! the account is setup now, I've written the credentials in your home on `deploy1001` TASK DETAI

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a comment. In T246004#6560303 <https://phabricator.wikimedia.org/T246004#6560303>, @Ottomata wrote: > I don't know! @fgiunchedi how does one access the cluster? @elukey can check the network VLAN ACLs and update accordingly. The canonical url is https

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a comment. Ok, thank you for the information. It doesn't seem we have an isolated test environment anyways so even though I'm reluctant we'll have to test on the production swift cluster. A middle ground I suppose would be to create the accounts on the `thanos` swift

[Wikidata-bugs] [Maniphest] T265015: TypeError: $.widget is not a function -- User script error

fgiunchedi removed a project: Wikimedia-Logstash. fgiunchedi added a comment. Removing wikimedia-logstash since it doesn't seem to be a logstash-specific issue, please add back if that's not the case! TASK DETAIL https://phabricator.wikimedia.org/T265015 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T265035: Gadget Error: "Uncaught TypeError: $(...).css(...).draggable is not a function"

fgiunchedi removed a project: Wikimedia-Logstash. fgiunchedi added a comment. Removing wikimedia-logstash since it doesn't seem to be a logstash-specific issue, please add back if that's not the case! TASK DETAIL https://phabricator.wikimedia.org/T265035 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T265037: User Script error: "ReferenceError: wikibase is not defined"

fgiunchedi removed a project: Wikimedia-Logstash. fgiunchedi added a comment. Removing wikimedia-logstash since it doesn't seem to be a logstash-specific issue, please add back if that's not the case! TASK DETAIL https://phabricator.wikimedia.org/T265037 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T265022: Client (Gadget?) Error: "NS_ERROR_FILE_CORRUPTED: "

fgiunchedi removed a project: Wikimedia-Logstash. fgiunchedi added a comment. Removing `wikimedia-logstash` since it doesn't seem to be a logstash-specific issue, please add back if that's not the case! TASK DETAIL https://phabricator.wikimedia.org/T265022 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a comment. In T246004#6520077 <https://phabricator.wikimedia.org/T246004#6520077>, @Zbyszko wrote: > @fgiunchedi Currently, Flink pipeline resides on the Analytics Hadoop cluster. As for the question whether Flink creates it's containers - I think not, it did

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a comment. In T246004#6501106 <https://phabricator.wikimedia.org/T246004#6501106>, @Zbyszko wrote: > @fgiunchedi We estimate we'd need around 500GB of storage for the streaming updater (not accounting for replicas). Our use case is almost always write only (ch

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

fgiunchedi added a subscriber: JMeybohm. fgiunchedi added a comment. @Zbyszko re: docker and swift. @JMeybohm suggested using https://github.com/swiftstack/docker-swift (and possibly lowering auth token TTLs to make sure renewing expired tokens works as expected) re: monitoring, we have

[Wikidata-bugs] [Maniphest] [Updated] T238540: Delete grafana dashboard, https://grafana.wikimedia.org/d/000000599/wikibase-wb_terms-newitemidformatter

fgiunchedi edited projects, added Traffic, observability; removed Graphite. Restricted Application added a project: Operations. TASK DETAIL https://phabricator.wikimedia.org/T238540 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: fgiunchedi Cc

[Wikidata-bugs] [Maniphest] [Commented On] T238540: Delete grafana dashboard, https://grafana.wikimedia.org/d/000000599/wikibase-wb_terms-newitemidformatter

fgiunchedi added a comment. I can confirm that a DELETE of https://grafana.wikimedia.org/api/dashboards/uid/00599 results in a 403, further I don't see the request reaching grafana1001's apache logs. I'm adding #traffic <https://phabricator.wikimedia.org/tag/traffic/> since this

[Wikidata-bugs] [Maniphest] [Updated] T204364: Rate limit wdqs logs

fgiunchedi added a project: observability. TASK DETAIL https://phabricator.wikimedia.org/T204364 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, fgiunchedi Cc: gerritbot, Smalyshev, fgiunchedi, Gehel, Aklapper, Hook696, Daryl-TTMG

[Wikidata-bugs] [Maniphest] [Updated] T136852: Wikibase\Client\Changes\WikiPageUpdater logging is very verbose

fgiunchedi added a project: observability. TASK DETAIL https://phabricator.wikimedia.org/T136852 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808, fgiunchedi Cc: gerritbot, hoo, Addshore, Aklapper, bd808, Zppix, Hook696, Daryl-TTMG

[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash

fgiunchedi added a project: observability. TASK DETAIL https://phabricator.wikimedia.org/T178530 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: debt, fgiunchedi Cc: Stashbot, gerritbot, dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Hook696

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

fgiunchedi added a comment. In T221774#5155621 <https://phabricator.wikimedia.org/T221774#5155621>, @hoo wrote: > Possible way to do this: > > Create `PrometheusBlazegraphLagService` class which internally fetches the lag from a given Blazegraph instance li

[Wikidata-bugs] [Maniphest] [Edited] T187960: Rack/cable/configure asw2-a-eqiad switch stack

fgiunchedi updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T187960 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Cmjohnson, fgiunchedi Cc: akosiaris, Joe, fgiunchedi, hashar, Krinkle, ArielGlenn, jijiki, Addshore

[Wikidata-bugs] [Maniphest] [Commented On] T208215: Metrics from wdqs updater JMX should be prefixed

fgiunchedi added a comment. Any update?TASK DETAILhttps://phabricator.wikimedia.org/T208215EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: fgiunchediCc: fgiunchedi, Aklapper, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune

[Wikidata-bugs] [Maniphest] [Created] T208215: Metrics from wdqs updater JMX should be prefixed

fgiunchedi created this task.fgiunchedi added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONNoticed this while investigating something else, metrics exposed by jmx_exporter running on wdqs

[Wikidata-bugs] [Maniphest] [Commented On] T195121: Contribution from the IGN to Structured Data on Commons

fgiunchedi added a comment. In T195121#4529715, @aborrero wrote: In T195121#4527757, @fgiunchedi wrote: Sounds like a nice project! With my swift maintainer hat on, testing a single 200-300 GB chunk of data sounds good to me. Let's coordinate though before uploading the full data set because

[Wikidata-bugs] [Maniphest] [Updated] T195121: Contribution from the IGN to Structured Data on Commons

fgiunchedi added a comment. Sounds like a nice project! With my swift maintainer hat on, testing a single 200-300 GB chunk of data sounds good to me. Let's coordinate though before uploading the full data set because swift is pending its annual expansion (T201937) and I'd like to have

[Wikidata-bugs] [Maniphest] [Unblock] T195520: Multiple projects reporting Cannot access the database: No working replica DB server

fgiunchedi closed subtask T195530: status.wikimedia.org showing all lights green during major outage as "Invalid". TASK DETAILhttps://phabricator.wikimedia.org/T195520EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, fgiunchediCc

[Wikidata-bugs] [Maniphest] [Updated] T192768: wdqs-updater crashing not cleanly

fgiunchedi added a comment. No planned upgrades ATM, though a newer upstream version might help with understanding (hopefully fixing) T192456: Prometheus metrics missing for some hosts too, so definitely welcome!TASK DETAILhttps://phabricator.wikimedia.org/T192768EMAIL PREFERENCEShttps

[Wikidata-bugs] [Maniphest] [Triaged] T186815: Badges not displaying on trwiki

fgiunchedi triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T186815EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: fgiunchediCc: Superyetkin, Aklapper, Davinaclare77, Qtn1293, Lahi, Gq86, GoranSMilovanovic, Th3d3v

[Wikidata-bugs] [Maniphest] [Closed] T184434: prometheus-blazegraph-exporter failing to start after reboot

fgiunchedi closed this task as "Resolved".fgiunchedi claimed this task.fgiunchedi added a comment. Done, fix deployedTASK DETAILhttps://phabricator.wikimedia.org/T184434EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: fgiunchediCc: fgiunchedi,

[Wikidata-bugs] [Maniphest] [Updated] T147328: Add http://tools.wmflabs.org/grafana-json-datasource as a datasource to production grafana instance

fgiunchedi added a project: User-fgiunchedi.fgiunchedi added a comment. @Addshore yes! I'll try taking a look in the next couple of weeks I thinkTASK DETAILhttps://phabricator.wikimedia.org/T147328EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore

[Wikidata-bugs] [Maniphest] [Triaged] T160685: Increase $wgExpensiveParserFunctionLimit on nowiki

fgiunchedi triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T160685EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: fgiunchediCc: Lydia_Pintscher, Krinkle, Reedy, jeblad, Aklapper, Th3d3v1ls, Hfbn0, QZanden,

[Wikidata-bugs] [Maniphest] [Triaged] T150356: Wikidata Query Service is overly verbose toward logstash

fgiunchedi triaged this task as "Normal" priority. TASK DETAILhttps://phabricator.wikimedia.org/T150356EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: fgiunchediCc: Smalyshev, Gehel, Aklapper, EBjune, mschwarzer, Avner, Zppix, debt, D3r1ck01, Jonas

[Wikidata-bugs] [Maniphest] [Commented On] T147329: Add simple-json-datasource plugin to productrion grafana instance

fgiunchedi added a comment. Merged, though following up from IRC: we're keeping grafana labs/prod segregated in their datasources to avoid introducing more production/labs dependencies. It'd be nice if the tool ran somewhere in production. AFAICS it is stateless so that shouldn't be too hard

[Wikidata-bugs] [Maniphest] [Triaged] T133490: Wikidata Query Service REST endpoint returns truncated results

fgiunchedi triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T133490 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: fgiunchedi Cc: Bovlb, Aklapper, Mushroom, Avner, debt, Gehel, D3r1ck01, FloNight, Izn

[Wikidata-bugs] [Maniphest] [Commented On] T119579: Additional diskspace of wdqs1001/wdqs1002

fgiunchedi added a comment. drive-by comment: partman will likely to be adjusted too so we don't run into surprises when reprovisioning TASK DETAIL https://phabricator.wikimedia.org/T119579 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RobH

[Wikidata-bugs] [Maniphest] [Closed] T118850: Delete daily.wikidata.api.getclaims_property_use.* Graphite metrics

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi closed this task as "Resolved". fgiunchedi claimed this task. fgiunchedi added a comment. {{done}} TASK DETAIL https://phabricator.wikimedia.org/T118850 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] [Closed] T118836: Delete wikibase.dispatch.* metrics

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi closed this task as "Resolved". fgiunchedi claimed this task. fgiunchedi added a comment. {{done}} TASK DETAIL https://phabricator.wikimedia.org/T118836 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] [Triaged] T119579: Additional diskspace of wdqs1001/wdqs1002

fgiunchedi triaged this task as "Normal" priority. fgiunchedi added a subscriber: fgiunchedi. TASK DETAIL https://phabricator.wikimedia.org/T119579 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: fgiunchedi Cc: fgiunchedi, hoo, Akl

[Wikidata-bugs] [Maniphest] [Commented On] T117735: Track all Wikidata metrics currently gathered in Graphite rather than SQL and TSVs

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi added a comment. thanks for expanding on that, here's my (as the person who's been looking after our graphite stack) opinion: - graphite isn't really data warehouse, thus I wouldn't recommend it as the primary storage for the verbatim

[Wikidata-bugs] [Maniphest] [Commented On] T117732: Create a Graphite instance in the Analytics cluster

fgiunchedi added a comment. @addshore to clarify, more than functionality I was pointing out guarantees about the data stored. if the metrics are also being archived to hdfs for example so it is possible to dump/load into graphite then IMO that's acceptable. re: analytics graphite instance, I

[Wikidata-bugs] [Maniphest] [Commented On] T117402: Enable retention of daily metrics for longer periods of time in Graphite

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi added a comment. for long term data warehousing or analytics type of workflows using ourhadoop/analytics infrastructure will be more appropriate I think. graphite is more focused on operational metrics from applications, services and so

[Wikidata-bugs] [Maniphest] [Assigned] T95679: Make a puppet role that sets up a query service and loads it

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi assigned this task to GLavagetto. fgiunchedi added a comment. moving to @joe TASK DETAIL https://phabricator.wikimedia.org/T95679 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GLavagetto

[Wikidata-bugs] [Maniphest] [Reassigned] T95679: Make a puppet role that sets up a query service and loads it

fgiunchedi reassigned this task from GLavagetto to Joe. fgiunchedi added a subscriber: GLavagetto. TASK DETAIL https://phabricator.wikimedia.org/T95679 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, fgiunchedi Cc: GLavagetto, fgiunchedi

[Wikidata-bugs] [Maniphest] [Commented On] T84902: deploy haedus and capella with os for orientdb testing

fgiunchedi added a subscriber: fgiunchedi. fgiunchedi added a comment. looks like this is completed, anything else left @joe ? TASK DETAIL https://phabricator.wikimedia.org/T84902 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username