[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[Manuel]

Manuel closed this task as "Resolved".
Manuel claimed this task.
Manuel added a comment.


  Thank you for your support!

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: ItamarWMDE, Krinkle, colewhite, fgiunchedi, Aklapper, Manuel, 
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[ItamarWMDE]

ItamarWMDE removed ItamarWMDE as the assignee of this task.
ItamarWMDE added a comment.


  Removing myself as assignee as this is not being actively worked on atm

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE
Cc: ItamarWMDE, Krinkle, colewhite, fgiunchedi, Aklapper, Manuel, 
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[fgiunchedi]

fgiunchedi added a comment.


  In T297494#8036682 , 
@ItamarWMDE wrote:
  
  >> My understanding is that you are solving for the former problem (i.e. MW) 
(?)
  >
  > In this particular case, yes, the metrics are collected from Wikidata 
itself (please correct me if I'm wrong @Manuel).
  
  Thank you for confirming!
  
  > However, more generally speaking, we do have some tools surrounding 
wikidata, that are not MW based (predominantly hosted in various toolforge 
containers), in which we still used statsv/statsd. Is there any clear guide on 
how to migrate away from these methods in those projects?
  
  I can't speak for toolforge (though I believe there are Prometheus solutions 
there too!). However for production yes, the basic methods are outlined here: 
https://wikitech.wikimedia.org/wiki/Prometheus#Adding_new_metrics . For statsd 
specifically the basic idea is illustrated here: 
https://wikitech.wikimedia.org/wiki/Prometheus#Statsd  and the k8s-specific 
documentation can be found at 
https://wikitech.wikimedia.org/wiki/Prometheus/statsd_k8s
  
  I'm sure there are gaps in the documentation, please reach out with any other 
questions/doubts/etc !

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE, fgiunchedi
Cc: Krinkle, colewhite, fgiunchedi, Aklapper, Manuel, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[ItamarWMDE]

ItamarWMDE added a comment.


  > My understanding is that you are solving for the former problem (i.e. MW) 
(?)
  
  In this particular case, yes, the metrics are collected from Wikidata itself 
(please correct me if I'm wrong @Manuel).
  
  However, more generally speaking, we do have some tools surrounding wikidata, 
that are not MW based (predominantly hosted in various toolforge containers), 
in which we still used statsv/statsd. Is there any clear guide on how to 
migrate away from these methods in those projects?

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE
Cc: Krinkle, colewhite, fgiunchedi, Aklapper, Manuel, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[fgiunchedi]

fgiunchedi added subscribers: colewhite, Krinkle.
fgiunchedi added a comment.


  In T297494#8022604 , 
@ItamarWMDE wrote:
  
  > Reposting from a Slack discussion, it appears as though statsd is still the 
preferred way to gather some metrics (as opposed to ephemeral jobs), is that 
correct @fgiunchedi? In that case, is it our responsibility to set up export of 
these into Prometheus with statsd exporter? Which data collection methods could 
be migrated to Prometheus otherwise? Is there a place where we can find a more 
detailed migration guideline from Graphite to Prometheus to instruct us in this 
process (apart from the small section in the wikitech Prometheus docs)?
  
  Thank you for reaching out! In the case of metrics generated from within 
Mediawiki you are correct that we're not there yet for off the shelf Mediawiki 
Prometheus metrics in production (though cc @colewhite and @Krinkle as I would 
love to be wrong here!).
  
  For non-Mediawiki metrics though (and new projects) the recommendation is to 
steer away from Statsd/Graphite and use Prometheus instead.
  
  My understanding is that you are solving for the former problem (i.e. MW) (?)

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE, fgiunchedi
Cc: Krinkle, colewhite, fgiunchedi, Aklapper, Manuel, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[Manuel]

Manuel removed projects: Special:NewLexeme revival, Wikidata-Campsite (Team A 
Hearth ).

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE, Manuel
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331, Lydia_Pintscher
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[Manuel]

Manuel renamed this task from "PREP : Port Wikidata dashboard data from 
Graphite to Prometheus [investigation only for now]" to "Port Wikidata 
dashboard data from Graphite to Prometheus ".
Manuel changed the task status from "Open" to "Stalled".
Manuel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ItamarWMDE, Manuel
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus [investigation only for now]

[Manuel]

Manuel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus [investigation only for now]

[karapayneWMDE]

karapayneWMDE added a project: Special:NewLexeme revival.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: karapayneWMDE
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus [investigation only for now]

[Manuel]

Manuel added a project: Wikidata-Campsite (Team A Hearth ).

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus [investigation only for now]

[Manuel]

Manuel renamed this task from "Port Wikidata dashboard data from Graphite to 
Prometheus" to "Port Wikidata dashboard data from Graphite to Prometheus 
[investigation only for now]".
Manuel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: fgiunchedi, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, 
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[Manuel]

Manuel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Manuel
Cc: fgiunchedi, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T297494: Port Wikidata dashboard data from Graphite to Prometheus

[Maintenance_bot]

Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T297494

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: fgiunchedi, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org