Re: [ceph-users] Ceph monitoring

2017-10-05 Thread Lenz Grimmer
On 10/05/2017 12:15 PM, Jasper Spaans wrote: > Thanks for the pointers - I guess I'll need to find some time to change > those dashboards to use the ceph-mgr metrics names (at least, I'm unsure > if the DO exporter uses the same names as ceph-mgr.) To be continued.. Not sure about that; AFAIK the

Re: [ceph-users] Ceph monitoring

2017-10-05 Thread Jasper Spaans
On 05/10/2017 12:03, Lenz Grimmer wrote: >> Now to find or build a pretty dashboard with all of these metrics. I >> wasn't able to find something in the grafana supplied dashboards, and >> haven't spent enough time on openattic to extract a dashboard from >> there. Any pointers appreciated! > open

Re: [ceph-users] Ceph monitoring

2017-10-05 Thread Lenz Grimmer
Hi, On 10/03/2017 08:37 AM, Jasper Spaans wrote: > Now to find or build a pretty dashboard with all of these metrics. I > wasn't able to find something in the grafana supplied dashboards, and > haven't spent enough time on openattic to extract a dashboard from > there. Any pointers appreciated!

Re: [ceph-users] Ceph monitoring

2017-10-03 Thread John Spray
On Tue, Oct 3, 2017 at 7:37 AM, Jasper Spaans wrote: > Hi, > > On 02/10/2017 13:34, Osama Hasebou wrote: > > Hi Everyone, > > Is there a guide/tutorial about how to setup Ceph monitoring system using > collectd / grafana / graphite ? Other suggestions are welcome as well ! > > I found some GitHub

Re: [ceph-users] Ceph monitoring

2017-10-03 Thread Matthew Vernon
On 02/10/17 20:26, Erik McCormick wrote: > On Mon, Oct 2, 2017 at 11:55 AM, Matthew Vernon wrote: >> Making a dashboard is rather a matter of personal preference - we plot >> client and s3 i/o, network, server load & CPU use, and have indicator >> plots for numbers of osds up&in, and monitor quoru

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread Jasper Spaans
Hi, On 02/10/2017 13:34, Osama Hasebou wrote: > Hi Everyone, > > Is there a guide/tutorial about how to setup Ceph monitoring system > using collectd / grafana / graphite ? Other suggestions are welcome as > well ! > > I found some GitHub solutions but not much documentation on how to > implement

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread Reed Dier
As someone currently running collectd/influxdb/grafana stack for monitoring, I am curious if anyone has seen issues moving Jewel -> Luminous. I thought I remembered reading that collectd wasn’t working perfectly in Luminous, likely not helped with the MGR daemon. Also thought about trying teleg

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread Erik McCormick
On Mon, Oct 2, 2017 at 11:55 AM, Matthew Vernon wrote: > On 02/10/17 12:34, Osama Hasebou wrote: >> Hi Everyone, >> >> Is there a guide/tutorial about how to setup Ceph monitoring system >> using collectd / grafana / graphite ? Other suggestions are welcome as >> well ! > > We just installed the c

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread Matthew Vernon
On 02/10/17 12:34, Osama Hasebou wrote: > Hi Everyone, > > Is there a guide/tutorial about how to setup Ceph monitoring system > using collectd / grafana / graphite ? Other suggestions are welcome as > well ! We just installed the collectd plugin for ceph, and pointed it at our grahphite server;

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread German Anders
prometheus has a nice data exporter build in go, that then you can send to grafana or any other tool https://github.com/digitalocean/ceph_exporter *German* 2017-10-02 8:34 GMT-03:00 Osama Hasebou : > Hi Everyone, > > Is there a guide/tutorial about how to setup Ceph monitoring system using > co

Re: [ceph-users] Ceph monitoring

2017-10-02 Thread David
If you take Ceph out of your search string you should find loads of tutorials on setting up the popular collectd/influxdb/grafana stack. Once you've got that in place, the Ceph bit should be fairly easy. There's Ceph collectd plugins out there or you could write your own. On Mon, Oct 2, 2017 at

[ceph-users] Ceph monitoring

2017-10-02 Thread Osama Hasebou
Hi Everyone, Is there a guide/tutorial about how to setup Ceph monitoring system using collectd / grafana / graphite ? Other suggestions are welcome as well ! I found some GitHub solutions but not much documentation on how to implement. Thanks. Regards, Ossi

Re: [ceph-users] Ceph monitoring

2017-02-01 Thread Ruben Kerkhof
On Wed, Feb 1, 2017 at 11:22 AM, Lenz Grimmer wrote: > > First off, which collectd-ceph plugin are we talking about here? > > There seem to be several different implementations: > > https://github.com/ceph/collectd (full collectd fork, outdated?) > https://github.com/ceph/collectd-4.10.1 (dito, ou

Re: [ceph-users] Ceph monitoring

2017-02-01 Thread Trelohan Christophe
t; scripts so feel free to mail me if you want more information. Regards Chris -Message d'origine- De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de Lenz Grimmer Envoyé : mercredi 1 février 2017 11:23 À : ceph-users@lists.ceph.com Objet : Re: [ceph-users] Ceph

Re: [ceph-users] Ceph monitoring

2017-02-01 Thread Lenz Grimmer
Hi, On 01/30/2017 12:18 PM, Matthew Vernon wrote: > On 28/01/17 23:43, Marc Roos wrote: > >> Is there a doc that describes all the parameters that are published by >> collectd-ceph? > > The best I've found is the Redhat documentation of the performance > counters (which are what collectd-ceph i

Re: [ceph-users] Ceph monitoring

2017-01-30 Thread Andre Forigato
Matthew, Very good documentation on performance counters. Thank you for sharing with us. Regards, André - Mensagem original - > De: "Matthew Vernon" > Para: "Marc Roos" , "ceph-users" > > Enviadas: Segunda-feira, 30 de janeiro de 201

Re: [ceph-users] Ceph monitoring

2017-01-30 Thread Matthew Vernon
Dear Marc, On 28/01/17 23:43, Marc Roos wrote: Is there a doc that describes all the parameters that are published by collectd-ceph? The best I've found is the Redhat documentation of the performance counters (which are what collectd-ceph is querying): https://access.redhat.com/documentati

Re: [ceph-users] Ceph monitoring

2017-01-29 Thread Shinobu Kinjo
There were some related MLs. Google this: [ceph-users] Ceph Plugin for Collectd On Sun, Jan 29, 2017 at 8:43 AM, Marc Roos wrote: > > > Is there a doc that describes all the parameters that are published by > collectd-ceph? > > Is there maybe a default grafana dashboard for influxdb? I found >

[ceph-users] Ceph monitoring

2017-01-28 Thread Marc Roos
Is there a doc that describes all the parameters that are published by collectd-ceph? Is there maybe a default grafana dashboard for influxdb? I found something for graphite, and modifying those. -Original Message- From: Patrick McGarry [mailto:pmcga...@redhat.com] Sent: donderdag

Re: [ceph-users] Ceph Monitoring

2017-01-17 Thread Trey Palmer
Just going into production now with a large-ish multisite radosgw setup on 10.2. We are starting off by alerting on anything that isn't HEALTH_OK, just to see how things go. If we get HEALTH_WARN but no mons or OSD's are down then it will be a low-level alert. We will massage scripts to pick

Re: [ceph-users] Ceph Monitoring

2017-01-16 Thread Marius Vaitiekunas
On Mon, Jan 16, 2017 at 3:54 PM, Andre Forigato wrote: > Hello Marius Vaitiekunas, Chris Jones, > > Thank you for your contributions. > I was looking for this information. > > I'm starting to use Ceph, and my concern is about monitoring. > > Do you have any scripts for this monitoring? > If you c

Re: [ceph-users] Ceph Monitoring

2017-01-16 Thread Andre Forigato
re is misinterpretation) Best Regards, André Forigato - Mensagem original - > De: "Marius Vaitiekunas" > Para: "Chris Jones" , ceph-us...@ceph.com > Enviadas: Domingo, 15 de janeiro de 2017 19:26:05 > Assunto: Re: [ceph-users] Ceph Monitoring > On Fri,

Re: [ceph-users] Ceph Monitoring

2017-01-15 Thread Marius Vaitiekunas
On Fri, 13 Jan 2017 at 22:15, Chris Jones wrote: > General question/survey: > > Those that have larger clusters, how are you doing alerting/monitoring? > Meaning, do you trigger off of 'HEALTH_WARN', etc? Not really talking about > collectd related but more on initial alerts of an issue or potent

Re: [ceph-users] Ceph Monitoring

2017-01-13 Thread Paweł Sadowski
ying of this message is prohibited. *From:* Chris Jones [cjo...@cloudm2.com] *Sent:* Friday, January 13, 2017 1:31 PM *To:* David Turner *Cc:* ceph-us...@ceph.com *Subject:* Re: [ceph-users] Ceph Monitoring T

Re: [ceph-users] Ceph Monitoring

2017-01-13 Thread David Turner
this message is prohibited. From: Chris Jones [cjo...@cloudm2.com] Sent: Friday, January 13, 2017 1:31 PM To: David Turner Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Ceph Monitoring Thanks. What about 'NN ops > 32 sec'

Re: [ceph-users] Ceph Monitoring

2017-01-13 Thread Chris Jones
> > -- > *From:* ceph-users [ceph-users-boun...@lists.ceph.com] on behalf of Chris > Jones [cjo...@cloudm2.com] > *Sent:* Friday, January 13, 2017 1:15 PM > *To:* ceph-us...@ceph.com > *Subject:* [ceph-users] Ceph Monitoring > > Gener

Re: [ceph-users] Ceph Monitoring

2017-01-13 Thread David Turner
of Chris Jones [cjo...@cloudm2.com] Sent: Friday, January 13, 2017 1:15 PM To: ceph-us...@ceph.com Subject: [ceph-users] Ceph Monitoring General question/survey: Those that have larger clusters, how are you doing alerting/monitoring? Meaning, do you trigger off of 'HEALTH_WARN', etc?

[ceph-users] Ceph Monitoring

2017-01-13 Thread Chris Jones
General question/survey: Those that have larger clusters, how are you doing alerting/monitoring? Meaning, do you trigger off of 'HEALTH_WARN', etc? Not really talking about collectd related but more on initial alerts of an issue or potential issue? What threshold do you use basically? Just trying

Re: [ceph-users] ceph monitoring with graphite

2015-08-27 Thread John Spray
On Thu, Aug 27, 2015 at 10:37 AM, Wido den Hollander wrote: > On 08/26/2015 04:33 PM, Dan van der Ster wrote: >> Hi Wido, >> >> On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander wrote: >>> I'm sending pool statistics to Graphite >> >> We're doing the same -- stripping invalid chars as needed -

Re: [ceph-users] ceph monitoring with graphite

2015-08-27 Thread Wido den Hollander
On 08/26/2015 04:33 PM, Dan van der Ster wrote: > Hi Wido, > > On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander wrote: >> I'm sending pool statistics to Graphite > > We're doing the same -- stripping invalid chars as needed -- and I > would guess that lots of people have written similar json

Re: [ceph-users] ceph monitoring with graphite

2015-08-27 Thread Dan van der Ster
On Wed, Aug 26, 2015 at 6:52 PM, John Spray wrote: > On Wed, Aug 26, 2015 at 3:33 PM, Dan van der Ster wrote: >> Hi Wido, >> >> On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander wrote: >>> I'm sending pool statistics to Graphite >> >> We're doing the same -- stripping invalid chars as needed

Re: [ceph-users] ceph monitoring with graphite

2015-08-26 Thread John Spray
On Wed, Aug 26, 2015 at 3:33 PM, Dan van der Ster wrote: > Hi Wido, > > On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander wrote: >> I'm sending pool statistics to Graphite > > We're doing the same -- stripping invalid chars as needed -- and I > would guess that lots of people have written simi

Re: [ceph-users] ceph monitoring with graphite

2015-08-26 Thread Quentin Hartman
That would certainly be something we would use. QH On Wed, Aug 26, 2015 at 8:33 AM, Dan van der Ster wrote: > Hi Wido, > > On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander > wrote: > > I'm sending pool statistics to Graphite > > We're doing the same -- stripping invalid chars as needed --

[ceph-users] ceph monitoring with graphite

2015-08-26 Thread Dan van der Ster
Hi Wido, On Wed, Aug 26, 2015 at 10:36 AM, Wido den Hollander wrote: > I'm sending pool statistics to Graphite We're doing the same -- stripping invalid chars as needed -- and I would guess that lots of people have written similar json2graphite convertor scripts for Ceph monitoring in the recent

Re: [ceph-users] Ceph Monitoring with check_MK

2014-11-19 Thread Kostis Fardelas
Hi Robert, an improvement to your checks could be the addition of check parameters (instead of using hard coded values for warn and crit) so that someone can change their values in main.mk. Hope to find some time soon and send you a PR about it. Nice job btw! On 19 November 2014 18:23, Robert Sand

Re: [ceph-users] Ceph Monitoring with check_MK

2014-11-19 Thread Robert Sander
Hi, On 14.11.2014 11:38, Nick Fisk wrote: > I've just been testing your ceph check and I have made a small modification > to allow it to adjust itself to suit the autoscaling of the units Ceph > outputs. Thanks for the feedback. I took your idea, added PB and KB, and pushed it to github again:

Re: [ceph-users] Ceph Monitoring with check_MK

2014-11-14 Thread Nick Fisk
putting some cluster IO perf data and # of objects in the future, will keep you posted. Nick -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Robert Sander Sent: 07 November 2014 13:51 To: ceph-users@lists.ceph.com Subject: [ceph-users] Ceph

Re: [ceph-users] Ceph Monitoring with check_MK

2014-11-07 Thread Joao Eduardo Luis
On 11/07/2014 03:46 PM, Gregory Farnum wrote: I believe we use base-2 space accounting everywhere. Joao could confirm on that. although unit formatting is set to SI, these are base-2 values. 2G or 2GB will in fact be (2 << 30) bytes. -Joao -Greg On Fri, Nov 7, 2014 at 5:50 AM Robert Sander

Re: [ceph-users] Ceph Monitoring with check_MK

2014-11-07 Thread Gregory Farnum
I believe we use base-2 space accounting everywhere. Joao could confirm on that. -Greg On Fri, Nov 7, 2014 at 5:50 AM Robert Sander wrote: > Hi, > > I just create a simple check_MK agent plugin and accompanying checks to > monitor the overall health status and pool usage with the check_MK / OMD >

[ceph-users] Ceph Monitoring with check_MK

2014-11-07 Thread Robert Sander
Hi, I just create a simple check_MK agent plugin and accompanying checks to monitor the overall health status and pool usage with the check_MK / OMD monitoring system: https://github.com/HeinleinSupport/check_mk/tree/master/ceph One question remains: What is the real unit of the ceph df output?

Re: [ceph-users] Ceph monitoring / stats and troubleshooting tools

2013-10-09 Thread Guang
For the second issue, I got the answer from within: http://ceph.com/docs/master/rados/operations/monitoring-osd-pg/#finding-an-object-location. Thanks, Guang On Oct 8, 2013, at 8:43 PM, Guang wrote: > Hi ceph-users, > After walking through the operations document, I still have several questions

[ceph-users] Ceph monitoring / stats and troubleshooting tools

2013-10-08 Thread Guang
Hi ceph-users, After walking through the operations document, I still have several questions in terms of operation / monitoring for ceph which need you help. Thanks! 1. Does ceph provide build in monitoring mechanism for Rados and RadosGW? Taking Rados for example, is it possible to monitor the