Re: [Ganglia-general] Huge metrics' size being reported to gmetad
Hi Cristovao, that depends on how many metrics and on the rrd creation settings. Sure 150MB looks like a lot. An ls -la may give more hints... Ciao, Sergio On 30 Jun 2014 16:35, Cristovao Jose Domingues Cordeiro cristovao.corde...@cern.ch wrote: Someone? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN -- *From:* Cristovao Jose Domingues Cordeiro [cristovao.corde...@cern.ch] *Sent:* 24 June 2014 13:58 *To:* ganglia-general@lists.sourceforge.net *Subject:* [Ganglia-general] Huge metrics' size being reported to gmetad Hi, I have a grid configuration, with several clusters. I am also using RAM disk for I/O optimization (4GB). I've been noticing that sometimes, gmetad breaks, complaining about lack of space in this tmpfs partition. I checked and I saw that for some reason, some clusters, have hosts which occupy 3MB, 6MB and even sometimes 150MB All together makes the cluster occupy 2GB and consequently occupy half of the ramdisk space. We would normally expect these host metrics to have +/- 336k right? Has anyone experienced this? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Huge metrics' size being reported to gmetad
Dear Sergio, Somehow on my 300-node cluster Ganglia, with more or less default metrics and RRD configs, collects over 40GB! If there are smarter RRD settings to reduce the size, it would be very interesting to learn them. -- Grigory Shamov HPC Analyst, Tech. Site Lead, Westgrid/Compute Canada E2-588 EITC Building, University of Manitoba (204) 474-9625 From: Sergio Ballestrero sergio.ballestr...@gmail.commailto:sergio.ballestr...@gmail.com Date: Monday, 30 June, 2014 10:21 AM To: Cristovao Jose Domingues Cordeiro cristovao.corde...@cern.chmailto:cristovao.corde...@cern.ch Cc: Ganglia ganglia-general@lists.sourceforge.netmailto:ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Huge metrics' size being reported to gmetad Hi Cristovao, that depends on how many metrics and on the rrd creation settings. Sure 150MB looks like a lot. An ls -la may give more hints... Ciao, Sergio On 30 Jun 2014 16:35, Cristovao Jose Domingues Cordeiro cristovao.corde...@cern.chmailto:cristovao.corde...@cern.ch wrote: Someone? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN From: Cristovao Jose Domingues Cordeiro [cristovao.corde...@cern.chmailto:cristovao.corde...@cern.ch] Sent: 24 June 2014 13:58 To: ganglia-general@lists.sourceforge.netmailto:ganglia-general@lists.sourceforge.net Subject: [Ganglia-general] Huge metrics' size being reported to gmetad Hi, I have a grid configuration, with several clusters. I am also using RAM disk for I/O optimization (4GB). I've been noticing that sometimes, gmetad breaks, complaining about lack of space in this tmpfs partition. I checked and I saw that for some reason, some clusters, have hosts which occupy 3MB, 6MB and even sometimes 150MB All together makes the cluster occupy 2GB and consequently occupy half of the ramdisk space. We would normally expect these host metrics to have +/- 336k right? Has anyone experienced this? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.netmailto:Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Huge metrics' size being reported to gmetad
Hi Grigory, I was hit by a similar problem before realizing that the default changed from one version to another. This what I have now # Old Default RRA: Keep 1 hour of metrics at 15 second resolution. 1 day at 6 minute RRAs RRA:AVERAGE:0.5:1:244 RRA:AVERAGE:0.5:24:244 RRA:AVERAGE:0.5:168:244 RRA:AVERAGE:0.5:672:244 \ RRA:AVERAGE:0.5:5760:374 # New Default RRA # Keep 5856 data points at 15 second resolution assuming 15 second (default) polling. That's 1 day # Two weeks of data points at 1 minute resolution (average) #RRAs RRA:AVERAGE:0.5:1:5856 RRA:AVERAGE:0.5:4:20160 RRA:AVERAGE:0.5:40:52704 Cheers, Chris 2014-06-30 17:30 GMT+02:00 Grigory Shamov grigory.sha...@umanitoba.ca: Dear Sergio, Somehow on my 300-node cluster Ganglia, with more or less default metrics and RRD configs, collects over 40GB! If there are smarter RRD settings to reduce the size, it would be very interesting to learn them. -- Grigory Shamov HPC Analyst, Tech. Site Lead, Westgrid/Compute Canada E2-588 EITC Building, University of Manitoba (204) 474-9625 From: Sergio Ballestrero sergio.ballestr...@gmail.com Date: Monday, 30 June, 2014 10:21 AM To: Cristovao Jose Domingues Cordeiro cristovao.corde...@cern.ch Cc: Ganglia ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Huge metrics' size being reported to gmetad Hi Cristovao, that depends on how many metrics and on the rrd creation settings. Sure 150MB looks like a lot. An ls -la may give more hints... Ciao, Sergio On 30 Jun 2014 16:35, Cristovao Jose Domingues Cordeiro cristovao.corde...@cern.ch wrote: Someone? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN -- *From:* Cristovao Jose Domingues Cordeiro [cristovao.corde...@cern.ch] *Sent:* 24 June 2014 13:58 *To:* ganglia-general@lists.sourceforge.net *Subject:* [Ganglia-general] Huge metrics' size being reported to gmetad Hi, I have a grid configuration, with several clusters. I am also using RAM disk for I/O optimization (4GB). I've been noticing that sometimes, gmetad breaks, complaining about lack of space in this tmpfs partition. I checked and I saw that for some reason, some clusters, have hosts which occupy 3MB, 6MB and even sometimes 150MB All together makes the cluster occupy 2GB and consequently occupy half of the ramdisk space. We would normally expect these host metrics to have +/- 336k right? Has anyone experienced this? Cumprimentos / Best regards, Cristóvão José Domingues Cordeiro IT Department - 28/1-010 CERN -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Christophe HAEN CERN PH-LBC 2/R022 Phone : +41 (0)2 27 67 31 25 Mobile : +41 (0)7 64 87 88 57 -- Open source business process management suite built on Java and Eclipse Turn processes into business applications with Bonita BPM Community Edition Quickly connect people, data, and systems into organized workflows Winner of BOSSIE, CODIE, OW2 and Gartner awards http://p.sf.net/sfu/Bonitasoft___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
