One of Archive's clusters, more or less:
1700 hosts, 512-1GB RAM mostly, 1T to 4T of disk per host
Wishlist additions and seconds:
- 4T Memory limit (already mentioned)
- Multi PB disk limit
- Better on disk RRD perf (tmpfs is an OK workaround)
- Better support for bigger less frequent updates (
> Of course, if the rrdtool enhancement you mentioned would
> solve this problem without any "hacks", it would be even
> better -- someone care to do some tests and provide feedback?
If nobody else responds to my query (below) ... I'll give it a whirl.
David
"Is anyone using RRDtool 1.3 Beta?
Hi David:
On 10/4/07, Wood, David <[EMAIL PROTECTED]> wrote:
> I was under the impression that lots of people experienced disk i/o
> issues with gmetad. I was also under the impression that the generally
> accepted work around for this problem was using tmpfs along with scripts
> to rsync (or wh
Hi Bernard,
I'm using Solaris 10 Sparc and x86. The hardest hit gmetad host runs
Solaris 10 x86 and is monitoring around 1000 systems. The system takes
a good minute to offer a shell via ssh and the I/O subsystem is
completely saturated. The RRDs currently live in a boring old UFS
filesystem an
Hi David:
On 10/4/07, Wood, David <[EMAIL PROTECTED]> wrote:
> Were these ideas dropped? I've adapted to the portability issue;
> however, the current gmetad performance is excruciating. Is anyone
> using RRDtool 1.3 Beta? I'm curious to know if the MMAPed IO changes
> alone are enough to cure
Hello,
> I thought I would start a wishlist for 3.1.0 where we
> can brainstorm for ideas to go into our next release.
In the following thread:
http://www.mail-archive.com/ganglia-developers@lists.sourceforge.net/msg
01820.html
Matt and Tobias discussed changes to support:
a) xdr for RRD portab
Hi Alex:
On 10/4/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> http://www.steveshipway.org/software/rrd/routers2-v2.17a.tar.gz
> The README in the tarball says its GPL v2.
>
> Is ganglia BSD licensed? I see "Copyright (C) 2002,2003 University of
> California, Berkeley" here :
> http://gangl
Quoting Bernard Li <[EMAIL PROTECTED]>:
> Hi John:
>
> On 10/4/07, john allspaw <[EMAIL PROTECTED]> wrote:
>
>> Not sure if anyone would find this helpful, but this looks pretty
>> damn useful:
>>
>> http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&pa
Hi Brad:
On 10/4/07, Brad Nicholes <[EMAIL PROTECTED]> wrote:
> - Implement additional language interfaces. Any embedable scripting language
> could be supported by gmond. The python interface was added by just
> embedding the python language support into a gmond C interface module.
A user
Hi John:
On 10/4/07, john allspaw <[EMAIL PROTECTED]> wrote:
> Not sure if anyone would find this helpful, but this looks pretty damn useful:
>
> http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&page=graph&xgstyle=l2&xmtype=routers
>
> take a look there
Not sure if anyone would find this helpful, but this looks pretty damn useful:
http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&page=graph&xgstyle=l2&xmtype=routers
take a look there, he's got some javascript which will show you the values as
you move
Perhaps it's time to migrate all existing RRDs that store byte counts or
their derivatives to 8 byte ints?
-Matt
Carlo Marcelo Arenas Belon wrote:
> On Thu, Oct 04, 2007 at 10:47:41AM -0500, Jim Rowan wrote:
>
>> Bernard Li wrote:
>>
>>> Dear all:
>>>
>>> As you all know, 3.0.5 has just b
On Thu, Oct 04, 2007 at 10:47:41AM -0500, Jim Rowan wrote:
> Bernard Li wrote:
> >Dear all:
> >
> >As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-)
> >
> >I thought I would start a wishlist for 3.1.0 where we can brainstorm
> >for ideas to go into our next release.
> >
Hi Carlo:
Thanks for doing this.
I guess I should subscribe to the -commits and -bugs mailing-lists so
I can be more on top of development...
Cheers,
Bernard
On 10/4/07, Carlo Marcelo Arenas Belon <[EMAIL PROTECTED]> wrote:
> On Tue, Oct 02, 2007 at 11:32:48PM -0700, Bernard Li wrote:
> > Anyb
Bernard Li wrote:
>Dear all:
>
>As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-)
>
>I thought I would start a wishlist for 3.1.0 where we can brainstorm
>for ideas to go into our next release.
>
>
I would love to see the 4T memory limit removed.
---
>>> On 10/3/2007 at 5:37 PM, in message
<[EMAIL PROTECTED]>, "Bernard Li"
<[EMAIL PROTECTED]> wrote:
> Dear all:
>
> As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-)
>
> I thought I would start a wishlist for 3.1.0 where we can brainstorm
> for ideas to go into our next
On Tue, Oct 02, 2007 at 11:32:48PM -0700, Bernard Li wrote:
> Anybody who have access to Cygwin want to test this patch and provide
> feedback?
>
> http://bugzilla.ganglia.info/cgi-bin/bugzilla/show_bug.cgi?id=154
took the bug, the provided patch conflicts with the fix I proposed, tested
and co
Bernard Li wrote:
> Dear all:
>
> As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-)
>
> I thought I would start a wishlist for 3.1.0 where we can brainstorm
> for ideas to go into our next release.
>
> So far, here are some points:
>
> - Support for new RRDTool which allow
On Thursday 04 October 2007 12:27:41 john allspaw wrote:
> As to compatability breakageit would suck to lose data, for sure.
As far as I understand it, the compatibility issue is mostly between gmond and
gmetad rather than RRDTool. The consequence is one would have to upgrade all
of a site
- graphs of metrics aggregated at the grid-of-grids level, when a gmetad
instance is polling other gmetads. I have some basic code to contribute on
this front but like the stacked graphs, it could use a production-quality
scrubbing.
Gilad
- Original Message
From: Bernard Li <[EMAIL P
Great list!
As to compatability breakageit would suck to lose data, for sure. So how
about
maybe adding a way to possibly archive past data ? Possibly freeze the data you
have
before upgrade, and then have it available as a separate item, just never to be
updated again ?
-j
- Original
Hi all,
Following on from Bernard's & Brad's emails, here's my wish-list for 3.1.0
(although some ideas are perhaps for a more longer-term).
Gathering of metrics:
o A cleaner XDR encoding:
The current encoding scheme embeds too much information about which
metrics
gmond coll
On Wed, Oct 03, 2007 at 04:48:08PM -0700, Bernard Li wrote:
> Hey Stu:
>
> Now that 3.0.5 is released, any chance we can get the official Debian
> packages updated? I believe their package repositories still have
> 2.5.7, which is very old.
>
> Thanks for your help!
I'll roll some interim packa
23 matches
Mail list logo