Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Joerg Bashir
One of Archive's clusters, more or less: 1700 hosts, 512-1GB RAM mostly, 1T to 4T of disk per host Wishlist additions and seconds: - 4T Memory limit (already mentioned) - Multi PB disk limit - Better on disk RRD perf (tmpfs is an OK workaround) - Better support for bigger less frequent updates (

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Wood, David
> Of course, if the rrdtool enhancement you mentioned would > solve this problem without any "hacks", it would be even > better -- someone care to do some tests and provide feedback? If nobody else responds to my query (below) ... I'll give it a whirl. David "Is anyone using RRDtool 1.3 Beta?

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Bernard Li
Hi David: On 10/4/07, Wood, David <[EMAIL PROTECTED]> wrote: > I was under the impression that lots of people experienced disk i/o > issues with gmetad. I was also under the impression that the generally > accepted work around for this problem was using tmpfs along with scripts > to rsync (or wh

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Wood, David
Hi Bernard, I'm using Solaris 10 Sparc and x86. The hardest hit gmetad host runs Solaris 10 x86 and is monitoring around 1000 systems. The system takes a good minute to offer a shell via ssh and the I/O subsystem is completely saturated. The RRDs currently live in a boring old UFS filesystem an

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Bernard Li
Hi David: On 10/4/07, Wood, David <[EMAIL PROTECTED]> wrote: > Were these ideas dropped? I've adapted to the portability issue; > however, the current gmetad performance is excruciating. Is anyone > using RRDtool 1.3 Beta? I'm curious to know if the MMAPed IO changes > alone are enough to cure

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Wood, David
Hello, > I thought I would start a wishlist for 3.1.0 where we > can brainstorm for ideas to go into our next release. In the following thread: http://www.mail-archive.com/ganglia-developers@lists.sourceforge.net/msg 01820.html Matt and Tobias discussed changes to support: a) xdr for RRD portab

Re: [Ganglia-developers] 3.1.0 wishlist - web20-y stuff

2007-10-04 Thread Bernard Li
Hi Alex: On 10/4/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > http://www.steveshipway.org/software/rrd/routers2-v2.17a.tar.gz > The README in the tarball says its GPL v2. > > Is ganglia BSD licensed? I see "Copyright (C) 2002,2003 University of > California, Berkeley" here : > http://gangl

Re: [Ganglia-developers] 3.1.0 wishlist - web20-y stuff

2007-10-04 Thread alex
Quoting Bernard Li <[EMAIL PROTECTED]>: > Hi John: > > On 10/4/07, john allspaw <[EMAIL PROTECTED]> wrote: > >> Not sure if anyone would find this helpful, but this looks pretty >> damn useful: >> >> http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&pa

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Bernard Li
Hi Brad: On 10/4/07, Brad Nicholes <[EMAIL PROTECTED]> wrote: > - Implement additional language interfaces. Any embedable scripting language > could be supported by gmond. The python interface was added by just > embedding the python language support into a gmond C interface module. A user

Re: [Ganglia-developers] 3.1.0 wishlist - web20-y stuff

2007-10-04 Thread Bernard Li
Hi John: On 10/4/07, john allspaw <[EMAIL PROTECTED]> wrote: > Not sure if anyone would find this helpful, but this looks pretty damn useful: > > http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&page=graph&xgstyle=l2&xmtype=routers > > take a look there

Re: [Ganglia-developers] 3.1.0 wishlist - web20-y stuff

2007-10-04 Thread john allspaw
Not sure if anyone would find this helpful, but this looks pretty damn useful: http://www.steveshipway.org/cgi-bin/routers2.pl?rtr=switches%2Fswitch.cfg&bars=Cami&xgtype=d&page=graph&xgstyle=l2&xmtype=routers take a look there, he's got some javascript which will show you the values as you move

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Matthew Chambers
Perhaps it's time to migrate all existing RRDs that store byte counts or their derivatives to 8 byte ints? -Matt Carlo Marcelo Arenas Belon wrote: > On Thu, Oct 04, 2007 at 10:47:41AM -0500, Jim Rowan wrote: > >> Bernard Li wrote: >> >>> Dear all: >>> >>> As you all know, 3.0.5 has just b

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Carlo Marcelo Arenas Belon
On Thu, Oct 04, 2007 at 10:47:41AM -0500, Jim Rowan wrote: > Bernard Li wrote: > >Dear all: > > > >As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-) > > > >I thought I would start a wishlist for 3.1.0 where we can brainstorm > >for ideas to go into our next release. > >

Re: [Ganglia-developers] Cygwin

2007-10-04 Thread Bernard Li
Hi Carlo: Thanks for doing this. I guess I should subscribe to the -commits and -bugs mailing-lists so I can be more on top of development... Cheers, Bernard On 10/4/07, Carlo Marcelo Arenas Belon <[EMAIL PROTECTED]> wrote: > On Tue, Oct 02, 2007 at 11:32:48PM -0700, Bernard Li wrote: > > Anyb

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Jim Rowan
Bernard Li wrote: >Dear all: > >As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-) > >I thought I would start a wishlist for 3.1.0 where we can brainstorm >for ideas to go into our next release. > > I would love to see the 4T memory limit removed. ---

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Brad Nicholes
>>> On 10/3/2007 at 5:37 PM, in message <[EMAIL PROTECTED]>, "Bernard Li" <[EMAIL PROTECTED]> wrote: > Dear all: > > As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-) > > I thought I would start a wishlist for 3.1.0 where we can brainstorm > for ideas to go into our next

Re: [Ganglia-developers] Cygwin

2007-10-04 Thread Carlo Marcelo Arenas Belon
On Tue, Oct 02, 2007 at 11:32:48PM -0700, Bernard Li wrote: > Anybody who have access to Cygwin want to test this patch and provide > feedback? > > http://bugzilla.ganglia.info/cgi-bin/bugzilla/show_bug.cgi?id=154 took the bug, the provided patch conflicts with the fix I proposed, tested and co

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Matthew Chambers
Bernard Li wrote: > Dear all: > > As you all know, 3.0.5 has just been released -- time to work on 3.1.0! :-) > > I thought I would start a wishlist for 3.1.0 where we can brainstorm > for ideas to go into our next release. > > So far, here are some points: > > - Support for new RRDTool which allow

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Paul Millar
On Thursday 04 October 2007 12:27:41 john allspaw wrote: > As to compatability breakageit would suck to lose data, for sure. As far as I understand it, the compatibility issue is mostly between gmond and gmetad rather than RRDTool. The consequence is one would have to upgrade all of a site

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread Gilad Raphaelli
- graphs of metrics aggregated at the grid-of-grids level, when a gmetad instance is polling other gmetads. I have some basic code to contribute on this front but like the stacked graphs, it could use a production-quality scrubbing. Gilad - Original Message From: Bernard Li <[EMAIL P

Re: [Ganglia-developers] 3.1.0 wishlist

2007-10-04 Thread john allspaw
Great list! As to compatability breakageit would suck to lose data, for sure. So how about maybe adding a way to possibly archive past data ? Possibly freeze the data you have before upgrade, and then have it available as a separate item, just never to be updated again ? -j - Original

[Ganglia-developers] Further 3.1.0 wishlist

2007-10-04 Thread Paul Millar
Hi all, Following on from Bernard's & Brad's emails, here's my wish-list for 3.1.0 (although some ideas are perhaps for a more longer-term). Gathering of metrics: o A cleaner XDR encoding: The current encoding scheme embeds too much information about which metrics gmond coll

Re: [Ganglia-developers] Debian packages for 3.0.5

2007-10-04 Thread Stu Teasdale
On Wed, Oct 03, 2007 at 04:48:08PM -0700, Bernard Li wrote: > Hey Stu: > > Now that 3.0.5 is released, any chance we can get the official Debian > packages updated? I believe their package repositories still have > 2.5.7, which is very old. > > Thanks for your help! I'll roll some interim packa