Arjun,
How 'real-time' do you need it to be, how precise should the information be?
I don't know if it's a wise thing to make real-time configuration
changes to your cluster based upon Ganglia information.
Ganglia's stream of XML as communicated across the uni/multicast channel
can be rather slow in terms of seconds.
I.e.: if a metric value changes on the machine itself it could/might
take up to 15 seconds before it is actually sent across the network (or
even longer depending on the particular metric). If you are using
multicast, it might take some additional time (seconds) for it to
propagate across the stream.
For this reason, I wouldn't do anything like load balancing, ip/route
switching or similar.
Kind regards,
- Ramon.
Arjun wrote:
Sorry .. I meant "real-time" not "meal-time".
Probably made that mistake cause i'm hungry at the moment
;)
On 2/24/06, *Arjun* <[EMAIL PROTECTED]
<mailto:[EMAIL PROTECTED]>> wrote:
Ok, let me explain in more detail :-
I have a requirement to write gathered data from a small cluster
(about 40 computers).
The number of metrics to be gathered is low (about 6-10). These
metrics need to be stored indefinitely.
We also want to process the data in a real-time manner, that is -
each insert of data results in some operations, the results
of which are used in taking meal-time decisions about the
configuration/allocation of the cluster.
Having the data in a Relational DB makes it far easier to perform
complex operations on the stored data. This is the
main reason why we want it in a DB. This is all for a research
project into cluster computing.
The growing size of the Data is not really an issue for us as we
can truncate it to whatever we want.
We already know that an rrd can be dumped to xml or whatever, but
we specifically want data to be written
directly to a DB.
I hope that answers all the queries.
:)
Thanks and regards
Arjun
--
ing. R. Bastiaans HPC - Systems Programmer
SARA - Computing and Networking Services
Kruislaan 415 PO Box 194613
1098 SJ Amsterdam 1090 GP Amsterdam
Tel. +31 (0) 20 592 3000 Fax. +31 (0) 20 668 3167
---
There are really only three types of people:
Those who make things happen, those who watch things happen
and those who say, "What happened?"
