---------- Forwarded message ---------- From: Dan Roberts <[EMAIL PROTECTED]> Date: Jul 26, 2007 12:41 PM Subject: Re: [Ganglia-general] HELP>. How to remove >>zillions upon zillions of RRD_update messages in /var/log/messages To: Bernard Li <[EMAIL PROTECTED]>
how do I check that.. run date on all the headnodes and compute nodes and see how far off they are? What is acceptable in time differene do you believe? As well, is there a way to get ganglia to write to a diferrent file other than /var/log/messages! Thanks Dan On Thu, 2007-07-26 at 12:29 -0700, Bernard Li wrote: > Most likely the clocks of your servers (gmetad, gmond) are not in sync > -- I would check that first. > > Cheers, > > Bernard > > On 7/26/07, Dan Roberts <[EMAIL PROTECTED]> wrote: > > Hello All > > How can I temper or reduce the number of thes types of messages that > > appear in my systems /var/log/messages file? > > I get hundreds of these logged every few seconds!. > > I have a cluster of about 108 compute nodes.. > > > > Thanks for any advice!! > > > > Dan > > > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n004.lnxc1.com/proc_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n004.lnxc1.com/mem_shared.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n004.lnxc1.com/mem_cached.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n004.lnxc1.com/bytes_out.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n004.lnxc1.com/pkts_in.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/disk_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_speed.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/part_max_used.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/swap_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_user.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_system.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_aidle.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/load_five.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/proc_run.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/mem_free.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/mem_buffers.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/swap_free.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/bytes_in.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/pkts_out.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_num.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/disk_free.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/mem_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_wio.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/boottime.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_nice.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/cpu_idle.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/load_one.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/load_fifteen.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/proc_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/mem_shared.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/mem_cached.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/bytes_out.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n013.lnxc1.com/pkts_in.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/disk_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/cpu_speed.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/part_max_used.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/swap_total.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/cpu_user.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/cpu_system.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/cpu_aidle.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/load_five.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/proc_run.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/mem_free.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/mem_buffers.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/swap_free.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one second step) > > Jul 22 04:17:56 bwdl01-m001 /usr/sbin/gmetad[21836]: RRD_update > > (/var/lib/ganglia/rrds/bwdl01/bwdl01-n005.lnxc1.com/bytes_in.rrd): > > illegal attempt to update using time 1121534337 when last update time is > > 1181823348 (minimum one sec[ > > > > ------------------------------------------------------------------------- > > This SF.net email is sponsored by: Splunk Inc. > > Still grepping through log files to find problems? Stop. > > Now Search log events and configuration files using AJAX and a browser. > > Download your FREE copy of Splunk now >> http://get.splunk.com/ > > _______________________________________________ > > Ganglia-general mailing list > > [email protected] > > https://lists.sourceforge.net/lists/listinfo/ganglia-general > > ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Ganglia-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/ganglia-general
