Re: [Ganglia-developers] hsflowd for Windows + Ganglia webfrontend

2011-03-04 Thread Neil McKee
I checked in the new sFlow proxy.

There are just config settings,  both optional,  so you typically don't need an 
sflow { } section at all,   just the udp_recv_channel for 6343.  However if you 
wanted to run sFlow in on an non-standard port such as  and you also wanted 
to see any VMs that may be reported-on by their hypervisors,  then you would 
add this to gmond.conf:

udp_recv_channel {
  port =   /* for sFlow */
}
 
sflow {
  udp_port =    /* non-standard port */
  accept_vm_metrics = yes
}

All physical (non-VM) metrics will be accepted by default,  so the first thing 
you will see if you are running host-sflow agents is the inclusion of metrics 
such as swap_in and swap_out.

I added documentation to the gmond/conf.pod file,  but I don't know if/how this 
gets into the man page(?)

Please let me know if there are any problems.

Neil


On Feb 24, 2011, at 4:17 PM, Neil McKee wrote:

 
 On Feb 24, 2011, at 3:07 PM, Bernard Li wrote:
 
 Hi Neil:
 
 I finally had a chance to test out the patch.  Didn't run into any
 major issue on my end, so +1 from me.
 
 On Thu, Feb 17, 2011 at 2:22 PM, Neil McKee neil.mc...@inmon.com wrote:
 
 There are three metrics to draw particular attention to:
 
 1. System UUID
 
 I noticed that on my Windows host, UUID is
 ----.  I guess UUID generation on
 Windows is not supported yet?  I tested with hsflowd 1.12 on Windows
 XP.
 
 
 The Windows UUID appears for me,  but that's from a Windows7 OS.  Maybe we 
 would need to look in a different place on XP.  (The Linux port falls back on 
 the UUID of the first local disk if it can't get a UUID for the whole system, 
  so maybe something similar to that would be acceptable as a work around.)  
 Please raise this question on host-sflow-discuss.
 
 
 The Datasource ID and Parent Datasource ID can be treated as opaque 
 strings that the UI could use to capture and represent the containment 
 hierarchy.
 
 Perhaps you could explain a bit about the format of Datasource ID?
 
 The specs on sflow.org cover this,  but basically it consists of 
 {IPAddress,dsClass,dsIndex} where the IPAddress can be a v4 or v6 address,  
 and the dsClass tells you if the dsIndex is referring to an interface, a 
 physical entity or a logical entity (such as a VM or application).   
 Conceptually I think of each datasource as being one observation point in 
 the system.   From ganglia's perspective it's probably best to treat it as an 
 opaque string,  and just use it to know,  for example,  that a particular VM 
 is running on a particular hypervisor.
 
 
 I've granted you SVN access, so please feel free to check the code
 into trunk.  But perhaps Brad might want to review the code quickly
 before you do so :-)
 
 OK.  I'll wait for Brad to comment.
 
 
 Can you also modify the manpage for gmond.conf plus add it to the
 default configuration?  I'm okay with accept_all_physical = yes as
 the default.
 
 
 OK.
 
 BTW, are you interested in implementing UUID for gmond?  We've been
 talking about using UUID instead of hostname/IP as host identifiers
 because those things could change, so I think this would be a great
 feature to be added to our code base.
 
 
 I really don't know my way around gmond,  and that sounds like it might be a 
 far-reaching change.
 
 Neil
 
 
 
 Thanks,
 
 Bernard
 


--
What You Don't Know About Data Connectivity CAN Hurt You
This paper provides an overview of data connectivity, details
its effect on application quality, and explores various alternative
solutions. http://p.sf.net/sfu/progress-d2d
___
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers


Re: [Ganglia-developers] hsflowd for Windows + Ganglia webfrontend

2011-03-04 Thread Neil McKee
OK,  I added some commented-out lines to lib/default_conf.h.in,  and checked in 
the changes in that directory.  Should be OK now(?)

Thanks for catching my mistake.

Neil

On Mar 4, 2011, at 12:40 PM, Bernard Li wrote:

 Hi Neil:
 
 On Fri, Mar 4, 2011 at 11:25 AM, Neil McKee neil.mc...@inmon.com wrote:
 
 I added documentation to the gmond/conf.pod file,  but I don't know if/how 
 this gets into the man page(?)
 
 Yes, that gets converted to gmond.conf.5 in the Makefile:
 
 https://sourceforge.net/apps/trac/ganglia/browser/trunk/monitor-core/gmond/Makefile.am
 
 Could you please also update lib/default_conf.h.in to include the new
 sflow stuff (commented out)?
 
 Please let me know if there are any problems.
 
 Unfortunately, it looks like you've only committed changes to the
 gmond/ dir but missed the ones from lib/ so gmond doesn't quite run:
 
 # gmond
 /etc/ganglia/gmond.conf:361: no such option 'sflow'
 gmond: confuse.c:323: cfg_opt_getnsec: Assertion `opt  opt-type ==
 CFGT_SEC' failed.
 Aborted (core dumped)
 
 Could you please fix that?
 
 Thanks! :)
 
 Bernard


--
What You Don't Know About Data Connectivity CAN Hurt You
This paper provides an overview of data connectivity, details
its effect on application quality, and explores various alternative
solutions. http://p.sf.net/sfu/progress-d2d
___
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers


Re: [Ganglia-developers] hsflowd for Windows + Ganglia webfrontend

2011-03-04 Thread Bernard Li
Hi Neil:

On Fri, Mar 4, 2011 at 1:35 PM, Neil McKee neil.mc...@inmon.com wrote:

 OK,  I added some commented-out lines to lib/default_conf.h.in,  and checked 
 in the changes in that directory.  Should be OK now(?)

Looks fine.

BTW, did we already decide that 'accept_all_physical' is no longer a
configurable option?

The configuration option in gmond.conf seems to be increasing over
time -- I wonder if it would be better to put the sflow configuration
in a separate file, such as /etc/ganglia/conf.d/sflow.conf.  It will
get included via the include directive in gmond.conf.  What do you
think?

I noticed something weird with the metrics from my WinXP host (running hsflowd):

The gmond collector was down for say an hour, during that time,
hsflowd on WinXP was still running.  However, when I started gmond up,
I noticed that the boottime metric was no longer a constant, and
changes with time.  As a result, Uptime and Last Reported are
quite close to each other.  I also noticed that certain metrics like
load_* were not correct either (lower than what it should be).

I haven't really been able to re-produce this, but thought I'd ask you
to see if you know why that would happen.  Will definitely write back
if I encounter it again in the future.

Cheers,

Bernard

--
What You Don't Know About Data Connectivity CAN Hurt You
This paper provides an overview of data connectivity, details
its effect on application quality, and explores various alternative
solutions. http://p.sf.net/sfu/progress-d2d
___
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers