Go Nikhil Rao, go! IIRC (I was one of the original authors), we limited each batch to exactly one MTU (and either hardcoded or configured that length, don't remember off-hand).
That's probably still required, since you really don't want to deal with fragmentation on multicast. Also, since the timestamp is batch-wide, we would flush (send) either when we had a second sample for something that was buffered, we hit the buffer size, or we processed a metric outside our normal interval (e.g., more than 15s after the first metric was buffered). In the first implementation, the batches were all fed from a script that sampled a number of underlying systems, so it would just flush whenever it had completed its loop. I'm sure the team @ Quantcast has improved the process since then.... I'm really happy to see somebody moving forward with getting it open sourced. -- ReC On Fri, Jul 24, 2015 at 8:50 PM, Nikhil <mnik...@gmail.com> wrote: > interesting indeed -- looking forward to the patch. > > couple of things: > > is there a limit on how big the packet can be through the config? are > there any system network config changes needed at the os level for this? > what is the limit on the number of metrics that could be put together in > the single packet? > what is the (configurable?) interval to wait for the packets to be > available before constructing the packet and sending it out? > > On a different note, I would be also interested in having gmond work with > any of the message queues (rabbitmq or any other fast) as a feature > request. :-) > > thanks! > > Nikhil > > On Fri, Jul 24, 2015 at 12:23 PM, Vladimir Vuksan <vli...@veus.hr> wrote: > >> Hi Nikhill, >> >> This definitely sounds very interesting. I'd love to see it. >> >> As far as other features I'd love to see some payload encryption e.g. >> possibly >> >> http://nacl.cr.yp.to/ >> >> :-) >> >> Vladimir >> >> 07/24/2015 u 02:34 PM, Nikhill Rao je napisao/la: >> >> Hello all: >> We are in the process of upgrading our Ganglia installations at Quantcast >> to version 3.7.1. Currently, we use a heavily modified version of 3.0.4 >> which incorporates support for packing multiple metrics into a single UDP >> packet, as well as adding a timestamp to the packet before before being >> sent. These custom-formatted packets are based on the old 3.0 format. I am >> working on a patch for gmond to be able to accept and emit our packed >> packet format as well as the 3.7.1 format. Gmond would be able to accept >> both kinds of packets and emit either format based on a config option. It >> should also be fairly simple to re-implement our packing logic to allow for >> the packing of 3.7-style packets as well. Is there any interest in this >> patch upstream, and if so, what other features would you all like to see? >> >> >> >> >> ------------------------------------------------------------------------------ >> >> _______________________________________________ >> Ganglia-developers mailing list >> Ganglia-developers@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/ganglia-developers >> >> > > > ------------------------------------------------------------------------------ > > _______________________________________________ > Ganglia-developers mailing list > Ganglia-developers@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/ganglia-developers > >
------------------------------------------------------------------------------
_______________________________________________ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
