Re: [Ganglia-developers] Metric Packing Patch Proposal
Nikhil, The max udp message size is a built-in gmond config option. The default maximum is 1472 bytes. At Quantcast, we have increased this to 65535. The patch as exists currently packs metrics from the same collection group together, so for gmond’s built-in metrics, there are anywhere between 1-7 metrics in a packet. There is no interval to wait before sending metrics, since all the metrics in the collection group are collected together and then sent immediately. w From: Nikhil mnik...@gmail.commailto:mnik...@gmail.com Date: Friday, July 24, 2015 at 8:50 PM To: Vladimir Vuksan vli...@veus.hrmailto:vli...@veus.hr Cc: ganglia-developers@lists.sourceforge.netmailto:ganglia-developers@lists.sourceforge.net ganglia-developers@lists.sourceforge.netmailto:ganglia-developers@lists.sourceforge.net Subject: Re: [Ganglia-developers] Metric Packing Patch Proposal interesting indeed -- looking forward to the patch. couple of things: is there a limit on how big the packet can be through the config? are there any system network config changes needed at the os level for this? what is the limit on the number of metrics that could be put together in the single packet? what is the (configurable?) interval to wait for the packets to be available before constructing the packet and sending it out? On a different note, I would be also interested in having gmond work with any of the message queues (rabbitmq or any other fast) as a feature request. :-) thanks! Nikhil On Fri, Jul 24, 2015 at 12:23 PM, Vladimir Vuksan vli...@veus.hrmailto:vli...@veus.hr wrote: Hi Nikhill, This definitely sounds very interesting. I'd love to see it. As far as other features I'd love to see some payload encryption e.g. possibly http://nacl.cr.yp.to/ :-) Vladimir 07/24/2015 u 02:34 PM, Nikhill Rao je napisao/la: Hello all: We are in the process of upgrading our Ganglia installations at Quantcast to version 3.7.1. Currently, we use a heavily modified version of 3.0.4 which incorporates support for packing multiple metrics into a single UDP packet, as well as adding a timestamp to the packet before before being sent. These custom-formatted packets are based on the old 3.0 format. I am working on a patch for gmond to be able to accept and emit our packed packet format as well as the 3.7.1 format. Gmond would be able to accept both kinds of packets and emit either format based on a config option. It should also be fairly simple to re-implement our packing logic to allow for the packing of 3.7-style packets as well. Is there any interest in this patch upstream, and if so, what other features would you all like to see? -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.netmailto:Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] Metric Packing Patch Proposal
Go Nikhil Rao, go! IIRC (I was one of the original authors), we limited each batch to exactly one MTU (and either hardcoded or configured that length, don't remember off-hand). That's probably still required, since you really don't want to deal with fragmentation on multicast. Also, since the timestamp is batch-wide, we would flush (send) either when we had a second sample for something that was buffered, we hit the buffer size, or we processed a metric outside our normal interval (e.g., more than 15s after the first metric was buffered). In the first implementation, the batches were all fed from a script that sampled a number of underlying systems, so it would just flush whenever it had completed its loop. I'm sure the team @ Quantcast has improved the process since then I'm really happy to see somebody moving forward with getting it open sourced. -- ReC On Fri, Jul 24, 2015 at 8:50 PM, Nikhil mnik...@gmail.com wrote: interesting indeed -- looking forward to the patch. couple of things: is there a limit on how big the packet can be through the config? are there any system network config changes needed at the os level for this? what is the limit on the number of metrics that could be put together in the single packet? what is the (configurable?) interval to wait for the packets to be available before constructing the packet and sending it out? On a different note, I would be also interested in having gmond work with any of the message queues (rabbitmq or any other fast) as a feature request. :-) thanks! Nikhil On Fri, Jul 24, 2015 at 12:23 PM, Vladimir Vuksan vli...@veus.hr wrote: Hi Nikhill, This definitely sounds very interesting. I'd love to see it. As far as other features I'd love to see some payload encryption e.g. possibly http://nacl.cr.yp.to/ :-) Vladimir 07/24/2015 u 02:34 PM, Nikhill Rao je napisao/la: Hello all: We are in the process of upgrading our Ganglia installations at Quantcast to version 3.7.1. Currently, we use a heavily modified version of 3.0.4 which incorporates support for packing multiple metrics into a single UDP packet, as well as adding a timestamp to the packet before before being sent. These custom-formatted packets are based on the old 3.0 format. I am working on a patch for gmond to be able to accept and emit our packed packet format as well as the 3.7.1 format. Gmond would be able to accept both kinds of packets and emit either format based on a config option. It should also be fairly simple to re-implement our packing logic to allow for the packing of 3.7-style packets as well. Is there any interest in this patch upstream, and if so, what other features would you all like to see? -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] Metric Packing Patch Proposal
Hi Nikhill, This definitely sounds very interesting. I'd love to see it. As far as other features I'd love to see some payload encryption e.g. possibly http://nacl.cr.yp.to/ :-) Vladimir 07/24/2015 u 02:34 PM, Nikhill Rao je napisao/la: Hello all: We are in the process of upgrading our Ganglia installations at Quantcast to version 3.7.1. Currently, we use a heavily modified version of 3.0.4 which incorporates support for packing multiple metrics into a single UDP packet, as well as adding a timestamp to the packet before before being sent. These custom-formatted packets are based on the old 3.0 format. I am working on a patch for gmond to be able to accept and emit our packed packet format as well as the 3.7.1 format. Gmond would be able to accept both kinds of packets and emit either format based on a config option. It should also be fairly simple to re-implement our packing logic to allow for the packing of 3.7-style packets as well. Is there any interest in this patch upstream, and if so, what other features would you all like to see? -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] Metric Packing Patch Proposal
interesting indeed -- looking forward to the patch. couple of things: is there a limit on how big the packet can be through the config? are there any system network config changes needed at the os level for this? what is the limit on the number of metrics that could be put together in the single packet? what is the (configurable?) interval to wait for the packets to be available before constructing the packet and sending it out? On a different note, I would be also interested in having gmond work with any of the message queues (rabbitmq or any other fast) as a feature request. :-) thanks! Nikhil On Fri, Jul 24, 2015 at 12:23 PM, Vladimir Vuksan vli...@veus.hr wrote: Hi Nikhill, This definitely sounds very interesting. I'd love to see it. As far as other features I'd love to see some payload encryption e.g. possibly http://nacl.cr.yp.to/ :-) Vladimir 07/24/2015 u 02:34 PM, Nikhill Rao je napisao/la: Hello all: We are in the process of upgrading our Ganglia installations at Quantcast to version 3.7.1. Currently, we use a heavily modified version of 3.0.4 which incorporates support for packing multiple metrics into a single UDP packet, as well as adding a timestamp to the packet before before being sent. These custom-formatted packets are based on the old 3.0 format. I am working on a patch for gmond to be able to accept and emit our packed packet format as well as the 3.7.1 format. Gmond would be able to accept both kinds of packets and emit either format based on a config option. It should also be fairly simple to re-implement our packing logic to allow for the packing of 3.7-style packets as well. Is there any interest in this patch upstream, and if so, what other features would you all like to see? -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
