Re: [Ganglia-developers] Does Ganglia work well for a large-scale cluster

[Vladimir Vuksan]

Hi Jason, it depends on the number of metrics and associated metadata in the cluster and how busy gmetad is overall. Also depends on your hardware. At one point FB had clusters with tens of thousands of nodes in a cluster. Try to keep your metrics lean ie. don't add any metric descriptions if you don't have to so to keep the XML payload small and it should be fine. Vladimir 3/28/2017 u 10:19 PM, Guo, Jason je napisao/la: Hi,     I’m writing this mail to discuss whether Ganglia works well for a large-scale cluster (more than 4000 nodes).     As per Ganglia document, ganglia can scale to handle clusters with 2000 nodes. So many people have concern on using Ganglia for a 4000 nodes production cluster. It has been used to link clusters across university campuses and around the world and can scale to handle clusters with 2000 nodes.   If the cluster is large than 2000 nodes, say 4000 nodes, can Ganglia handle it properly?     To verify this, I create a 5000 nodes ganglia cluster on top of Docker cluster (10 machine). I put 500 nodes in a cluster, so there are 10 cluster. And these 10 clusters are in the same Grid. For each gmond,  I use a script to generate 30 customized metrics (with gmetric).   Currently it works fine in the Docker based test environment.   So, my question is whether Ganglia is suitable for 4000 nodes cluster?     Thanks & Best Regards, Jason Gu0o     ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _______________________________________________ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Ganglia-developers mailing list
Ganglia-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-developers