Hi bob, appreciate your answer!
The VM specs don´t change while upgrading and judging from the CPU utilization I can´t really see a difference between ES 2.3.5 and ES 1.7.1. My inputs come from various sources, logstash, nxlog, raw udp, etc. Inputs don´t change when upgrading though and I get good perfomance with GL 1.3.4/ES 1.7.1 just abysmal output with GL 2.1.1. I don´t see the ES host dropping request, too - so my guess there´s something going on in the processing queues in GL that might cause the trouble. Suffice to say: input still works well, processing and output don´t. Am Donnerstag, 3. November 2016 13:54:23 UTC+1 schrieb Bob: > > With 4 cpu's on your ES server your bulk threads will max out at 4, with a > 1000 message output batch size that would set your max to essentially 4k > msg/s. I would increase the output batch size and add cpu on the ES vm. > Also you didn't mention what your input config is in graylog, are you sure > it isn't doing any dns lookups for the incoming messages? That will kill > throughput in that situation as well. > > >> -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/805ca59f-a609-437c-9024-0d305cbe23c4%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
