It seems that "shutting down" means that the executor service the internal elasticsearch node uses has been stopped.
So it tries to send some action to the cluster, but can't because it can't execute the runnable internally. This would indicate the graylog2 server was shutting down. Is there maybe something that sends signals to the graylog2 server? A logrotate or something like that? >From looking at elasticsearch's code I can't find any place where it would shutdown the executor except when the server is being stopped or while threadpool settings are updated dynamically. Have you tried starting graylog2 in debug mode to get a little more insight? Best, -k On Friday, March 21, 2014 10:16:17 AM UTC+1, Florent Bautista wrote: > Absolutely not. I haven't changed anything on ES cluster. > > The only recent change is updating Kafka version from 0.8.0 to 0.8.1 > because I had consummer errors in graylog2-server. This seems fixed but now > problem is at ES. > I can see in logs that Server connects to Kafka successfully. > > I cannot see any error in ES logs :( > > Do you know what does "shutting down" means in Server exception ? > > > On 03/21/2014 09:33 AM, Kay Röpke wrote: > > But you haven't by chance updated your elasticsearch version? > Or have any of the other settings changed? > On Mar 21, 2014 9:31 AM, "Florent Bautista" > <[email protected]<javascript:>> > wrote: > >> Hi >> >> On 03/20/2014 11:49 PM, Kay Röpke wrote: >> > >> > Have you restarted the graylog2 server as well? >> > >> >> Yes. Nothing better. >> >> > It sounds to me like the graylog2 server cannot talk to the cluster >> > anymore. Were there timeouts or errors in the elasticsearch logs? >> > >> >> Graylog2-server connects to ES successfully, I can see it in nodes of >> cluster and in logs of ES: >> >> [2014-03-21 09:28:22,925][INFO ][cluster.service ] [Albert] >> added >> >> {[graylog2-server][VXtb48JMQFaAA2ikTutI7A][inet[/10.111.12.171:9350]]{client=true, >> data=false, master=false},}, reason: zen-disco-receive(from master >> [[Headlok][2mwwLN_oTEekyHX37_UgqQ][inet[/10.111.20.13:9300]]]) >> >> But it seems that ES responds "shutting down"... I don't know what it >> means and how to fix it. >> Of course all nodes are UP and running.... >> >> > Best, >> > Kay >> > >> >> -- >> You received this message because you are subscribed to the Google Groups >> "graylog2" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > -- > You received this message because you are subscribed to the Google Groups > "graylog2" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] <javascript:>. > For more options, visit https://groups.google.com/d/optout. > > > -- You received this message because you are subscribed to the Google Groups "graylog2" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
