Looks like the data files of Etcd got somehow corrupted during the update: "etcdserver: read wal error: unexpected EOF" If this is a single host installation you can stop Etcd, delete the files in /var/opt/graylog/data/etcd and do a graylog-ctl reconfigure afterwards.
On 6 August 2015 at 11:11, Jochen Schalanda <[email protected]> wrote: > Hi, > > how did you upgrade from Graylog 1.1.4 to Graylog 1.1.5? Which appliance > (I guess that it's one of our virtual machine images…) are you using on > which hypervisor? > Did you try restarting etcd (which seems to be the culprit) with sudo > graylog-ctl restart etcd? You can see the logs with sudo graylog-ctl tail > etcd. > > > Cheers, > Jochen > > > On Thursday, 6 August 2015 11:06:32 UTC+2, Leittechnik SUN wrote: >> >> After upgrade from v 1.1.4 to 1.1.5 and reconfiguring graylog, i got the >> failure described above: >> ``` >> ruby_block[add node to server list] action run >> >> ================================================================================ >> Error executing action `run` on resource 'ruby_block[add node to >> server list]' >> >> ================================================================================ >> >> Errno::ECONNREFUSED >> ------------------- >> Connection refused - connect(2) for "127.0.0.1" port 4001 >> >> Cookbook Trace: >> --------------- >> /opt/graylog/embedded/cookbooks/graylog/libraries/registry.rb:17:in >> `set_master' >> >> /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:81:in >> `block (2 levels) in from_file' >> >> Resource Declaration: >> --------------------- >> # In /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb >> >> 79: ruby_block "add node to server list" do >> 80: block do >> 81: $registry.set_master >> 82: $registry.add_gl_server(node['ipaddress']) >> 83: $registry.add_es_node(node['ipaddress']) >> 84: end >> 85: end >> >> Compiled Resource: >> ------------------ >> # Declared in >> /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:79:in >> `from_file' >> >> ruby_block("add node to server list") do >> action "run" >> retries 0 >> retry_delay 2 >> default_guard_interpreter :default >> block_name "add node to server list" >> declared_type :ruby_block >> cookbook_name :graylog >> recipe_name "graylog-server" >> block #<Proc:0x000000042ee4e8@ >> /opt/graylog/embedded/cookbooks/graylog/recipes/graylog-server.rb:80> >> end >> >> >> Running handlers: >> [2015-07-31T10:00:16+02:00] ERROR: Running exception handlers >> Running handlers complete >> [2015-07-31T10:00:16+02:00] ERROR: Exception handlers complete >> [2015-07-31T10:00:16+02:00] FATAL: Stacktrace dumped to >> /opt/graylog/embedded/cookbooks/cache/chef-stacktrace.out >> Chef Client failed. 6 resources updated in 5.707804974 seconds >> [2015-07-31T10:00:16+02:00] ERROR: ruby_block[add node to server list] >> (graylog::graylog-server line 79) had an error: Errno::ECONNREFUSED: >> Connection refused - connect(2) for "127.0.0.1" port 4001 >> [2015-07-31T10:00:16+02:00] FATAL: Chef::Exceptions::ChildConvergeError: >> Chef run process exited unsuccessfully (exit code 1) >> >> Graylog seems running, because i get some stream alerts, but WEB-GUI can >> not be opened. >> I tested "sudo graylog-ctl restart etcd". >> Message after restart: ok: run: etcd: (pid 14919) 0s >> Then looked for errors in log with "sudo graylog-ctl tail etcd". This is >> my result (Logs entry every second): >> 2015-08-06_07:29:15.71893 2015/08/06 09:29:15 etcdserver: read wal error: >> unexpected EOF >> 2015-08-06_07:29:16.72284 2015/08/06 09:29:16 etcd: already initialized >> as member before, starting as etcd member... >> 2015-08-06_07:29:16.72381 2015/08/06 09:29:16 etcd: listening for peers >> on http://localhost:2380 >> 2015-08-06_07:29:16.72386 2015/08/06 09:29:16 etcd: listening for peers >> on http://localhost:7001 >> 2015-08-06_07:29:16.72390 2015/08/06 09:29:16 etcd: listening for client >> requests on http://0.0.0.0:2379 >> 2015-08-06_07:29:16.72394 2015/08/06 09:29:16 etcd: listening for client >> requests on http://0.0.0.0:4001 >> 2015-08-06_07:29:16.72403 2015/08/06 09:29:16 etcdserver: datadir is >> valid for the 2.0.1 format >> 2015-08-06_07:29:16.72679 2015/08/06 09:29:16 etcdserver: recovered store >> from snapshot at index 9150915 >> 2015-08-06_07:29:16.72687 2015/08/06 09:29:16 etcdserver: name = default >> 2015-08-06_07:29:16.72689 2015/08/06 09:29:16 etcdserver: data dir = >> /var/opt/graylog/data/etcd >> 2015-08-06_07:29:16.72691 2015/08/06 09:29:16 etcdserver: member dir = >> /var/opt/graylog/data/etcd/member >> 2015-08-06_07:29:16.72692 2015/08/06 09:29:16 etcdserver: heartbeat = >> 100ms >> 2015-08-06_07:29:16.72694 2015/08/06 09:29:16 etcdserver: election = >> 1000ms >> 2015-08-06_07:29:16.72695 2015/08/06 09:29:16 etcdserver: snapshot count >> = 10000 >> 2015-08-06_07:29:16.72697 2015/08/06 09:29:16 etcdserver: advertise >> client URLs = http://localhost:2379,http://localhost:4001 >> 2015-08-06_07:29:16.72700 2015/08/06 09:29:16 etcdserver: loaded cluster >> information from store: default=http://localhost:2380,default= >> http://localhost:7001 >> ``` >> so, what todo? >> > -- > You received this message because you are subscribed to the Google Groups > "Graylog Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/graylog2/a2132f21-5f17-4e35-b7eb-2fbefb89e4ef%40googlegroups.com > <https://groups.google.com/d/msgid/graylog2/a2132f21-5f17-4e35-b7eb-2fbefb89e4ef%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- Developer Tel.: +49 (0)40 609 452 077 Fax.: +49 (0)40 609 452 078 TORCH GmbH - A Graylog Company Steckelhörn 11 20457 Hamburg Germany https://www.graylog.com <https://www.torch.sh/> Commercial Reg. (Registergericht): Amtsgericht Hamburg, HRB 125175 Geschäftsführer: Lennart Koopmann (CEO) -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/CAMqbBbLY%3DhT43Ne55QCdn2LuZCKb3n6ES%3DTtO_6OnD6yfpuXig%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
