Any idea what might have caused the second crash, at bottom of this email?
Yesterday the same CouchDB server went down like this and didn't come back up:
-- first crash
heart: Wed Oct 8 10:31:25 2014: Erlang has closed.
Segmentation fault (core dumped)
sh: echo: I/O error
heart: Wed Oct 8 10:31:26 2014: Executed
"/home/natevw/bc16/build/bin/couchdb -k" -> 256. Terminating.
…which have been because I was just starting it from crontab and hoping the `-b
-r 5` options would actually work. By today I've got the daemonization more
properly setup, using upstart and its respawn option.
No big outage today, however I did notice another crash in the logs — I'd like
to avoid the daemon restarting at all in routine use if possible. I don't see
anything particularly useful/interesting as to the cause of the crash…does the
backtrace below imply anything in particular?
The main difference the last two days is that this system is now back under
some load (maybe 50 users, up from maybe one or two in preceding weeks). Right
now (under "higher" load) the server is showing "0.00, 0.01, 0.05" load average
and 2.6 of 3.7GB memory free, so it doesn't seem offhand we're pushing the
system too hard. Besides basic reads/writes/view stuff, we still haven't
migrated off use of per-user filtered changes, which is the only thing I can
think might lead to a load-related problem.
thanks,
-natevw
-- second crash
[Thu, 09 Oct 2014 15:23:24 GMT] [info] [<0.21979.2>] 127.0.0.1 - - GET
/production-db/org.couchdb.user%3Au123456 200
[Thu, 09 Oct 2014 15:23:26 GMT] [error] [<0.108.0>] {error_report,<0.31.0>,
{<0.108.0>,crash_report,
[[{initial_call,
{mochiweb_acceptor,init,
['Argument__1','Argument__2','Argument__3']}},
{pid,<0.108.0>},
{registered_name,[]},
{error_info,
{exit,
{noproc,
{gen_server,call,[couch_httpd_vhost,get_state]}},
[{gen_server,call,2,
[{file,"gen_server.erl"},{line,180}]},
{couch_httpd_vhost,dispatch_host,1,
[{file,
"/home/natevw/bc16/dependencies/couchdb/src/couchdb/couch_httpd_vhost.erl"},
{line,96}]},
{couch_httpd,handle_request,5,
[{file,
"/home/natevw/bc16/dependencies/couchdb/src/couchdb/couch_httpd.erl"},
{line,217}]},
{mochiweb_http,headers,5,
[{file,
"/home/natevw/bc16/dependencies/couchdb/src/mochiweb/mochiweb_http.erl"},
{line,94}]},
{proc_lib,init_p_do_apply,3,
[{file,"proc_lib.erl"},{line,239}]}]}},
{ancestors,
[couch_httpd,couch_secondary_services,
couch_server_sup,<0.32.0>]},
{messages,[]},
{links,[<0.107.0>,#Port<0.2017>]},
{dictionary,[{couch_rewrite_count,0}]},
{trap_exit,false},
{status,running},
{heap_size,2586},
{stack_size,27},
{reductions,1173}],
[]]}}
[Thu, 09 Oct 2014 15:23:26 GMT] [info] [<0.32.0>] Apache CouchDB has started on
http://127.0.0.1:55984/