style95 commented on issue #1071: [Question] CouchDB crashed during benchmark URL: https://github.com/apache/couchdb/issues/1071#issuecomment-352336820 I found, memory usage of one node1 keep increasing until 95%, and suddenly all modules are restarted. Memory usage of other nodes(node2, 3) were stable under 40%. ``` [info] 2017-12-18T06:04:11.965787Z [email protected] <0.7.0> -------- Application couch_log started on node '[email protected]' [info] 2017-12-18T06:04:11.969249Z [email protected] <0.7.0> -------- Application folsom started on node '[email protected]' [info] 2017-12-18T06:04:11.998677Z [email protected] <0.7.0> -------- Application couch_stats started on node '[email protected]' [info] 2017-12-18T06:04:11.998838Z [email protected] <0.7.0> -------- Application khash started on node '[email protected]' [info] 2017-12-18T06:04:12.005142Z [email protected] <0.7.0> -------- Application couch_event started on node '[email protected]' [info] 2017-12-18T06:04:12.009451Z [email protected] <0.7.0> -------- Application ibrowse started on node '[email protected]' [info] 2017-12-18T06:04:12.013053Z [email protected] <0.7.0> -------- Application ioq started on node '[email protected]' [info] 2017-12-18T06:04:12.013204Z [email protected] <0.7.0> -------- Application mochiweb started on node '[email protected]' [info] 2017-12-18T06:04:12.018868Z [email protected] <0.201.0> -------- Apache CouchDB 2.1.1 is starting. [info] 2017-12-18T06:04:12.018999Z [email protected] <0.202.0> -------- Starting couch_sup [info] 2017-12-18T06:04:12.140996Z [email protected] <0.201.0> -------- Apache CouchDB has started. Time to relax. [info] 2017-12-18T06:04:12.141142Z [email protected] <0.201.0> -------- Apache CouchDB has started on http://any:5986/ [info] 2017-12-18T06:04:12.141225Z [email protected] <0.7.0> -------- Application couch started on node '[email protected]' [info] 2017-12-18T06:04:12.141311Z [email protected] <0.7.0> -------- Application ets_lru started on node '[email protected]' [info] 2017-12-18T06:04:12.163563Z [email protected] <0.7.0> -------- Application rexi started on node '[email protected]' [info] 2017-12-18T06:04:12.165314Z [email protected] <0.265.0> -------- Opening index for db: _users idx: _design/_auth sig: "3e823c2a4383ac0c18d4e574135a5b08" [info] 2017-12-18T06:04:12.177415Z [email protected] <0.291.0> -------- Opening index for db: _replicator idx: _design/_replicator sig: "3e823c2a4383ac0c18d4e574135a5b08" [error] 2017-12-18T06:04:12.197986Z [email protected] emulator -------- Error in process <0.308.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<19 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.198169Z [email protected] <0.254.0> -------- Error opening view group `subjects` from database `shards/e0000000-ffffffff/lambda-bmt_subjects.1513576321`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_subjects">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.209860Z [email protected] emulator -------- Error in process <0.343.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<22 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.210001Z [email protected] <0.254.0> -------- Error opening view group `logCleanup` from database `shards/c0000000-dfffffff/lambda-bmt_activations.1513576331`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_activations">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.212308Z [email protected] emulator -------- Error in process <0.350.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<11 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.212430Z [email protected] <0.254.0> -------- Error opening view group `_replicator` from database `shards/80000000-9fffffff/_replicator.1513576319`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"_replicator">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.218714Z [email protected] emulator -------- Error in process <0.366.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<22 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.218968Z [email protected] <0.254.0> -------- Error opening view group `whisks-filters.v2` from database `shards/80000000-9fffffff/lambda-bmt_activations.1513576331`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_activations">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.226318Z [email protected] emulator -------- Error in process <0.391.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<6 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.226595Z [email protected] <0.254.0> -------- Error opening view group `_auth` from database `shards/40000000-5fffffff/_users.1513576319`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"_users">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.236714Z [email protected] emulator -------- Error in process <0.425.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<17 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.236955Z [email protected] <0.254.0> -------- Error opening view group `whisks.v2` from database `shards/20000000-3fffffff/lambda-bmt_whisks.1513576330`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_whisks">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.239656Z [email protected] emulator -------- Error in process <0.429.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<22 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.239796Z [email protected] <0.254.0> -------- Error opening view group `whisks.v2` from database `shards/20000000-3fffffff/lambda-bmt_activations.1513576331`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_activations">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.243468Z [email protected] emulator -------- Error in process <0.442.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<19 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.243604Z [email protected] <0.254.0> -------- Error opening view group `snapshotFilters` from database `shards/00000000-1fffffff/lambda-bmt_subjects.1513576321`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_subjects">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.245585Z [email protected] emulator -------- Error in process <0.449.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<17 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.245828Z [email protected] <0.254.0> -------- Error opening view group `snapshotFilters` from database `shards/00000000-1fffffff/lambda-bmt_whisks.1513576330`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_whisks">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.248764Z [email protected] emulator -------- Error in process <0.453.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<22 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.248891Z [email protected] <0.254.0> -------- Error opening view group `snapshotFilters` from database `shards/00000000-1fffffff/lambda-bmt_activations.1513576331`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_activations">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [info] 2017-12-18T06:04:12.250156Z [email protected] <0.456.0> -------- Starting compaction for db "shards/00000000-1fffffff/_global_changes.1513576319" [notice] 2017-12-18T06:04:12.259997Z [email protected] <0.456.0> -------- Compaction swap for db: ./data/shards/00000000-1fffffff/_global_changes.1513576319.couch 5509326 49352 [info] 2017-12-18T06:04:12.260331Z [email protected] <0.456.0> -------- Compaction for db "shards/00000000-1fffffff/_global_changes.1513576319" completed. [error] 2017-12-18T06:04:12.260952Z [email protected] emulator -------- Error in process <0.465.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<15 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.265586Z [email protected] emulator -------- Error in process <0.481.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<16 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.265820Z [email protected] <0.254.0> -------- Error opening view group `namespaces` from database `shards/a0000000-bfffffff/service_mappings.1513576326`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"service_mappings">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [error] 2017-12-18T06:04:12.269434Z [email protected] emulator -------- Error in process <0.488.0> on node '[email protected]' with exit value: {badarg,[{ets,member,[mem3_openers,<<22 bytes>>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk... [error] 2017-12-18T06:04:12.269561Z [email protected] <0.254.0> -------- Error opening view group `activations` from database `shards/a0000000-bfffffff/lambda-bmt_activations.1513576331`: {'EXIT',{{badmatch,{badarg,[{ets,member,[mem3_openers,<<"lambda-bmt_activations">>],[]},{mem3_shards,maybe_spawn_shard_writer,3,[{file,"src/mem3_shards.erl"},{line,486}]},{mem3_shards,load_shards_from_db,2,[{file,"src/mem3_shards.erl"},{line,389}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,378}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,407}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,96}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,38}]},{couch_index_server,'-get_index/3-fun-0-',2,[{file,"src/couch_index_server.erl"},{line,68}]}]}},[{couch_mrview,get_info,2,[{file,"src/couch_mrview.erl"},{line,332}]},{couch_compaction_daemon,maybe_compact_view,3,[{file,"src/couch_compaction_daemon.erl"},{line,253}]},{couch_compaction_daemon,maybe_compact_views,3,[{file,"src/couch_compaction_daemon.erl"},{line,227}]},{couch_compaction_daemon,'-compact_loop/1-fun-0-',3,[{file,"src/couch_compaction_daemon.erl"},{line,141}]},{couch_server,'-all_databases/2-fun-0-',4,[{file,"src/couch_server.erl"},{line,278}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,184}]},{filelib,do_fold_files2,8,[{file,"filelib.erl"},{line,194}]},{couch_server,all_databases,2,[{file,"src/couch_server.erl"},{line,267}]}]}} [notice] 2017-12-18T06:04:12.379628Z [email protected] <0.269.0> -------- rexi_server_mon : cluster unstable [notice] 2017-12-18T06:04:12.379672Z [email protected] <0.272.0> -------- rexi_server_mon : cluster unstable [notice] 2017-12-18T06:04:12.379798Z [email protected] <0.267.0> -------- rexi_server : cluster unstable [notice] 2017-12-18T06:04:12.379926Z [email protected] <0.271.0> -------- rexi_buffer : cluster unstable [notice] 2017-12-18T06:04:12.404666Z [email protected] <0.269.0> -------- rexi_server_mon : cluster unstable [notice] 2017-12-18T06:04:12.404757Z [email protected] <0.272.0> -------- rexi_server_mon : cluster unstable [notice] 2017-12-18T06:04:12.404825Z [email protected] <0.267.0> -------- rexi_server : cluster unstable [notice] 2017-12-18T06:04:12.404877Z [email protected] <0.271.0> -------- rexi_buffer : cluster unstable [info] 2017-12-18T06:04:12.417694Z [email protected] <0.7.0> -------- Application mem3 started on node '[email protected]' [info] 2017-12-18T06:04:12.417779Z [email protected] <0.7.0> -------- Application fabric started on node '[email protected]' [info] 2017-12-18T06:04:12.478630Z [email protected] <0.7.0> -------- Application chttpd started on node '[email protected]' [info] 2017-12-18T06:04:12.529773Z [email protected] <0.7.0> -------- Application couch_index started on node '[email protected]' [info] 2017-12-18T06:04:12.529875Z [email protected] <0.7.0> -------- Application couch_mrview started on node '[email protected]' [info] 2017-12-18T06:04:12.529942Z [email protected] <0.7.0> -------- Application couch_plugins started on node '[email protected]' [notice] 2017-12-18T06:04:12.773666Z [email protected] <0.88.0> -------- config: [features] scheduler set to true for reason nil [notice] 2017-12-18T06:04:12.839556Z [email protected] <0.874.0> 96b227aa8c 10.113.130.91:5984 10.66.100.4 admin GET /_active_tasks 200 ok 90 [info] 2017-12-18T06:04:12.967585Z [email protected] <0.7.0> -------- Application couch_replicator started on node '[email protected]' [info] 2017-12-18T06:04:12.984160Z [email protected] <0.7.0> -------- Application couch_peruser started on node '[email protected]' [info] 2017-12-18T06:04:13.005258Z [email protected] <0.7.0> -------- Application ddoc_cache started on node '[email protected]' [info] 2017-12-18T06:04:13.031852Z [email protected] <0.7.0> -------- Application global_changes started on node '[email protected]' [info] 2017-12-18T06:04:13.032102Z [email protected] <0.7.0> -------- Application jiffy started on node '[email protected]' [info] 2017-12-18T06:04:13.045481Z [email protected] <0.7.0> -------- Application mango started on node '[email protected]' [info] 2017-12-18T06:04:13.055213Z [email protected] <0.7.0> -------- Application setup started on node '[email protected]' [info] 2017-12-18T06:04:13.055272Z [email protected] <0.7.0> -------- Application snappy started on node '[email protected] ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
