sergey-safarov opened a new issue #1119: Could not open shard URL: https://github.com/apache/couchdb/issues/1119 ## Expected Behavior CouchDB must open shards without any error. ## Current Behavior When replicated database from other server to standalone CouchDB time to time i see errors like this ``` Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:47.577647Z [email protected] <0.25708.3> -------- 10.0.9.10 - - GET / 200 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:47.880163Z [email protected] <0.25433.3> -------- Retrying GET request to http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/ in 4.0 seconds due to error {code,500} Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.893174Z [email protected] <0.25726.3> -------- Could not open file ./data/shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.893399Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.894595Z [email protected] <0.25730.3> -------- Could not open file ./data/shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.895033Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.895562Z [email protected] <0.25734.3> -------- Could not open file ./data/shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.895868Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.896352Z [email protected] <0.25738.3> -------- Could not open file ./data/shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.896630Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.897154Z [email protected] <0.25742.3> -------- Could not open file ./data/shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.897454Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.897923Z [email protected] <0.25746.3> -------- Could not open file ./data/shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.898239Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.898754Z [email protected] <0.25750.3> -------- Could not open file ./data/shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.899083Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.899571Z [email protected] <0.25754.3> -------- Could not open file ./data/shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch: no such file or directory Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 2018-01-15T10:34:47.899888Z [email protected] <0.206.0> -------- open_result error {not_found,no_db_file} for shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479 Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.900597Z [email protected] <0.25433.3> -------- Replicator, request GET to "http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" failed due to error {code,500} Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.900935Z [email protected] <0.25433.3> -------- exit:{http_error_code,500,<<"GET http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/">>}: Replication 77d0d1cc310aa875647f25011de294cf+create_target failed to start "http://217.12.247.210:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" -> "http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/" doc null:null stack:[{couch_replicator_api_wrap,db_open,3,[{file,"src/couch_replicator_api_wrap.erl"},{line,119}]},{couch_replicator_scheduler_job,init_state,1,[{file,"src/couch_replicator_scheduler_job.erl"},{line,590}]}] Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 2018-01-15T10:34:47.901167Z [email protected] <0.357.0> -------- couch_replicator_scheduler : Transient job {"77d0d1cc310aa875647f25011de294cf","+create_target"} failed, removing. Error: <<"{http_error_code,500,\n <<\"GET http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/\">>}">> Jan 15 10:34:48 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:48.682942Z [email protected] <0.25757.3> 8f8d36eae3 undefined 10.0.9.10 undefined GET / 200 ok 0 Jan 15 10:34:49 node0.docker.rcsnet.ru sh[1690]: [notice] 2018-01-15T10:34:49.578731Z [email protected] <0.25774.3> -------- 10.0.9.10 - - GET / 200 ``` ## Possible Solution Not sure but this may by thread sync issue. Similar error is described here for other erlang program. [link 1](https://github.com/2600hz/kazoo/pull/3809) [link2](https://2600hz.atlassian.net/browse/KAZOO-5354) ## Steps to Reproduce (for bugs) 1. start docker container 2. start replication about 1500 databases (total 25 Gb) from other server. ## Context I want migrate date from other CouchDB server. ## Your Environment * Version used: [docker image](https://hub.docker.com/r/apache/couchdb/) tag 2.1.1 * Browser Name and version: Google Chrome 63.0.3239.132 (Official Build) (64-bit) * Operating System and version (desktop or mobile): Fedora 27 + Docker 17.12.0-ce * Link to your project: none
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
