Compactation failure when *.compact file reach 2116687115 (ap. 2GB) size
------------------------------------------------------------------------
Key: COUCHDB-149
URL: https://issues.apache.org/jira/browse/COUCHDB-149
Project: CouchDB
Issue Type: Bug
Components: Database Core
Affects Versions: 0.8.1
Environment: Ubuntu 8.04 2.6.24-21-generic x86_64 GNU/Linux processor
Duo 2 Quad, 8 GB RAM
Reporter: Paweł Melon
CouchDB is has been working 3 days without stop. I tried to insert large amount
of data. From time to time I was doing compactation.
One when database has 50GB of size and 3 mln records, then tried second time
when there was 4,7 mln records and 12 GB but something failed. I tried to
restart compaction from futon interface but it wasn't working.
On console where was working inserting script written in erlang I received
message.
Err add {event,{session,965,3,2005718},
{session_data,os,"Ubuntu 8.10",icecast,"WinampMPEG/5.53"},
{listener,999999999999999,12301897,"85.112.221.200"},
1213297703,undefined,21,undefined,undefined} {ok,
{{"HTTP/1.1",
500,
"Internal
Server Error"},
[{"cache-control",
"must-revalidate"},
{"date",
"Fri, 31 Oct
2008 19:13:43 GMT"},
{"server",
"CouchDB/0.8.1-incubating (Erlang OTP/R12B)"},
{"content-length",
"1665"},
{"content-type",
"text/plain;charset=utf-8"}],
"{\"error\":\"EXIT\",\"reason\":\"{{function_clause,\\n
[{couch_db,'-copy_docs\\/3-fun-0-',\\n [not_found,<0.24367.262>,\\n
{stream,<0.25264.262>,<0.25263.262>},\\n <0.25263.262>]},\\n
{lists,map,2},\\n {lists,map,2},\\n {couch_db,copy_docs,3},\\n
{couch_db,'-copy_compact_docs\\/2-fun-0-',4},\\n
{couch_btree,stream_kv_node2,7},\\n {couch_btree,stream_kp_node,6},\\n
{couch_btree,stream_kp_node,7}]},\\n {gen_server,call,\\n
[<0.24368.262>,\\n {update_docs,\\n
[[{doc,\\\"965:3:2005718\\\",\\n [\\\"102178913\\\"],\\n
{obj,\\n [{\\\"type\\\",\\\"event\\\"},\\n
{\\\"session\\\",\\n {obj,\\n
[{\\\"server_id\\\",965},\\n
{\\\"instance_id\\\",3},\\n
{\\\"id\\\",2005718}]}},\\n {\\\"session_data\\\",\\n
{obj,\\n
[{\\\"origin\\\",\\\"os\\\"},\\n
{\\\"os_type\\\",\\\"Ubuntu 8.10\\\"},\\n
{\\\"server_type\\\",\\\"icecast\\\"},\\n
{\\\"player\\\",\\\"WinampMPEG\\/5.53\\\"}]}},\\n
{\\\"listener\\\",\\n {obj,\\n
[{\\\"pid\\\",999999999999999},\\n
{\\\"gg\\\",12301897},\\n
{\\\"ip\\\",\\\"85.112.221.200\\\"}]}},\\n
{\\\"start_time\\\",1213297703},\\n
{\\\"end_time\\\",\\\"undefined\\\"},\\n
{\\\"channel\\\",21},\\n
{\\\"intro\\\",\\\"undefined\\\"}]},\\n [],false,[]}]],\\n
[new_edits]},\\n infinity]}}\"}"}}
I think that the most important part is error reason:
"{\"error\":\"EXIT\",\"reason\":\"{{function_clause,\\n
[{couch_db,'-copy_docs\\/3-fun-0-',\\n [not_found,<0.24367.262>,\\n
{stream,<0.25264.262>,<0.25263.262>},\\n <0.25263.262>]},\\n
{lists,map,2},\\n {lists,map,2},\\n {couch_db,copy_docs,3},\\n
{couch_db,'-copy_compact_docs\\/2-fun-0-',4},\\n
{couch_btree,stream_kv_node2,7},\\n {couch_btree,stream_kp_node,6},\\n
{couch_btree,stream_kp_node,7}]},\\n {gen_server,call,\\n
[<0.24368.262>,\\n {update_docs,\\n
[[{doc,\\\"965:3:2005718\\\",\\n [\\\"102178913\\\"],\\n
{obj,\\n [{\\\"type\\\",\\\"event\\\"},\\n
{\\\"session\\\",\\n {obj,\\n
[{\\\"server_id\\\",965},\\n
or second time
"{\"error\":\"EXIT\",\"reason\":\"{noproc,{gen_server,call,\\n
[<0.25341.262>,{pread_bin,18695772967},infinity]}}\"}"}
It is strange that compaction alway failed when *.compact file has 2116687115
or 2116963527 bytes of size. Always approximately 2GB.
Is it bug? or there is some config parameter which says about result compact
file size. If here is one, why file before compaction can has 50 GB size?
Im sory for my poor English.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
