I'll be using 0.11.0 for the time being. Thanks! Hopefully a solution is on the way for the latest version of couchdb.
2010/9/27 Juhani Ränkimies <[email protected]> > I too, was able to reproduce the problem on couchdb 1.0.1, windows 7 > (32bit) . > > However, with 0.11.0 (+windows_file_fix_2.patch for compaction and db > deletion, http://github.com/juranki/couchdb/downloads) database size > does grow past 4GB (now 7.5GB and growing). > > -juhani > > On Mon, Sep 27, 2010 at 2:27 PM, Peter Somers <[email protected]> wrote: > > Thanks Cliff, > > > > At least it is reproducible. > > I hope you can come up with a solution. I don't know Erlang at all. > > > > If it is a limitation in Erlang, we are screwed. If it is a bug in > Couchdb, > > there is hope :-) > > > > Best regards, > > > > Peter > > > > > > > > 2010/9/27 Cliff Williams <[email protected]> > > > >> Peter, > >> > >> I had some time last night so I set up a fresh XP install with the > windows > >> binary from couchone. (I am interested in this since I am looking to set > up > >> couch on a number of windows machines.) > >> > >> I set up 5 clients to populate a test database with 2MB documents > >> .......... somewhat regretfully I can reproduce your issue without any > >> problems ie at exactly 4GB on a single database, couch falls over. In my > >> case couch will restart but any attempt to access the 4GB database will > >> knock it over again. > >> > >> Hopefully I will get some time this evening to dig deeper and write some > >> Erlang to find out a bit more. > >> > >> sorry that its not good news. > >> > >> best regards > >> > >> cliff > >> > >> > >> On 27/09/10 09:11, Peter Somers wrote: > >> > >>> Hi all, > >>> > >>> Just to summarize my previous thread, hoping that someone does know the > >>> answer to my problem. > >>> I want to thank everyone that already tried to help me. > >>> > >>> We have been using couchdb on Windows without any problems for a while > now > >>> in dev an test phases. > >>> Couchdb version 1.0.1, Windows 7 64bit. > >>> Database files where always around 2 GB. > >>> Our project enters productions phase, so I tried to load actual > production > >>> data in. > >>> Couchdb always crashes when the database file is exactly 4GB (around > >>> 250,000 > >>> different documents)! > >>> > >>> > >>> This is is couchdb's response after 4 GB of data: > >>> > >>> Status code:500 > >>> > >>> {"error":"{{badmatch,{error,enomem}}, > >>> > >>> [{couch_file,read_raw_iolist_int,3}, > >>> > >>> {couch_file,handle_call,3}, > >>> > >>> {gen_server,handle_msg,5}, > >>> > >>> > >>> > >>> > {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"} > >>> > >>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic server > >>> <0.227.0> terminating > >>> ** Last message in was {pread_iolist,4294943206} > >>> ** When Server state == > >>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}}, > >>> 0,4295016651} > >>> ** Reason for termination == > >>> ** file_corruption > >>> > >>> After restart, couchdb keeps crashing as long as the 4 GB db file is > >>> there. > >>> > >>> Possible solutions from the mailing list > >>> -Use NTFS instead of FAT32: I was already using NTFS > >>> -Check file quota settings: quotas management was disabled > >>> I tried to copy a 5 GB file into the DB folder without any problems > >>> -Run couchdb with the erlang console instead of as service: the same > error > >>> occurs > >>> -It could be an Erlang on Windows problem: I hope it is not, they would > >>> not > >>> support Couchdb on Windows if this was the case? > >>> > >>> Windows event log: > >>> This is what I found in the windows event log: > >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <Event xmlns="* > >>> http://schemas.microsoft.com/win/2004/08/events/event*";> > >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <System> > >>> > >>> <Provider Name="*Application Error*" /> > >>> <EventID Qualifiers="*0*">1000</EventID> > >>> <Level>2</Level> > >>> <Task>100</Task> > >>> <Keywords>0x80000000000000</Keywords> > >>> <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" /> > >>> <EventRecordID>43469</EventRecordID> > >>> <Channel>Application</Channel> > >>> <Computer>xxxxxxxx</Computer> > >>> <Security /> > >>> </System> > >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <EventData> > >>> > >>> <Data>*erl.exe*</Data> > >>> <Data>0.0.0.0</Data> > >>> <Data>4c25a0e8</Data> > >>> <Data>*beam.smp.dll*</Data> > >>> <Data>0.0.0.0</Data> > >>> <Data>4c259ee0</Data> > >>> <Data>40000015</Data> > >>> <Data>0001062a</Data> > >>> <Data>4ac</Data> > >>> <Data>01cb5bcdbb76622e</Data> > >>> <Data>C:\Program Files (x86)\Apache Software > >>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data> > >>> <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data> > >>> <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data> > >>> </EventData> > >>> </Event> > >>> > >>> > >>> crashdump excerpt: > >>> > >>> > https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ > >>> > >>> > >>> couchlog excerpt: > >>> > >>> > https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC > >>> > >>> To speed up my tests (to get faster to the 4 GB), I tried to upload big > >>> attachments (800MB) with futon. > >>> Couchdb always crashes during the upload. This may not be related to > this > >>> problem. > >>> > >>> Thanks, > >>> > >>> Peter > >>> > >>> > > > > > > -- > Juhani Ränkimies > +358 40 762 4323 >
