It would definitely be worth putting this information (especially about the regression from 0.11) into Jira:
https://issues.apache.org/jira/browse/COUCHDB The committers don't use much Windows, although we'd love to support it completely. If someone were to step up to the plate and make Windows a 1st-class citizen of the CouchDB world, thats the sort of thing that'd qualify you for consideration as a committer. (I can't speak for the group, but I do think this is an overlooked yet crucial aspect of getting CouchDB popular). Chris On Mon, Sep 27, 2010 at 2:06 PM, Peter Somers <[email protected]> wrote: > I'll be using 0.11.0 for the time being. > Thanks! > > Hopefully a solution is on the way for the latest version of couchdb. > > > > 2010/9/27 Juhani Ränkimies <[email protected]> > >> I too, was able to reproduce the problem on couchdb 1.0.1, windows 7 >> (32bit) . >> >> However, with 0.11.0 (+windows_file_fix_2.patch for compaction and db >> deletion, http://github.com/juranki/couchdb/downloads) database size >> does grow past 4GB (now 7.5GB and growing). >> >> -juhani >> >> On Mon, Sep 27, 2010 at 2:27 PM, Peter Somers <[email protected]> wrote: >> > Thanks Cliff, >> > >> > At least it is reproducible. >> > I hope you can come up with a solution. I don't know Erlang at all. >> > >> > If it is a limitation in Erlang, we are screwed. If it is a bug in >> Couchdb, >> > there is hope :-) >> > >> > Best regards, >> > >> > Peter >> > >> > >> > >> > 2010/9/27 Cliff Williams <[email protected]> >> > >> >> Peter, >> >> >> >> I had some time last night so I set up a fresh XP install with the >> windows >> >> binary from couchone. (I am interested in this since I am looking to set >> up >> >> couch on a number of windows machines.) >> >> >> >> I set up 5 clients to populate a test database with 2MB documents >> >> .......... somewhat regretfully I can reproduce your issue without any >> >> problems ie at exactly 4GB on a single database, couch falls over. In my >> >> case couch will restart but any attempt to access the 4GB database will >> >> knock it over again. >> >> >> >> Hopefully I will get some time this evening to dig deeper and write some >> >> Erlang to find out a bit more. >> >> >> >> sorry that its not good news. >> >> >> >> best regards >> >> >> >> cliff >> >> >> >> >> >> On 27/09/10 09:11, Peter Somers wrote: >> >> >> >>> Hi all, >> >>> >> >>> Just to summarize my previous thread, hoping that someone does know the >> >>> answer to my problem. >> >>> I want to thank everyone that already tried to help me. >> >>> >> >>> We have been using couchdb on Windows without any problems for a while >> now >> >>> in dev an test phases. >> >>> Couchdb version 1.0.1, Windows 7 64bit. >> >>> Database files where always around 2 GB. >> >>> Our project enters productions phase, so I tried to load actual >> production >> >>> data in. >> >>> Couchdb always crashes when the database file is exactly 4GB (around >> >>> 250,000 >> >>> different documents)! >> >>> >> >>> >> >>> This is is couchdb's response after 4 GB of data: >> >>> >> >>> Status code:500 >> >>> >> >>> {"error":"{{badmatch,{error,enomem}}, >> >>> >> >>> [{couch_file,read_raw_iolist_int,3}, >> >>> >> >>> {couch_file,handle_call,3}, >> >>> >> >>> {gen_server,handle_msg,5}, >> >>> >> >>> >> >>> >> >>> >> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"} >> >>> >> >>> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic server >> >>> <0.227.0> terminating >> >>> ** Last message in was {pread_iolist,4294943206} >> >>> ** When Server state == >> >>> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}}, >> >>> 0,4295016651} >> >>> ** Reason for termination == >> >>> ** file_corruption >> >>> >> >>> After restart, couchdb keeps crashing as long as the 4 GB db file is >> >>> there. >> >>> >> >>> Possible solutions from the mailing list >> >>> -Use NTFS instead of FAT32: I was already using NTFS >> >>> -Check file quota settings: quotas management was disabled >> >>> I tried to copy a 5 GB file into the DB folder without any problems >> >>> -Run couchdb with the erlang console instead of as service: the same >> error >> >>> occurs >> >>> -It could be an Erlang on Windows problem: I hope it is not, they would >> >>> not >> >>> support Couchdb on Windows if this was the case? >> >>> >> >>> Windows event log: >> >>> This is what I found in the windows event log: >> >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <Event xmlns="* >> >>> http://schemas.microsoft.com/win/2004/08/events/event*";> >> >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <System> >> >>> >> >>> <Provider Name="*Application Error*" /> >> >>> <EventID Qualifiers="*0*">1000</EventID> >> >>> <Level>2</Level> >> >>> <Task>100</Task> >> >>> <Keywords>0x80000000000000</Keywords> >> >>> <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" /> >> >>> <EventRecordID>43469</EventRecordID> >> >>> <Channel>Application</Channel> >> >>> <Computer>xxxxxxxx</Computer> >> >>> <Security /> >> >>> </System> >> >>> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <EventData> >> >>> >> >>> <Data>*erl.exe*</Data> >> >>> <Data>0.0.0.0</Data> >> >>> <Data>4c25a0e8</Data> >> >>> <Data>*beam.smp.dll*</Data> >> >>> <Data>0.0.0.0</Data> >> >>> <Data>4c259ee0</Data> >> >>> <Data>40000015</Data> >> >>> <Data>0001062a</Data> >> >>> <Data>4ac</Data> >> >>> <Data>01cb5bcdbb76622e</Data> >> >>> <Data>C:\Program Files (x86)\Apache Software >> >>> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data> >> >>> <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data> >> >>> <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data> >> >>> </EventData> >> >>> </Event> >> >>> >> >>> >> >>> crashdump excerpt: >> >>> >> >>> >> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ >> >>> >> >>> >> >>> couchlog excerpt: >> >>> >> >>> >> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC >> >>> >> >>> To speed up my tests (to get faster to the 4 GB), I tried to upload big >> >>> attachments (800MB) with futon. >> >>> Couchdb always crashes during the upload. This may not be related to >> this >> >>> problem. >> >>> >> >>> Thanks, >> >>> >> >>> Peter >> >>> >> >>> >> > >> >> >> >> -- >> Juhani Ränkimies >> +358 40 762 4323 >> > -- Chris Anderson http://jchrisa.net http://couch.io
