Could be just some build configuration for Erlang on Windows. I don't have any experience with building Erland, especially not on Windows, but it could be just some 32-bit limitation in the Erlang build that is being used. CouchDB is certainly able to handle files larger than 4 GB, at least on Unix-like platforms.
Nils. ________________________________________ Van: Peter Somers [[email protected]] Verzonden: maandag 27 september 2010 13:27 Aan: [email protected] Onderwerp: Re: Recap: Couchdb crashes on Windows Thanks Cliff, At least it is reproducible. I hope you can come up with a solution. I don't know Erlang at all. If it is a limitation in Erlang, we are screwed. If it is a bug in Couchdb, there is hope :-) Best regards, Peter 2010/9/27 Cliff Williams <[email protected]> > Peter, > > I had some time last night so I set up a fresh XP install with the windows > binary from couchone. (I am interested in this since I am looking to set up > couch on a number of windows machines.) > > I set up 5 clients to populate a test database with 2MB documents > .......... somewhat regretfully I can reproduce your issue without any > problems ie at exactly 4GB on a single database, couch falls over. In my > case couch will restart but any attempt to access the 4GB database will > knock it over again. > > Hopefully I will get some time this evening to dig deeper and write some > Erlang to find out a bit more. > > sorry that its not good news. > > best regards > > cliff > > > On 27/09/10 09:11, Peter Somers wrote: > >> Hi all, >> >> Just to summarize my previous thread, hoping that someone does know the >> answer to my problem. >> I want to thank everyone that already tried to help me. >> >> We have been using couchdb on Windows without any problems for a while now >> in dev an test phases. >> Couchdb version 1.0.1, Windows 7 64bit. >> Database files where always around 2 GB. >> Our project enters productions phase, so I tried to load actual production >> data in. >> Couchdb always crashes when the database file is exactly 4GB (around >> 250,000 >> different documents)! >> >> >> This is is couchdb's response after 4 GB of data: >> >> Status code:500 >> >> {"error":"{{badmatch,{error,enomem}}, >> >> [{couch_file,read_raw_iolist_int,3}, >> >> {couch_file,handle_call,3}, >> >> {gen_server,handle_msg,5}, >> >> >> >> {proc_lib,init_p_do_apply,3}]}","reason":"{gen_server,call,[<0.19884.5>,{pread_iolist,4294426050},infinity]}"} >> >> [Sat, 25 Sep 2010 16:59:17 GMT] [error] [<0.227.0>] ** Generic server >> <0.227.0> terminating >> ** Last message in was {pread_iolist,4294943206} >> ** When Server state == >> {file,{file_descriptor,prim_file,{#Port<0.3730>,680}}, >> 0,4295016651} >> ** Reason for termination == >> ** file_corruption >> >> After restart, couchdb keeps crashing as long as the 4 GB db file is >> there. >> >> Possible solutions from the mailing list >> -Use NTFS instead of FAT32: I was already using NTFS >> -Check file quota settings: quotas management was disabled >> I tried to copy a 5 GB file into the DB folder without any problems >> -Run couchdb with the erlang console instead of as service: the same error >> occurs >> -It could be an Erlang on Windows problem: I hope it is not, they would >> not >> support Couchdb on Windows if this was the case? >> >> Windows event log: >> This is what I found in the windows event log: >> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <Event xmlns="* >> http://schemas.microsoft.com/win/2004/08/events/event*";> >> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <System> >> >> <Provider Name="*Application Error*" /> >> <EventID Qualifiers="*0*">1000</EventID> >> <Level>2</Level> >> <Task>100</Task> >> <Keywords>0x80000000000000</Keywords> >> <TimeCreated SystemTime="*2010-09-24T09:50:57.000000000Z*" /> >> <EventRecordID>43469</EventRecordID> >> <Channel>Application</Channel> >> <Computer>xxxxxxxx</Computer> >> <Security /> >> </System> >> -<?ui=2&view=bsp&ver=ohhl4rw8mbn4#12b488d84095eff0_> <EventData> >> >> <Data>*erl.exe*</Data> >> <Data>0.0.0.0</Data> >> <Data>4c25a0e8</Data> >> <Data>*beam.smp.dll*</Data> >> <Data>0.0.0.0</Data> >> <Data>4c259ee0</Data> >> <Data>40000015</Data> >> <Data>0001062a</Data> >> <Data>4ac</Data> >> <Data>01cb5bcdbb76622e</Data> >> <Data>C:\Program Files (x86)\Apache Software >> Foundation\CouchDB\erts-5.8\bin\erl.exe</Data> >> <Data>C:\PROGRA~2\APACHE~1\CouchDB\erts-5.8\bin\beam.smp.dll</Data> >> <Data>3a3a07c6-c7c1-11df-a821-c9b233f5989f</Data> >> </EventData> >> </Event> >> >> >> crashdump excerpt: >> >> https://docs.google.com/Doc?docid=0Ac5wgE-Tye0oZGQ2cjU1Z2tfMThkNjl3Yzdnag&hl=nl&authkey=CJfN2pQJ >> >> >> couchlog excerpt: >> >> https://docs.google.com/document/edit?id=1K_cWU4bwDSPa0UYxF8mOiAwC7-zhTHhWsigUNZHuQdM&hl=nl&authkey=CPCV9vYC >> >> To speed up my tests (to get faster to the 4 GB), I tried to upload big >> attachments (800MB) with futon. >> Couchdb always crashes during the upload. This may not be related to this >> problem. >> >> Thanks, >> >> Peter >> >> ------------------------------------------------------------------------ VPRO phone: +31(0)356712911 e-mail: [email protected] web: www.vpro.nl ------------------------------------------------------------------------
