Hi Rumi, thanks for the hint. Btw, do I need to restart the server in order for these changes in the virtuoso.ini to become active?
(I remember that DirsAllowed auto refresh, what about the buffer count?) Harald ----- Original Message ----- From: "Rumi" <[email protected]> To: "Harald Beck" <[email protected]> Cc: [email protected] Sent: Wednesday, March 20, 2013 3:57:20 PM Subject: Re: [Virtuoso-users] Parallel WebDAV uploads fail Hello Harald, On 20-Mar-13 3:24 PM, Harald Beck wrote: > Hi, > > If I upload multiple files at the same time to the WebDAV folder, > different errors occur, and I receive a 599 internal server error > response for some of the requests. > > I use requests of the following form: > > curl -i -T $dir/$file > http://localhost:8890/DAV/home/username/targetfolder/$file -u > username:password > > I upload about 10 ttl files in parallel, ranging between 1 and 800 > MB. (I also got the problem in one attempt with 4 parallel request > with files smaller than 100 MB.) > > It works fine for single requests. On multple requests, I get different error > messages (see below). > > Is importing to WebDAV limited to a single request? If not, what's the > problem and/or what can I try? > > Best, > Harald > > > ERROR LOG 1: > > 12:10:30 INFO: Failed to get a buffer for a new page. Retrying. If the > failure repeats, an out of disk error will be signalled. The cause of this > is having too many buffers wired down for preread, flush or group by/hash > join temp space. To correct, increase the number of buffers in the > configuration file. If this repeats in spite of having hundreds of thousands > of buffers, please report to support. > 12:10:31 ERROR: Signaling out of disk due to failure to get a buffer. This > condition is not a case of running out of disk > 12:10:31 ERROR: Out of disk space for database You should increase the number of buffers + MaxDirtyBuffers in your virtuoso ini file. So for ex.: NumberOfBuffers = 500000 MaxDirtyBuffers = 400000 Note that these values are approximate depending on the RAM of your machine has etc. Best Regards, Rumi > > (Since I don't how many 'hundreds of thousands' exactly are, I omitted this > option.) > > ERROR LOG 2: > > 12:50:50 INFO: Checkpoint started > 12:50:50 ERROR: suspect to miss a flush of L=563838 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=571411 in cpt, line 905 > 12:50:50 ERROR: Buffer 0x7fc3a1ff59b8 occupied in cpt > 12:50:50 ERROR: Buffer 0x7fc3a6218f88 occupied in cpt > 12:50:50 ERROR: suspect to miss a flush of L=563838 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=571411 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=563838 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=571411 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=563838 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=571411 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=563838 in cpt, line 905 > 12:50:50 ERROR: suspect to miss a flush of L=571411 in cpt, line 905 > 12:50:50 ERROR: Buffer 0x7fc3a1ff59b8 occupied in cpt > 12:50:50 ERROR: Buffer 0x7fc3a1ff59b8 dirty but no remap, tree SYS_DAV_RES > 12:50:50 ERROR: Buffer 0x7fc3a6218f88 occupied in cpt > 12:50:50 ERROR: Buffer 0x7fc3a6218f88 dirty but no remap, tree SYS_DAV_RES > 12:50:50 INFO: Checkpoint finished, log reused > 12:50:50 ERROR: Buffer 0x7fc3a1ff59b8 occupied in cpt > 12:50:50 ERROR: Buffer 0x7fc3a1ff59b8 dirty but no remap, tree SYS_DAV_RES > 12:50:50 ERROR: Buffer 0x7fc3a6218f88 occupied in cpt > 12:50:50 ERROR: Buffer 0x7fc3a6218f88 dirty but no remap, tree SYS_DAV_RES > > -- Harald Beck Software Developer Semantic Web Company GmbH Mariahilfer Straße 70 / 8 A - 1070 Vienna, Austria Tel +43 1 402 12 35 Fax +43 1 402 12 35 - 22 http://www.semantic-web.at http://blog.semantic-web.at http://poolparty.biz LOD2 - Creating Knowledge out of Interlinked Data - http://lod2.eu/ ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ Virtuoso-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/virtuoso-users
