Virtuoso log snippet: 23:28:12 PL LOG: Loader started 23:33:08 Memory low! Using memory reserve to terminate current activities properly 23:33:08 Current location of the program break 146526208 23:33:08 Current location of the program break 146526208 23:33:08 GPF: Dkernel.c:5286 Out of memory
The triple count would be around 7765408. On Wed, Jan 5, 2011 at 7:22 PM, Hugh Williams <[email protected]>wrote: > Hi Abhi, > > You config params for NumberOfBuffers etc look of for the machine > configuration, are any errors reported in the "virtuoso.log" file indicating > this out of memory condition, please provide a log snippet ? > > Also, the latest virtuoso open source is 06.01.3127 from July 2010 on > source forge, whichI would recommend you download and compile to see if this > has the same issue: > > http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VOSDownload > > What is the triple count of the datasets being loaded ? > > Best Regards > Hugh Williams > Professional Services > OpenLink Software > Web: http://www.openlinksw.com > Support: http://support.openlinksw.com > Forums: http://boards.openlinksw.com/support > Twitter: http://twitter.com/OpenLink > > On 5 Jan 2011, at 09:53, Abhi wrote: > > > I am running Virtuoso version 0.6.01.3126 built on Feb 19 2010 on a 32 > bit Ubuntu server box(headless) running on a 64 bit machine with 4 Gb ram. I > am trying to do some bulk triple loading using ld_dir and rdf_loader_run > commands. If I do the loading with the default configuration parameters then > everything goes fine. If I try to do the same with changed parameters, I run > into out of memory problem. > > > > I am planning to assign 50% of the system memory to virtuoso. So assuming > each buffer takes around 8.7kb, I arrived at the buffer no as below: > > Half of 4gb ram is 2048 Mb that translates to 2048Mb/8.7kb = 246837 no of > buffers. > > Maximum dirty buffers are supposed to be 3/4th of the no of buffers, > hence 3/4 of 246837 = 185127 > > > > NumberOfBuffers = 246837 > > MaxDirtyBuffers = 18517 > > MaxCheckpointRemap(Database and temp database) = 246837 > > > > If I use these parameter values, then the server shuts down sometime > after starting the loading saying out of memory. If I monitor top during > this period, I see the memory usage starting at around 2Gb and going up till > around 80% of the system memory and then it dies. Am I doing something wrong > here? > > > > -- > > Cheers, > > Abhi > > > ------------------------------------------------------------------------------ > > Learn how Oracle Real Application Clusters (RAC) One Node allows > customers > > to consolidate database storage, standardize their database environment, > and, > > should the need arise, upgrade to a full multi-node Oracle RAC database > > without downtime or disruption > > > http://p.sf.net/sfu/oracle-sfdevnl_______________________________________________ > > Virtuoso-users mailing list > > [email protected] > > https://lists.sourceforge.net/lists/listinfo/virtuoso-users > > -- Cheers, Abhi
