Hi all, we are trying to perform on a Virtuoso Instance (version 7.2.2) a bulk loading of 100 ttl files using the command rdf_loader_run() with 2 cores (I have 7 cores totally on the machine). The size of every file is approximately 200 MB.
Our virtual machine where Virtuoso is running has 32 GB of memory totally. In the virtuoso.ini file we have setup the following parameters NumberOfBuffers = 2720000 MaxDirtyBuffers = 2000000 following the advice for system with 32 GB. It happened that after loading roughly 50 files the memory of the Virtuoso process (and of the entire machine) was completely exhausted causing the the stop of the Virtuoso process due to the complete freezing of the machine (all the 32 GB were used). So we decided to tune the above parameters in order to allow Virtuoso to use up to 16 GB and the total loading was successful even if it was slow because Virtuoso quickly used all the available memory (16 GB). The only difference was that the machine was not struggling (still 16 GB free totally) and therefore Virtuoso process was able to work. My question is how can I prevent Virtuoso to use all its available memory? Or how can I tell Virtuoso to perform a better management of the memory releasing it when it is not needed anymore? I assume that in the batch loading procedure once a file is loaded Virtuoso could remove completely from the memory what ever is connected to it immediately. But it seems that Virtuoso starts to remove things from the memory only when it is running out of it. Thanks very much, Francesco ------------------------------------------------------------------------------ Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140 _______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
