Hi Thomas, Is the loading of the dataset now complete or it is still in progress as you opening statement is not clear ?
You should not need 40GB RAM for inserting and hosting 240 million triples, which should require less then 10GB depending on how well they can be compressed for storage in the database. I assume you have set the swappiness as suggested previously ? When you recompiled your Virtuoso was this done from the git stable/7 or develop/7 branch , as I latter has a number of memory consumption fixes that would not be in stable/7, thus I would suggest building from develop/7. Have you provided a copy of your INI file previously, if not can you provide a copy ? Do ensure the following params are set to 1 in order to clean up unused threads/resources and reduce memory consumption of the Virtuoso server, which can otherwise be construed as memory leaks.: ThreadCleanupInterval = 1 ResourcesCleanupInterval = 1 Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Google+ -- http://plus.google.com/100570109519069333827/ Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers > On 15 Mar 2017, at 17:08, Thomas Michaux <mich...@abes.fr> wrote: > > Hello, > > FYI, virtuoso still loading but we needed to increase memory ressources, > now the process use almost 40GB of ram : > > [devel@tulipe-test2 ~]$ ./memcheck-virtuoso.sh > 2017-03-15T17:54 VmSize: 41273424kB 5883 > > stats for the graph <http://hub.abes.fr/referentiel/ORCID/2016> (forget > to mention, it's the only graph in db) : > > 239 451 028 triples > > > this:Dataset a void:Dataset ; > rdfs:seeAlso <http://hub.abes.fr/referentiel/ORCID/2016> ; > rdfs:label "" ; > void:sparqlEndpoint <http://idrefplus.v102.abes.fr:8890/sparql> ; > void:triples 239451028 ; > void:classes 13 ; > void:entities 57692917 ; > void:distinctSubjects 57650847 ; > void:properties 32 ; > void:distinctObjects 72219514 . > > this:sameAsLinks a void:Linkset ; > void:inDataset this:Dataset ; > void:triples 997389 ; > void:linkPredicate owl:sameAs . > > > Le 14/03/2017 à 10:05, Thomas Michaux a écrit :
smime.p7s
Description: S/MIME cryptographic signature
------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
