Hi everybody.
I am trying to delete a large number of triples of a very big graph. The
graph contains *217.609.545* triples and I want to delete all the triples
having a specific predicate (*64.884.016* triples).
I am trying to do it through the isql-v command line interface, using the
command:
SPARQL DEFINE sql:log-enable 3
WITH <graph>
DELETE { ?s <predicate> ?o }
WHERE{ ?s <predicate> ?o }
After some time (I don't know exactly how much) I got the error
*** Error 42000: [Virtuoso Driver][Virtuoso Server]FRVEC: array in for
> vectored over max vector length 2000000 > 1000000
> at line 1 of Top-Level:
I checked the virtuoso.log and I see nothing related to the specific error.
I changed the parameters in virtuoso.ini:
> MaxQueryMem = 8G ; from 2G
> VectorSize = 1000 ; not changed
> MaxVectorSize = 2000000 ; from 1000000
> AdjustVectorSize = 1 ; from 0
I am not very confident about these changes in virtuoso settings, but
checking the http://docs.openlinksw.com/virtuoso/dbadm.html these changes
seemed the right thing to do.
I restarted the VM and retried the whole process. After one hour, the
memory consumed by Virtuoso got around 100% and got an error:
> *** Error 08S01: [Virtuoso Driver]CL065: Lost connection to server
Please note that from previous similar errors, I already have the following
virtuoso.ini settings:
> NumberOfBuffers = 1360000
> MaxDirtyBuffers = 1000000
> ThreadCleanupInterval = 1
> ResourcesCleanupInterval = 1
My questions:
1. Is there any way to improve my query in order to facilitate its
processing? It is the first time I am doing a DELETE query and I am not
comfortable with it.
2. Is there any way to "split" the query so that it doesn't need to handle
all these triples at once?
3. Alternatively, is there any configuration change that might improve
memory handling in order to handle such big queries?
Kind regards,
Pantelis Natsiavas
------------------------------------------------------------------------------
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
