Hi guys, First of all, thanks for all the suggestions. I changed my settings according to your suggestions, and at first the problem was the same (100% CPU for quite a while when deleting triples) but after a while (~10 minutes) Virtuoso completed the action and now the tool seems to be running ok. I'm afraid I don't know which of the settings did finally got it to work.
I have one more problem with the dbpintegrator tool however. I set the date in my lastDownloadDate.dat to 2011-09-10-00-000000, but the tool seems to start at the first file of the current hour (2011-09-16-16-000001), could this be a bug? @Mohamed: It really did take two days to fill the store with the DBpedia live dump. Initially it was fast, but it got slower and slower. There already was the default DBpedia dump (not the live version) inserted into another graph, maybe the amount of triples is just too large? How fast should it (more or less) take to load the live dump into Virtuoso you think? Virtuoso was running for a few weeks the first time I tried to run the sync tool. Since then, I restarted it a few times after changing config files and trying to debug things. @Patrick, @Kingsley: The version I am using is Version: 06.01.3127, Build: Mar 16 2011 of VOS. I downloaded and compiled it (on Ubuntu 10.04.2 LTS). The lastDownloadDate.dat file contains 2011-09-16-16-000555 at the moment of writing (the tool is working now). Best regards and thanks for the hints, Karel On Fri, Sep 16, 2011 at 3:53 PM, Patrick van Kleef <[email protected]> wrote: > Hi Karel, > >> Forgot to mention the machine details: >> >> 24GB RAM >> 2x quadcore Xeon E5540 2.5GHz >> Virtuoso data is on SSD disks > > Your parameters look ok, but you may want to try adding the following: > > [Parameters] > ... > DefaultIsolation = 2 > ... > > which sets a different transaction isolation level which is more suitable > for situation where updates/deletes and queries are done on the same server. > > > Did you also set your linux kernel swappiness parameter as per the following > Tips and Tricks article: > > http://www.openlinksw.com/dataspace/dav/wiki/Main/VirtTipsAndTricksGuideRDFPerformanceTuning > > If not than your Linux kernel may start swapping out parts of your virtuoso > process pages in favor of filesystem cache which will seriously hurt > virtuoso's performance. > > In general you should make sure your system never starts swapping. > > > Can you tell me the exact version of VOS you are using on your system and > whether you are using the OS supplied version or if you compiled and > installed it yourself. Note that the current version of Virtuoso OpenSource > is 6.1.3 from: > > http://sourceforge.net/projects/virtuoso/files/ > > However if you are running an older version and are not afraid to do a build > yourself, i would like to give you access to a prerelease of the upcoming > 6.1.4 which has a number of new optimisations and fixes that maybe of > benefit. > > > Lastly on the subject of this dbpintegrator part, can you tell me the > content of the file: > > lastDownloadDate.dat > > > Patrick > > > ------------------------------------------------------------------------------ BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA http://p.sf.net/sfu/rim-devcon-copy2 _______________________________________________ Dbpedia-discussion mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
