Hi Alexander, Thanks for your INI file. You seem to have taken the ram settings for a 64GB ram machine. This is not "enough" hardware for a dataset the size of pubchem. PubChem 110,786,608,453 triples per there void.
You should really have a big ram machine for that. i.e. 512GB of ram lots of cores, and about 4 terabytes of fast SSDs disk space with a good FS such as a recent XFS. For reference this is about 4 times as much triples as UniProt and we use 256GB ram and need more than 1.1 TB of diskspace. I also suggest you turn off full text indexing if you are not going to use it. Regards, Jerven On 2017-01-30 14:57, Jerven Tjalling Bolleman wrote: > Hi Alexander, > > I believe PubChem is in the order of 60 billion triples. > > Would you mind sharing the hardware details and your virtuoso.ini file? > > Regards, > Jerven > > On 2017-01-30 14:47, Alexander Garcia Castro wrote: >> Hi all. I am using virtuoso 7 trying to load pubchem, well over 1000G >> . I have plenty hardware but I must be doing something wrong when >> loading the dataset because it is just taking for ever. I started last >> week and so far I am nowhere near finishing it. >> >> Do anyone here have some data loading scripts that I could reuse? >> >> -- >> Alexander Garcia >> http://www.alexandergarcia.name/ >> http://www.usefilm.com/photographer/75943.html >> http://www.linkedin.com/in/alexgarciac >> ------------------------------------------------------------------------------ >> Check out the vibrant tech community on one of the world's most >> engaging tech sites, SlashDot.org! http://sdm.link/slashdot >> _______________________________________________ >> Virtuoso-users mailing list >> Virtuoso-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/virtuoso-users > > -- > Jerven Tjalling Bolleman > SIB | Swiss Institute of Bioinformatics > CMU - 1, rue Michel Servet - 1211 Geneva 4 > t: +41 22 379 58 85 - f: +41 22 379 58 58 > Jerven.Bolleman@sib.swiss - http://www.sib.swiss > > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, SlashDot.org! http://sdm.link/slashdot > _______________________________________________ > Virtuoso-users mailing list > Virtuoso-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Jerven Tjalling Bolleman SIB | Swiss Institute of Bioinformatics CMU - 1, rue Michel Servet - 1211 Geneva 4 t: +41 22 379 58 85 - f: +41 22 379 58 58 Jerven.Bolleman@sib.swiss - http://www.sib.swiss ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot _______________________________________________ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
