On Wed, Nov 28, 2012 at 4:41 PM, Jona Christopher Sahnwaldt <[email protected]> wrote: > On Wed, Nov 28, 2012 at 2:29 AM, Hugh Williams <[email protected]> > wrote: >> Hi Christopher, >> >> I am not aware of a linkset to Freebase in the DBpedia project. > > http://wiki.dbpedia.org/Downloads38#links-to-freebase > http://downloads.dbpedia.org/3.8/links/freebase_links.nt.bz2
Preview: http://downloads.dbpedia.org/preview.php?file=3.8_sl_links_sl_freebase_links.nt.bz2 > >> baseKB >> (http://basekb.com) is an example of a dataset with good mappings between >> DBpedia and Freebase, you may want to look at ... >> >> Best Regards >> Hugh Williams >> Professional Services >> OpenLink Software, Inc. // http://www.openlinksw.com/ >> Weblog -- http://www.openlinksw.com/blogs/ >> LinkedIn -- http://www.linkedin.com/company/openlink-software/ >> Twitter -- http://twitter.com/OpenLink >> Google+ -- http://plus.google.com/100570109519069333827/ >> Facebook -- http://www.facebook.com/OpenLinkSoftware >> Universal Data Access, Integration, and Management Technology Providers >> >> On 27 Nov 2012, at 19:05, Jona Christopher Sahnwaldt wrote: >> >> On Tue, Nov 27, 2012 at 7:30 PM, Gunaratna, Dalkandura Arachchige >> Kalpa Shashika Silva <[email protected]> wrote: >> >> Hi Hugh, >> >> There was a bug in the script (ini file when uncommenting and had to >> >> remove spaces). I think it is working fine now and loaded within few hours >> >> and I can see its memory usage using top command and isql status(''); >> >> message for number of buffers. >> >> >> I have a another issue though, I downloaded all the files for DBpedia >> >> 3.8 dump but when I query an instance, it doesn't give me interconnections >> >> (sameAs link) for other datasets like Freebase but only sameAs links within >> >> dbpedia. >> >> >> Also load the files in http://downloads.dbpedia.org/3.8/links/ >> >> Regards, >> Christopher >> >> Following is the list of loaded files (which was downloaded from >> >> dump and loaded). There if the folder, I have created a file called >> >> global.graph as mentioned in the openLink website documentations but it >> >> didn't get loaded. I can also see that external interlining file is also >> >> loaded but I do not get sameAs links to Freebase. I checked this by running >> >> the same query in dbpedia.org sparql endpoint and my local endpoint. Do you >> >> have any idea what would have happened if anything went wrong in my >> >> installation? Thank you very much for the help. >> >> >> >> >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/article_categories_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 21:47.14 0 2012.11.21 21:57.23 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/category_labels_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 21:57.23 0 2012.11.21 21:58.39 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/disambiguations_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 21:58.39 0 2012.11.21 21:59.43 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/disambiguations_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 21:59.43 0 2012.11.21 22:0.5 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/external_links_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 22:0.5 0 2012.11.21 22:5.30 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/geo_coordinates_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 22:5.30 0 2012.11.21 22:7.6 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/global.graph >> >> http://dbpedia.org >> >> 2 2012.11.21 22:7.6 0 2012.11.21 22:7.6 0 0 NULL >> >> 37000 SP029: TURTLE RDF loader, line 1: Undefined namespace prefix at >> >> http://dbpedia.org >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/homepages_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 22:7.6 0 2012.11.21 22:7.33 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/images_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 22:7.33 0 2012.11.21 22:12.56 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/infobox_properties_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 22:12.56 0 2012.11.21 23:10.20 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/infobox_properties_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 23:10.20 0 2012.11.21 23:37.1 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/infobox_property_definitions_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 23:37.1 0 2012.11.21 23:37.6 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/infobox_test_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.21 23:37.1 0 2012.11.22 0:28.20 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/instance_types_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 0:28.20 0 2012.11.22 0:36.7 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/interlanguage_links_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 0:36.7 0 2012.11.22 0:48.43 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/interlanguage_links_same_as_chapters_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 0:48.43 0 2012.11.22 0:55.18 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/interlanguage_links_same_as_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 0:55.19 0 2012.11.22 1:8.38 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/interlanguage_links_see_also_chapters_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:8.39 0 2012.11.22 1:9.6 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/interlanguage_links_see_also_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:9.6 0 2012.11.22 1:9.37 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/iri_same_as_uri_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:9.37 0 2012.11.22 1:10.41 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/labels_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:10.41 0 2012.11.22 1:23.53 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/long_abstracts_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:23.53 0 2012.11.22 1:36.56 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/mappingbased_properties_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:36.56 0 2012.11.22 1:59.15 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/mappingbased_properties_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 1:59.15 0 2012.11.22 2:7.58 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/page_ids_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 2:7.58 0 2012.11.22 2:23.26 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/page_links_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 2:23.26 0 2012.11.22 4:59.20 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/page_links_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 4:59.20 0 2012.11.22 6:15.17 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/persondata_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:15.17 0 2012.11.22 6:28.46 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/persondata_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:28.46 0 2012.11.22 6:32.14 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/pnd_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:32.14 0 2012.11.22 6:32.14 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/redirects_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:32.14 0 2012.11.22 6:40.57 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/redirects_transitive_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:40.58 0 2012.11.22 6:45.28 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/revision_ids_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 6:45.28 0 2012.11.22 7:10.23 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/revision_uris_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 7:10.23 0 2012.11.22 7:46.7 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/short_abstracts_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 7:46.7 0 2012.11.22 8:1.54 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/skos_categories_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 8:1.54 0 2012.11.22 8:8.2 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/specific_mappingbased_properties_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 8:8.2 0 2012.11.22 8:9.19 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/topical_concepts_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 8:9.19 0 2012.11.22 8:9.28 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/topical_concepts_unredirected_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 8:9.19 0 2012.11.22 8:9.30 0 0 NULL >> >> NULL >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/wikipedia_links_en.nt.gz >> >> http://dbpedia.org >> >> 2 2012.11.22 8:9.30 0 2012.11.22 8:50.6 0 0 NULL >> >> NULL >> >> >> >> >> >> ________________________________ >> >> From: Hugh Williams [[email protected]] >> >> Sent: Thursday, November 22, 2012 6:10 AM >> >> >> To: Gunaratna, Dalkandura Arachchige Kalpa Shashika Silva >> >> Cc: [email protected] >> >> Subject: Re: [Dbpedia-discussion] local dbpedia dump load to virtuoso server >> >> >> Hi Kalpa, >> >> >> Did you restart your Virtuoso instance having made these changes to enable >> >> the new settings to take effect ? Also please provide a copy of the INI file >> >> changes you have made so we can see what should be reported in the status >> >> output ? >> >> >> Best Regards >> >> Hugh Williams >> >> Professional Services >> >> OpenLink Software, Inc. // http://www.openlinksw.com/ >> >> Weblog -- http://www.openlinksw.com/blogs/ >> >> LinkedIn -- http://www.linkedin.com/company/openlink-software/ >> >> Twitter -- http://twitter.com/OpenLink >> >> Google+ -- http://plus.google.com/100570109519069333827/ >> >> Facebook -- http://www.facebook.com/OpenLinkSoftware >> >> Universal Data Access, Integration, and Management Technology Providers >> >> >> On 20 Nov 2012, at 17:50, Gunaratna, Dalkandura Arachchige Kalpa Shashika >> >> Silva wrote: >> >> >> Hi Hugh, >> >> Yes, I uncommented the lines and commented out the default number of >> >> buffers before I started the server. I made the changes in virtuoso.ini in >> >> var/lib/db folder. But following is the status I see when I type status(''); >> >> in isql. I think it is still using 2000 buffers and I do not know why it is >> >> using the default setting after I have changed the parameters. >> >> >> >> >> OpenLink Virtuoso Server >> >> Version 06.01.3127-pthreads for Linux as of Nov 15 2012 >> >> Started on: 2012/11/18 16:10 GMT-300 >> >> >> Database Status: >> >> File size 29255270400, 3571200 pages, 760183 free. >> >> 2000 buffers, 2000 used, 1175 dirty 6 wired down, repl age 429 441 w. io 3 >> >> w/crsr. >> >> Disk Usage: 352003762 reads avg 0 msec, 0% r 0% w last 0 s, 198597618 >> >> writes, >> >> 1311 read ahead, batch = 1. Autocompact 4406099 in 3148871 out, 28% >> >> saved. >> >> Gate: 3381 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap. >> >> Log = /home/kalpa/Virtuoso/var/lib/virtuoso/db/virtuoso.trx, 2394315279 >> >> bytes >> >> 1545766 pages have been changed since last backup (in checkpoint state) >> >> Current backup timestamp: 0x0000-0x00-0x00 >> >> Last backup date: unknown >> >> Clients: 3 connects, max 2 concurrent >> >> RPC: 37 calls, 1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 >> >> second brk=159555584 >> >> Checkpoint Remap 339966 pages, 0 mapped back. 1997 s atomic time. >> >> DB master 3571200 total 760183 free 339966 remap 44104 mapped back >> >> temp 256 total 250 free >> >> >> Lock Status: 0 deadlocks of which 0 2r1w, 105 waits, >> >> Currently 3 threads running 0 threads waiting 0 threads in vdb. >> >> Pending: >> >> >> 23 Rows. -- 2234 msec. >> >> >> >> >> ________________________________ >> >> From: Hugh Williams [[email protected]] >> >> Sent: Tuesday, November 20, 2012 4:21 AM >> >> To: Gunaratna, Dalkandura Arachchige Kalpa Shashika Silva >> >> Cc: [email protected] >> >> Subject: Re: [Dbpedia-discussion] local dbpedia dump load to virtuoso server >> >> >> Hi Kalpa, >> >> >> Have you tuning your Virtuoso instance to take advantage of the 32GB of >> >> available RAM as detailed at: >> >> >> http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtRDFPerformanceTuning >> >> >> I suspect you are running out of allocated memory for the Virtuoso server as >> >> the NumberOfBuffers param is low by default and need to be increase to match >> >> the available memory as indicated in the above document. Run the >> >> “status(‘’);” command from isql to see the status of the server in >> >> particular the number of buffers available to ensure the setting has taken >> >> effect. >> >> >> Best Regards >> >> Hugh Williams >> >> Professional Services >> >> OpenLink Software, Inc. // http://www.openlinksw.com/ >> >> Weblog -- http://www.openlinksw.com/blogs/ >> >> LinkedIn -- http://www.linkedin.com/company/openlink-software/ >> >> Twitter -- http://twitter.com/OpenLink >> >> Google+ -- http://plus.google.com/100570109519069333827/ >> >> Facebook -- http://www.facebook.com/OpenLinkSoftware >> >> Universal Data Access, Integration, and Management Technology Providers >> >> >> On 20 Nov 2012, at 04:21, Gunaratna, Dalkandura Arachchige Kalpa Shashika >> >> Silva wrote: >> >> >> Hi, >> >> I am loading dbpedia version 3.8 into Virtuoso 6.1. I unzipped the files >> >> into .gz format and ran ld_dir method in isql mode to load all files in a >> >> folder (whole dump). Then I am running rdf_loader_run() to process the >> >> files. I have two questions, >> >> >> 1. the server is having 32 GB of ram and 8 cores. But still it has taken 2 >> >> days to load half the files. Why is it taking this much time? is it normal? >> >> >> >> 2. When I check the status using SELECT * FROM DB.DBA.LOAD_LIST; one file >> >> has a start timestamp but no end timestamp. Following is the relevant row >> >> for that file in the output, >> >> >> /home/kalpa/Virtuoso/data/datasets/dbpedia/3.8/3.8/en/infobox_properties_en.nt.gz >> >> http://dbpedia.org >> >> 1 2012.11.17 2:12.5 0 NULL 0 NULL >> >> NULL >> >> >> If I re-load that file only after the other files are processed, will it >> >> add duplicate tuples or I have to remove that file and then load that file >> >> only? If so, what is the process to do that? >> >> If I commit after processing all files are finished (I assume I have to >> >> commit using command commit WORK; to make changes permanent) and only load >> >> that infobox_properties_en.nt.gz file only again, is it fine? Please let me >> >> know some details about these two problems and make the local dbpedia server >> >> working without any errors. Thank you. >> >> >> regards, >> >> kalpa >> >> >> >> ------------------------------------------------------------------------------ >> >> Monitor your physical, virtual and cloud infrastructure from a single >> >> web console. Get in-depth insight into apps, servers, databases, vmware, >> >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> >> Pricing starts from $795 for 25 servers or applications! >> >> http://p.sf.net/sfu/zoho_dev2dev_nov_______________________________________________ >> >> Dbpedia-discussion mailing list >> >> [email protected] >> >> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> >> Monitor your physical, virtual and cloud infrastructure from a single >> >> web console. Get in-depth insight into apps, servers, databases, vmware, >> >> SAP, cloud infrastructure, etc. Download 30-day Free Trial. >> >> Pricing starts from $795 for 25 servers or applications! >> >> http://p.sf.net/sfu/zoho_dev2dev_nov >> >> _______________________________________________ >> >> Dbpedia-discussion mailing list >> >> [email protected] >> >> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >> >> >> ------------------------------------------------------------------------------ Keep yourself connected to Go Parallel: INSIGHTS What's next for parallel hardware, programming and related areas? Interviews and blogs by thought leaders keep you ahead of the curve. http://goparallel.sourceforge.net _______________________________________________ Dbpedia-discussion mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
