Re: [Virtuoso-users] Virtuoso performance for bookmarking?
Hi Jens, Strange. Try sparqling the endpoint to get triples from resources defined after this one: 6690544 That way we will know if it continues to index the file. If not, then I think I would kill the instance, check what is the last resource being indexed (last checkpoint), split the dump file in two, and try to index the remaining resources. However, the error doesn't seem related to the end of the file (obviously). So Ivan or someone else could tell you more about the meaning of this error. Obviously, some debugging will be needed I think :( Take care, Fred
Re: [Virtuoso-users] Scalable SPARQL querying in PHP?
Hi Daniel, I've been using the ARC PHP libraries to query my local Virtuoso SPARQL end point. While this works fine for small amounts of data, the memory usage of paging through hundreds of pages of results is too much for my PHP process to handle. Is there a better way to do SPARQL querying against a local Virtuoso than using ARC? Feel free to tell me to RTFM, but i'd appreciate any thoughts you might have. Thanks, Dan Dan, What's the configuration of your machine? Basically, how much RAM is in place? BTW - Have you looked at the Virtuoso tunning guide? Links: 1. http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html I think this is related to ARC or PHP or the SPARQL query he sends and not the performance of the virtuoso data store. Daniel: make sure that what handle the paging is the sparql query by using LIMIT and OFFSET. Otherwise, a really big number of triples can be returned, and then PHP can choke with its memory if too many objects are created by ARC. So, if you are performing the paging using SPARQL, a small amount of data will be loaded in PHP objects (ARC) and will then be usable. Does this answer your question? Thanks, Take care, Fred
Re: [Virtuoso-users] Inserting data into an arbitrary graph with HTTP
Hi Kjetil, Try one of these PL functions: DB.DBA.TTLP_MT() DB.DBA.RDF_LOAD_RDFXML_MT() Take care, Fred All, We need to insert a few hundred triples in a certain graph over HTTP and we are struggling to do that. The graph name we use is not dereferenceable, i.e. there is no server there, thus we have to insert into it by name only. Our preferred way to do this is using SPARUL INSERT DATA, but the SQL compiled from this query becomes more than 1 lines for less than 200 triples, so it is at present unsuitable for any large amounts of data. I have sent a feature request about this, but we need a more immediate workaround. I've gone over http://docs.openlinksw.com/virtuoso/rdfinsertmethods.html but it seems like none of the HTTP methods lets us insert into an arbitrary graph, the DAV methods seem to require a graph name connected to the WebDAV server, and that doesn't work well for us. Nor do LOAD, as the data is not available on a server. So, what options are there to insert data into an arbitrary graph using HTTP? Kind regards Kjetil Kjernsmo
Re: [Virtuoso-users] Inserting data into an arbitrary graph with HTTP
Hi Kjetil, Try one of these PL functions: DB.DBA.TTLP_MT() DB.DBA.RDF_LOAD_RDFXML_MT() Yeah, I am aware of them, but how can we use them from the SPARQL endpoint? Right, you will need an ODBC connection to send them. Otherwise I don't think you can do this via the SPARQL endpoint. Take care, Fred
Re: [Virtuoso-users] Virtuoso-opensource Installation issue: glib?
Hi Bill, Bill: first, I did CC this message to the Virtuoso Users List since it is mostly related to Virtuoso building questions. Virtuoso mailing list: this is a message from Bill Anderson that has some issues installing VOS. Hi all, I'm relatively new to construtscs and last week I had an almost complete installation working. This week I started over and I'm having an unusual error with the virtuoso-opensource install. Good I'm building a VMware Fusion VM starting with Ubuntu 9.10. I've successfully installed everything, including virtuoso-opensource-5.0.13. However I ran into two interesting problems when running iodbctest, one of which I've solved, the second remains. Ok The first error was a BAD LOGIN for iodbctest, but I was able to login to Virtuoso/conductor. I discovered that the ubuntu install created a separate entry in the /etc/hosts file for the hostname ubuntu with IP address 127.0.1.1 . When I added the hostname ubuntu to the 127.0.0.1 localhost entry this error went away. Is this is some interesting side effect of the Ubuntu install that needs to be documented? This is strange. First time I see this while installing Ubuntu. All my previous Ubuntu installation were made with 127.0.0.1 by default. I am wondering why you got this. Otherwise, if fixing this as an impact on iodctest, then I guess it has to do with the way the software as been created since I cannot see why it had an impact on your problem. The second error is illustrated below, and I don't know what the problem or solution is. (Perhaps reinstall some version of glib2.0 and rebuild virtuoso-opensource?) Any suggestions appreciated. -Bill Anderson = wla101@ubuntu:~$ sudo /usr/bin/iodbctest DN=structwsf-triples-store;UID=dba;PW=dba [sudo] password for wla101: iODBC Demonstration program This program shows an interactive SQL processor Driver Manager: 03.52.0607.1008 (process:3862): GLib-GObject-CRITICAL **: /build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization assertion failed, use IA__g_type_init() prior to this function (process:3862): GLib-CRITICAL **: g_once_init_leave: assertion `initialization_value != 0' failed (process:3862): GLib-GObject-CRITICAL **: /build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization assertion failed, use IA__g_type_init() prior to this function (process:3862): GLib-GObject-CRITICAL **: /build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization assertion failed, use IA__g_type_init() prior to this function (process:3862): GLib-GObject-CRITICAL **: /build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization assertion failed, use IA__g_type_init() prior to this function (process:3862): GLib-GObject-CRITICAL **: g_type_add_interface_static: assertion `G_TYPE_IS_INSTANTIATABLE (instance_type)' failed (process:3862): GLib-GObject-CRITICAL **: /build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization assertion failed, use IA__g_type_init() prior to this function (process:3862): GLib-GObject-CRITICAL **: g_type_add_interface_static: assertion `G_TYPE_IS_INSTANTIATABLE (instance_type)' failed ^C wla101@ubuntu:~$ This is for the Virtuoso team, any ideas? Thanks, Fred
[Virtuoso-users] Long read issues with PHP odbc
Hi Everybody, I am facing long read issue with one of my server (when sparqling). The server runs: (1) Virtuoso 5.12.3041 (2) PHP 5.3.2 (3) It uses the default unixodbc drivers that comes with ubuntu (4) I am using DB.DBA.SPARQL_EVAL to wrap the sparql queries via the PHP-ODBC API. So, basically, the problem is that long values get truncated at 4070 bytes (which is Virtuoso's max, after this it is supposed to get into a blob, but apparently that it has some issues reading it), and then garbage is added after these 4070 (some kind of stack overflow) bytes. I tested: (1) I tested a full set of parameters in odbc_connect (the flag). To increase the defaultlrl php.ini setting, to play with the binmode, to use the odbc_longreadlen() api call, etc. Nothing works. (2) I confirm that I don't have this issue when using iSql/Conductor (probably since it uses vsp iodbc) I want to know: (1) if there is some ways to fix this using some PHP API (2) if this is a bug, and if this has been fixed in 5.14 (3) if this will only works with iodbc drivers Thanks! Take care, Fred
[Virtuoso-users] Possible compatibility between 6.1.16 and 6.1.8?
Hi, I am wondering if I found a compability issue between VOS 6.1.6 and 6.1.8. I did compile VOS 6.1.8 without any issues, then I ran with with a VOS 6.1.6 database file. There was no issues, and everything was working as expected, until I use the following SPARQL query: == select ?s ?p ?o (DATATYPE(?o)) as ?otype (LANG(?o)) as ?olang where { { select distinct ?s from http://localhost/datasets/organizations/import where { ?s a ?type. } limit 50 offset 0 } ?s ?p ?o } == If I am requesting the following mimes to the /sparql/ endpoint: (a) application/sparql-results+xml (b) application/sparql-results+json I am getting the following content from the endpoint: == sparql xmlns=http://www.w3.org/2005/sparql-results#; xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation=http://www.w3.org/2001/sw/DataAccess/rf1/result2.xsd; head variable name=s/ variable name=p/ variable name=o/ variable name=otype/ variable name=olang/ /head results distinct=false ordered=true result binding name=surihttp://localhost/resources/organization/Random_House/uri/binding binding name=purihttp://www.w3.org/1999/02/22-rdf-syntax-ns#type/uri/binding binding name=ourihttp://dbpedia.org/ontology/Publisher/uri/binding /result result binding name=surihttp://localhost/resources/organization/Random_House/uri/binding binding name=purihttp://www.w3.org/1999/02/22-rdf-syntax-ns#type/uri/binding binding name=ourihttp://www.w3.org/ns/org#Organization/uri/binding /result result binding name=surihttp://localhost/resources/organization/Random_House/uri/binding binding name=purihttp://xmlns.com/foaf/0.1/homepage/uri/binding binding name=ourihttp://www.randomhouse.com/uri/binding /result result binding name=surihttp://localhost/resources/organization/Random_House/uri/binding binding name=purihttp://dbpedia.org/ontology/numberOfEmployees/uri/binding binding name=oliteral datatype=http://www.w3.org/2001/XMLSchema#integer;5712/literal/bindingVirtuoso 22023 Error SR544: Function __xsd_type() can not find XML Schema datatype that matches SQL datatype UNAME (217) SPARQL query: select ?s ?p ?o (DATATYPE(?o)) as ?otype (LANG(?o)) as ?olang where { { select distinct ?s from http://localhost/datasets/organizations/import where { ?s a ?type. } limit 50 offset 0 } ?s ?p ?o } == Obviously, the error is related to the datatype request. However, I am not sure why it chokes there, and in that way. If I request the text/html mime, it works fine. Is it just that something is missing in the 6.1.6 database that is now required by 6.1.8 related to these datatypes? If so, is this something I can create by hands? Thanks, Take care, Fred -- WatchGuard Dimension instantly turns raw network data into actionable security intelligence. It gives you real-time visual feedback on key security issues and trends. Skip the complicated setup - simply import a virtual appliance and go from zero to informed in seconds. http://pubads.g.doubleclick.net/gampad/clk?id=123612991iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Possible compatibility between 6.1.16 and 6.1.8?
Hi Hugh, You can track withthe atom feed, to see when a fix for this issue has been published: https://github.com/openlink/virtuoso-opensource/commits/develop/6.atom or you could log the issue on the git tracker and would get notification when the issue has been fixed ... https://github.com/openlink/virtuoso-opensource/issues?state=open Good thanks, just did it here: https://github.com/openlink/virtuoso-opensource/issues/131 Thanks, Fred -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121051231iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] Issues with UTF-8 characters when importing big N3 files
Hi, I am currently experiencing data ingest issues with Virtuoso 6.1.6 and 6.1.8. All the accented characters of the N3 file I am importing are replaced by question mark characters ?. The file I am importing is 242M big. I am using the following command to import it into Virtuoso: == DB.DBA.TTLP_MT('/data/big_file_to_import.n3'),'http://foo.com/datasets/foo/','http://foo.com/datasets/foo/'); == However, this was weird since this was obviously not a problem in the past. Then what I did is to create a new file with only a few records which were containing accented characters. When I was loading the smaller file, with the same command, everything was working as expected, and the characters where not replaced. Is this a know issue? Is there a way to use another method to try to go over this issue? Thanks, Take care, Fred -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Issues with UTF-8 characters when importing big N3 files
Hi, I think I found the issue. It was that there was one bad UTF-8 character in the whole document. That should have lead the parser to select a different encoding because of the inconsistency into the encoding of the file. When I was slicing it, I had slices properly encoded into UTF-8, and it is why it was properly working. So the issue had nothing to do with the file's size, nor Virtuoso. Thanks, Take care, Fred Hi, I am currently experiencing data ingest issues with Virtuoso 6.1.6 and 6.1.8. All the accented characters of the N3 file I am importing are replaced by question mark characters ?. The file I am importing is 242M big. I am using the following command to import it into Virtuoso: == DB.DBA.TTLP_MT('/data/big_file_to_import.n3'),'http://foo.com/datasets/foo/','http://foo.com/datasets/foo/'); == However, this was weird since this was obviously not a problem in the past. Then what I did is to create a new file with only a few records which were containing accented characters. When I was loading the smaller file, with the same command, everything was working as expected, and the characters where not replaced. Is this a know issue? Is there a way to use another method to try to go over this issue? Thanks, Take care, Fred -- Flow-based real-time traffic analytics software. Cisco certified tool. Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports. Network behavioral analysis security monitoring. All-in-one tool. http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] unable to delete typed literal
Hi all, I think this is the same as this error I reported on GitHub: https://github.com/openlink/virtuoso-opensource/issues/247 Thanks, Fred Hi Jürgen , Thanks for reporting, we are looking into this ... Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Google+ -- http://plus.google.com/100570109519069333827/ Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers On 13 Nov 2014, at 13:20, Jürgen Jakobitsch j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at wrote: hi again (II), this issue can be worked-around by using xsd:integer instead of xsd:int wkr j | Jürgen Jakobitsch, | Software Developer | Semantic Web Company GmbH | Mariahilfer Straße 70 / Neubaugasse 1, Top 8 | A - 1070 Wien, Austria | Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22 COMPANY INFORMATION | web : http://www.semantic-web.at/ | foaf : http://company.semantic-web.at/person/juergen_jakobitsch PERSONAL INFORMATION | web : http://www.turnguard.com http://www.turnguard.com/ | foaf : http://www.turnguard.com/turnguard | g+: https://plus.google.com/111233759991616358206/posts | skype : jakobitsch-punkt | xmlns:tg = http://www.turnguard.com/turnguard#; 2014-11-13 14:16 GMT+01:00 Jürgen Jakobitsch j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at: hi again, this issue is also present in a complete fresh build from just now.. git describe = v7.0.0-1211-g0b74378 wkr j | Jürgen Jakobitsch, | Software Developer | Semantic Web Company GmbH | Mariahilfer Straße 70 / Neubaugasse 1, Top 8 | A - 1070 Wien, Austria | Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22 COMPANY INFORMATION | web : http://www.semantic-web.at/ | foaf : http://company.semantic-web.at/person/juergen_jakobitsch PERSONAL INFORMATION | web : http://www.turnguard.com http://www.turnguard.com/ | foaf : http://www.turnguard.com/turnguard | g+: https://plus.google.com/111233759991616358206/posts | skype : jakobitsch-punkt | xmlns:tg = http://www.turnguard.com/turnguard#; 2014-11-12 19:30 GMT+01:00 Jürgen Jakobitsch j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at: hi, with my version of virtuoso-opensource, i'm not able to delete typed literals. INSERT DATA { GRAPH http://g.net http://g.net/ { http://s.net http://s.net/ http://p.net http://p.net/ 42^^http://www.w3.org/2001/XMLSchema#int } } WITH http://g.net http://g.net/ DELETE { ?s ?p ?o } WHERE { ?s ?p ?o FILTER(?s=http://s.net http://s.net/) } tells me that one triple (or less) has been deleted but the triple is still there.. i'm building from source: git branch -a = develop/7 git describe = v7.0.0-1169-gbd45941 git log = commit bd459415f6f1fe6dcfbd26f71e6be5ea1cede658 Author: VOS Maintainer vos.ad...@openlinksw.com mailto:vos.ad...@openlinksw.com Date: Tue Oct 7 13:46:27 2014 +0200 built on oct. 8 please note: i've found this post [1] with a similar/same issue but assumed the fix should be in the develop/7 code base by october this is quite urgent to me, any workaround highly welcome [1] https://github.com/openlink/virtuoso-opensource/issues/198 | Jürgen Jakobitsch, | Software Developer | Semantic Web Company GmbH | Mariahilfer Straße 70 / Neubaugasse 1, Top 8 | A - 1070 Wien, Austria | Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22 COMPANY INFORMATION | web : http://www.semantic-web.at/ | foaf : http://company.semantic-web.at/person/juergen_jakobitsch PERSONAL INFORMATION | web : http://www.turnguard.com http://www.turnguard.com/ | foaf : http://www.turnguard.com/turnguard | g+: https://plus.google.com/111233759991616358206/posts | skype : jakobitsch-punkt | xmlns:tg = http://www.turnguard.com/turnguard#; -- Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] virtuoso Sorted TOP clause specifies more then 1000000 rows
Hi Phillip Virtuoso 22023 Error SR353: Sorted TOP clause specifies more then 100 rows to sort. Only 1 are allowed. Either decrease the offset and/or row count or use a scrollable cursor Yes, you have to use subqueries for that. Instead of writing: select ?s ?pref from http://dbpedia.org where { ?s http://www.w3.org/2000/01/rdf-schema#label ?pref . } order by asc(?pref) limit 100 offset 2 Do use a subquery like this: select ?s ?pref from http://dbpedia.org where { { select ?s ?pref { ?s http://www.w3.org/2000/01/rdf-schema#label ?pref . } order by asc(?pref) } } limit 100 offset 2 Thanks, Fred -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] How to get full running SPARQL queries; status() trunc them
Hi Hugh, > You can enable Virtuoso query logging as detailed at: > > http://docs.openlinksw.com/virtuoso/ptune/ > > in the "Query Logging” section where many metrics on queries, profile, > compilation, execution time etc information can be veiwed and analysed ... Wonderful thanks! This is exactly what I was looking for. Take care, Fred -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] How to get full running SPARQL queries; status() trunc them
Hi, I am wondering if there is a way to get the full running SPARQL queries because status() is truncating them and I can't see what is the query that is currently running in most of the cases. Thanks, Fred -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users