Re: [Virtuoso-users] Virtuoso performance for bookmarking?

2008-10-29 Thread Frederick Giasson

Hi Jens,



Strange. Try sparqling the endpoint to get triples from resources 
defined after this one: 6690544



That way we will know if it continues to index the file.

If not, then I think I would kill the instance, check what is the last 
resource being indexed (last checkpoint), split the dump file in two, 
and try to index the remaining resources.



However, the error doesn't seem related to the end of the file 
(obviously). So Ivan or someone else could tell you more about the 
meaning of this error.



Obviously, some debugging will be needed I think :(


Take care,


Fred




Re: [Virtuoso-users] Scalable SPARQL querying in PHP?

2009-05-21 Thread Frederick Giasson

Hi Daniel,


I've been using the ARC PHP libraries to query my local Virtuoso  
SPARQL end point. While this works fine for small amounts of data, the  
memory usage of paging through hundreds of pages of results is too  
much for my PHP process to handle.


Is there a better way to do SPARQL querying against a local Virtuoso  
than using ARC?


Feel free to tell me to RTFM, but i'd appreciate any thoughts you  
might have.


Thanks,

Dan

  


Dan,

What's the configuration of your machine? Basically, how much RAM is in 
place?


BTW - Have you looked at the Virtuoso tunning guide?

Links:

1. http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html
  
I think this is related to ARC or PHP or the SPARQL query he sends and 
not the performance of the virtuoso data store.



Daniel: make sure that what handle the paging is the sparql query by 
using LIMIT and OFFSET. Otherwise, a really big number of triples can be 
returned, and then PHP can choke with its memory if too many objects are 
created by ARC.


So, if you are performing the paging using SPARQL, a small amount of 
data will be loaded in PHP objects (ARC) and will then be usable.



Does this answer your question?


Thanks,


Take care,


Fred




Re: [Virtuoso-users] Inserting data into an arbitrary graph with HTTP

2009-05-27 Thread Frederick Giasson

Hi Kjetil,


Try one of these PL functions:

DB.DBA.TTLP_MT()
DB.DBA.RDF_LOAD_RDFXML_MT()


Take care,


Fred

All,

We need to insert a few hundred triples in a certain graph over HTTP and we 
are struggling to do that. The graph name we use is not dereferenceable, i.e. 
there is no server there, thus we have to insert into it by name only.


Our preferred way to do this is using SPARUL INSERT DATA, but the SQL compiled 
from this query becomes more than 1 lines for less than 200 triples, so 
it is at present unsuitable for any large amounts of data. I have sent a 
feature request about this, but we need a more immediate workaround.


I've gone over http://docs.openlinksw.com/virtuoso/rdfinsertmethods.html
but it seems like none of the HTTP methods lets us insert into an arbitrary 
graph, the DAV methods seem to require a graph name connected to the WebDAV 
server, and that doesn't work well for us. Nor do LOAD, as the data is not 
available on a server.


So, what options are there to insert data into an arbitrary graph using HTTP?
 

Kind regards 


Kjetil Kjernsmo
  





Re: [Virtuoso-users] Inserting data into an arbitrary graph with HTTP

2009-05-27 Thread Frederick Giasson

Hi Kjetil,

Try one of these PL functions:

DB.DBA.TTLP_MT()
DB.DBA.RDF_LOAD_RDFXML_MT()
  


Yeah, I am aware of them, but how can we use them from the SPARQL endpoint?
  


Right, you will need an ODBC connection to send them. Otherwise I don't 
think you can do this via the SPARQL endpoint.




Take care,


Fred






Re: [Virtuoso-users] Virtuoso-opensource Installation issue: glib?

2010-03-09 Thread Frederick Giasson

Hi Bill,

Bill: first, I did CC this message to the Virtuoso Users List since it 
is mostly related to Virtuoso building questions.


Virtuoso mailing list: this is a message from Bill Anderson that has 
some issues installing VOS.



Hi all, I'm relatively new to construtscs and last week I had an
almost complete installation working. This week I started over and I'm
having an unusual error with the virtuoso-opensource install.
  

Good

I'm building a VMware Fusion VM starting with Ubuntu 9.10. I've
successfully installed everything, including
virtuoso-opensource-5.0.13. However I ran into two interesting
problems when running iodbctest, one of which I've solved, the second
remains.
  

Ok

The first error was a BAD LOGIN for iodbctest, but I was able to login
to Virtuoso/conductor. I discovered that the ubuntu install created a
separate entry in the /etc/hosts file for the hostname ubuntu with
IP address 127.0.1.1 . When I added the hostname ubuntu to the
127.0.0.1 localhost entry this error went away. Is this is some
interesting side effect of the Ubuntu install that needs to be
documented?
  
This is strange. First time I see this while installing Ubuntu. All my 
previous Ubuntu installation were made with 127.0.0.1 by default. I am 
wondering why you got this.


Otherwise, if fixing this as an impact on iodctest, then I guess it has 
to do with the way the software as been created since I cannot see why 
it had an impact on your problem.



The second error is illustrated below, and I don't know what the
problem or solution is. (Perhaps reinstall some version of glib2.0 and
rebuild virtuoso-opensource?) Any suggestions appreciated.

-Bill Anderson

=

wla101@ubuntu:~$ sudo /usr/bin/iodbctest
DN=structwsf-triples-store;UID=dba;PW=dba
[sudo] password for wla101:
iODBC Demonstration program
This program shows an interactive SQL processor
Driver Manager: 03.52.0607.1008

(process:3862): GLib-GObject-CRITICAL **:
/build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization
assertion failed, use IA__g_type_init() prior to this function

(process:3862): GLib-CRITICAL **: g_once_init_leave: assertion
`initialization_value != 0' failed

(process:3862): GLib-GObject-CRITICAL **:
/build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization
assertion failed, use IA__g_type_init() prior to this function

(process:3862): GLib-GObject-CRITICAL **:
/build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization
assertion failed, use IA__g_type_init() prior to this function

(process:3862): GLib-GObject-CRITICAL **:
/build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization
assertion failed, use IA__g_type_init() prior to this function

(process:3862): GLib-GObject-CRITICAL **: g_type_add_interface_static:
assertion `G_TYPE_IS_INSTANTIATABLE (instance_type)' failed

(process:3862): GLib-GObject-CRITICAL **:
/build/buildd/glib2.0-2.22.3/gobject/gtype.c:2458: initialization
assertion failed, use IA__g_type_init() prior to this function

(process:3862): GLib-GObject-CRITICAL **: g_type_add_interface_static:
assertion `G_TYPE_IS_INSTANTIATABLE (instance_type)' failed
^C
wla101@ubuntu:~$
  



This is for the Virtuoso team, any ideas?


Thanks,


Fred



[Virtuoso-users] Long read issues with PHP odbc

2011-05-03 Thread Frederick Giasson

Hi Everybody,

I am facing long read issue with one of my server (when sparqling). The 
server runs:


(1) Virtuoso 5.12.3041
(2) PHP 5.3.2
(3) It uses the default unixodbc drivers that comes with ubuntu
(4) I am using DB.DBA.SPARQL_EVAL to wrap the sparql queries via the 
PHP-ODBC API.



So, basically, the problem is that long values get truncated at 4070 
bytes (which is Virtuoso's max, after this it is supposed to get into a 
blob, but apparently that it has some issues reading it), and then 
garbage is added after these 4070 (some kind of stack overflow) bytes.



I tested:

(1) I tested a full set of parameters in odbc_connect (the flag). To 
increase the defaultlrl php.ini setting, to play with the binmode, to 
use the odbc_longreadlen() api call, etc. Nothing works.
(2) I confirm that I don't have this issue when using iSql/Conductor 
(probably since it uses vsp  iodbc)



I want to know:

(1) if there is some ways to fix this using some PHP API
(2) if this is a bug, and if this has been fixed in 5.14
(3) if this will only works with iodbc drivers


Thanks!


Take care,

Fred




[Virtuoso-users] Possible compatibility between 6.1.16 and 6.1.8?

2014-01-30 Thread Frederick Giasson

Hi,

I am wondering if I found a compability issue between VOS 6.1.6 and 6.1.8.

I did compile VOS 6.1.8 without any issues, then I ran with with a VOS 
6.1.6 database file. There was no issues, and everything was working as 
expected, until I use the following SPARQL query:



==
select ?s ?p ?o (DATATYPE(?o)) as ?otype (LANG(?o)) as ?olang
where
{
  {
select distinct ?s from 
http://localhost/datasets/organizations/import

where
{
  ?s a ?type.
}
limit 50
offset 0
  }

  ?s ?p ?o
}
==

If I am requesting the following mimes to the /sparql/ endpoint:

  (a) application/sparql-results+xml
  (b) application/sparql-results+json

I am getting the following content from the endpoint:


==
sparql xmlns=http://www.w3.org/2005/sparql-results#; 
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; 
xsi:schemaLocation=http://www.w3.org/2001/sw/DataAccess/rf1/result2.xsd;

 head
  variable name=s/
  variable name=p/
  variable name=o/
  variable name=otype/
  variable name=olang/
 /head
 results distinct=false ordered=true
  result
   binding 
name=surihttp://localhost/resources/organization/Random_House/uri/binding
   binding 
name=purihttp://www.w3.org/1999/02/22-rdf-syntax-ns#type/uri/binding
   binding 
name=ourihttp://dbpedia.org/ontology/Publisher/uri/binding

  /result
  result
   binding 
name=surihttp://localhost/resources/organization/Random_House/uri/binding
   binding 
name=purihttp://www.w3.org/1999/02/22-rdf-syntax-ns#type/uri/binding
   binding 
name=ourihttp://www.w3.org/ns/org#Organization/uri/binding

  /result
  result
   binding 
name=surihttp://localhost/resources/organization/Random_House/uri/binding
   binding 
name=purihttp://xmlns.com/foaf/0.1/homepage/uri/binding

   binding name=ourihttp://www.randomhouse.com/uri/binding
  /result
  result
   binding 
name=surihttp://localhost/resources/organization/Random_House/uri/binding
   binding 
name=purihttp://dbpedia.org/ontology/numberOfEmployees/uri/binding
   binding name=oliteral 
datatype=http://www.w3.org/2001/XMLSchema#integer;5712/literal/bindingVirtuoso 
22023 Error SR544: Function __xsd_type() can not find XML Schema 
datatype that matches SQL datatype UNAME (217)


SPARQL query:
select ?s ?p ?o (DATATYPE(?o)) as ?otype (LANG(?o)) as ?olang
  where
  {
{
  select distinct ?s from 
http://localhost/datasets/organizations/import

  where
  {
?s a ?type.
  }
  limit 50
  offset 0
}

?s ?p ?o
  }
==


Obviously, the error is related to the datatype request. However, I am 
not sure why it chokes there, and in that way. If I request the 
text/html mime, it works fine.


Is it just that something is missing in the 6.1.6 database that is now 
required by 6.1.8 related to these datatypes? If so, is this something I 
can create by hands?



Thanks,

Take care,

Fred
--
WatchGuard Dimension instantly turns raw network data into actionable 
security intelligence. It gives you real-time visual feedback on key
security issues and trends.  Skip the complicated setup - simply import
a virtual appliance and go from zero to informed in seconds.
http://pubads.g.doubleclick.net/gampad/clk?id=123612991iu=/4140/ostg.clktrk___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


Re: [Virtuoso-users] Possible compatibility between 6.1.16 and 6.1.8?

2014-02-03 Thread Frederick Giasson

Hi Hugh,



You can track withthe atom feed, to see when a fix for this issue has 
been published:


https://github.com/openlink/virtuoso-opensource/commits/develop/6.atom

or you could log the issue on the git tracker and would get 
notification when the issue has been fixed ...


https://github.com/openlink/virtuoso-opensource/issues?state=open


Good thanks, just did it here:

https://github.com/openlink/virtuoso-opensource/issues/131


Thanks,

Fred
--
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121051231iu=/4140/ostg.clktrk___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


[Virtuoso-users] Issues with UTF-8 characters when importing big N3 files

2014-02-25 Thread Frederick Giasson

Hi,

I am currently experiencing data ingest issues with Virtuoso 6.1.6 and 
6.1.8. All the accented characters of the N3 file I am importing are 
replaced by question mark characters ?. The file I am importing is 
242M big. I am using the following command to import it into Virtuoso:


==
DB.DBA.TTLP_MT('/data/big_file_to_import.n3'),'http://foo.com/datasets/foo/','http://foo.com/datasets/foo/');
==

However, this was weird since this was obviously not a problem in the 
past. Then what I did is to create a new file with only a few records 
which were containing accented characters. When I was loading the 
smaller file, with the same command, everything was working as expected, 
and the characters where not replaced.


Is this a know issue? Is there a way to use another method to try to go 
over this issue?


Thanks,

Take care,

Fred
--
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer
Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis  security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


Re: [Virtuoso-users] Issues with UTF-8 characters when importing big N3 files

2014-02-26 Thread Frederick Giasson

Hi,

I think I found the issue. It was that there was one bad UTF-8 character 
in the whole document. That should have lead the parser to select a 
different encoding because of the inconsistency into the encoding of the 
file. When I was slicing it, I had slices properly encoded into UTF-8, 
and it is why it was properly working. So the issue had nothing to do 
with the file's size, nor Virtuoso.


Thanks,

Take care,

Fred

Hi,

I am currently experiencing data ingest issues with Virtuoso 6.1.6 and 
6.1.8. All the accented characters of the N3 file I am importing are 
replaced by question mark characters ?. The file I am importing is 
242M big. I am using the following command to import it into Virtuoso:


==
DB.DBA.TTLP_MT('/data/big_file_to_import.n3'),'http://foo.com/datasets/foo/','http://foo.com/datasets/foo/');
==

However, this was weird since this was obviously not a problem in the 
past. Then what I did is to create a new file with only a few records 
which were containing accented characters. When I was loading the 
smaller file, with the same command, everything was working as 
expected, and the characters where not replaced.


Is this a know issue? Is there a way to use another method to try to 
go over this issue?


Thanks,

Take care,

Fred


--
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer
Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis  security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071iu=/4140/ostg.clktrk___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


Re: [Virtuoso-users] unable to delete typed literal

2014-11-17 Thread Frederick Giasson

Hi all,

I think this is the same as this error I reported on GitHub:

https://github.com/openlink/virtuoso-opensource/issues/247

Thanks,

Fred


Hi Jürgen ,

Thanks for reporting, we are looking into this ...

Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.  // http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

On 13 Nov 2014, at 13:20, Jürgen Jakobitsch 
j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at 
wrote:


hi again (II),

this issue can be worked-around by using xsd:integer instead of xsd:int

wkr j

| Jürgen Jakobitsch,
| Software Developer
| Semantic Web Company GmbH
| Mariahilfer Straße 70 / Neubaugasse 1, Top 8
| A - 1070 Wien, Austria
| Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22

COMPANY INFORMATION
| web   : http://www.semantic-web.at/
| foaf  : http://company.semantic-web.at/person/juergen_jakobitsch
PERSONAL INFORMATION
| web   : http://www.turnguard.com http://www.turnguard.com/
| foaf  : http://www.turnguard.com/turnguard
| g+: https://plus.google.com/111233759991616358206/posts
| skype : jakobitsch-punkt
| xmlns:tg  = http://www.turnguard.com/turnguard#;

2014-11-13 14:16 GMT+01:00 Jürgen Jakobitsch 
j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at:


hi again,

this issue is also present in a complete fresh build from just now..

git describe = v7.0.0-1211-g0b74378

wkr j

| Jürgen Jakobitsch,
| Software Developer
| Semantic Web Company GmbH
| Mariahilfer Straße 70 / Neubaugasse 1, Top 8
| A - 1070 Wien, Austria
| Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22

COMPANY INFORMATION
| web   : http://www.semantic-web.at/
| foaf  :
http://company.semantic-web.at/person/juergen_jakobitsch
PERSONAL INFORMATION
| web   : http://www.turnguard.com http://www.turnguard.com/
| foaf  : http://www.turnguard.com/turnguard
| g+: https://plus.google.com/111233759991616358206/posts
| skype : jakobitsch-punkt
| xmlns:tg  = http://www.turnguard.com/turnguard#;

2014-11-12 19:30 GMT+01:00 Jürgen Jakobitsch
j.jakobit...@semantic-web.at mailto:j.jakobit...@semantic-web.at:

hi, with my version of virtuoso-opensource, i'm not able to
delete
typed literals.

INSERT DATA { GRAPH http://g.net http://g.net/ {
http://s.net http://s.net/ http://p.net http://p.net/
42^^http://www.w3.org/2001/XMLSchema#int } }

WITH http://g.net http://g.net/
DELETE { ?s ?p ?o } WHERE { ?s ?p ?o FILTER(?s=http://s.net
http://s.net/) }

tells me that one triple (or less) has been deleted but the
triple is still there..

i'm building from source:

git branch -a   = develop/7
git describe = v7.0.0-1169-gbd45941
git log = commit bd459415f6f1fe6dcfbd26f71e6be5ea1cede658
Author: VOS Maintainer vos.ad...@openlinksw.com
mailto:vos.ad...@openlinksw.com
Date:   Tue Oct 7 13:46:27 2014 +0200

built on oct. 8

please note: i've found this post [1] with a similar/same
issue but assumed the fix should be in the develop/7 code
base by october

this is quite urgent to me, any workaround highly welcome

[1] https://github.com/openlink/virtuoso-opensource/issues/198

| Jürgen Jakobitsch,
| Software Developer
| Semantic Web Company GmbH
| Mariahilfer Straße 70 / Neubaugasse 1, Top 8
| A - 1070 Wien, Austria
| Mob +43 676 62 12 710 | Fax +43.1.402 12 35 - 22

COMPANY INFORMATION
| web   : http://www.semantic-web.at/
| foaf  :
http://company.semantic-web.at/person/juergen_jakobitsch
PERSONAL INFORMATION
| web   : http://www.turnguard.com
http://www.turnguard.com/
| foaf  : http://www.turnguard.com/turnguard
| g+: https://plus.google.com/111233759991616358206/posts
| skype : jakobitsch-punkt
| xmlns:tg  = http://www.turnguard.com/turnguard#;



--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://pubads.g.doubleclick.net/gampad/clk?id=154624111iu=/4140/ostg.clktrk___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users





Re: [Virtuoso-users] virtuoso Sorted TOP clause specifies more then 1000000 rows

2015-02-06 Thread Frederick Giasson

Hi Phillip

Virtuoso 22023 Error SR353: Sorted TOP clause specifies more then 
100 rows to sort. Only 1 are allowed. Either decrease the 
offset and/or row count or use a scrollable cursor






Yes, you have to use subqueries for that. Instead of writing:

select ?s ?pref
from http://dbpedia.org
where
{
  ?s http://www.w3.org/2000/01/rdf-schema#label ?pref .
}
order by asc(?pref)
limit 100
offset 2

Do use a subquery like this:

select ?s ?pref
from http://dbpedia.org
where
{
  {
select ?s ?pref
{
  ?s http://www.w3.org/2000/01/rdf-schema#label ?pref .
}
order by asc(?pref)

  }
}
limit 100
offset 2


Thanks,

Fred
--
Dive into the World of Parallel Programming. The Go Parallel Website,
sponsored by Intel and developed in partnership with Slashdot Media, is your
hub for all things parallel software development, from weekly thought
leadership blogs to news, videos, case studies, tutorials and more. Take a
look and join the conversation now. http://goparallel.sourceforge.net/___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


Re: [Virtuoso-users] How to get full running SPARQL queries; status() trunc them

2016-10-14 Thread Frederick Giasson
Hi Hugh,

> You can enable Virtuoso query logging as detailed at:
>
>   http://docs.openlinksw.com/virtuoso/ptune/
>
> in the "Query Logging” section where many metrics on queries,  profile, 
> compilation, execution time etc information can be veiwed and analysed ...


Wonderful thanks! This is exactly what I was looking for.

Take care,

Fred

--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users


[Virtuoso-users] How to get full running SPARQL queries; status() trunc them

2016-10-13 Thread Frederick Giasson
Hi,

I am wondering if there is a way to get the full running SPARQL queries 
because status() is truncating them and I can't see what is the query 
that is currently running in most of the cases.

Thanks,


Fred



--
Check out the vibrant tech community on one of the world's most 
engaging tech sites, SlashDot.org! http://sdm.link/slashdot
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users