Re: [Virtuoso-users] MySQL - Faceter
Aldo Bucchi wrote: Kingsley, On Wed, May 20, 2009 at 3:50 PM, Kingsley Idehen kide...@openlinksw.com wrote: Aldo Bucchi wrote: Hello, What's the fastest route to publish a MySQL database via V6 faceter? This is what we understand: 1) Connect the database via Virt-MySQL adapter 2) Configure, Generate and Install RDF Views We have some issues related to each point ;) Why not try the commercial edition so that you can test the Virtuoso--ODBC--MySQL approach. Or Virtuoso--[Replication via ODBC]--MySQL approach. You will more than likely have to use our ODBC Drivers for MySQL also. All the commercial bits are available on free 15 day eval basis. Yes of course. But does this apply to V6 as well? The tech preview release? Not the VOS release, but will apply to the commercial Tech Preview release which is coming out soon. Kingsley Kingsley Issue 1) How do we get/buy a Virt-MySQL adapter for V6? ( we have the Tech Preview version ) Issue 2) RDF Views on large databases have given us trouble before. I understand these are related to the size of the generated script. ( Cristián, can you please reproduce the error and attach it? ) For now we are using a manual frankenstein of a process which is OK but really time consuming. ( batch import data, create RDFViews by chunks ). Thanks, A -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com
Re: [Virtuoso-users] Hibernate dialect
Hugh Williams wrote: Hi Jem, Their is no hibernate dialect for Virtuoso that I am aware of or have been able to locate. I shall check with development to see if and work has been done with Hibernate. What are your requirements in this area ? No such thing. Jem: What are you trying to do here? I suspect work with an Object-Relational abstraction using Java? Kingsley Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support On 20 May 2009, at 16:36, Jem Rayfield wrote: I am after a Virtuoso Hibernate (JAVA ORM) dialect. I don't seem to be able to find one. Any pointers appreciated. Cheers Jem http://www.bbc.co.uk/ This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately. Please note that the BBC monitors e-mails sent or received. Further communication will signify your consent to this. -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net mailto:Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com
Re: [Virtuoso-users] Hibernate dialect
Yup that's exactly what I want. I want to persist news.bbc.co.uk content within an ER model via JAVA/Hibernate/ORM. I will be using an RDF view ontop of this as well. Our pan BBC service layer infrastructure is usually built using Spring/Hibernate. We need standard SQL access to the data as well as SPARQL. I guess I can look at using iBatis or straight SQL. But our standard approach is hibernate. It will also help development speed as its more convienent than SQL and our devs are fully versed in Hibernate. Cheers Jem -Original Message- From: Kingsley Idehen [mailto:kide...@openlinksw.com] Sent: 21 May 2009 03:02 To: Hugh Williams Cc: Jem Rayfield; virtuoso-users@lists.sourceforge.net Subject: Re: [Virtuoso-users] Hibernate dialect Hugh Williams wrote: Hi Jem, Their is no hibernate dialect for Virtuoso that I am aware of or have been able to locate. I shall check with development to see if and work has been done with Hibernate. What are your requirements in this area ? No such thing. Jem: What are you trying to do here? I suspect work with an Object-Relational abstraction using Java? Kingsley Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support On 20 May 2009, at 16:36, Jem Rayfield wrote: I am after a Virtuoso Hibernate (JAVA ORM) dialect. I don't seem to be able to find one. Any pointers appreciated. Cheers Jem http://www.bbc.co.uk/ This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately. Please note that the BBC monitors e-mails sent or received. Further communication will signify your consent to this. - - Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net mailto:Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- -- -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com -- -- ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com http://www.bbc.co.uk/ This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately. Please note that the BBC monitors e-mails sent or received. Further communication will signify your consent to this.
Re: [Virtuoso-users] MySQL - Faceter
Aldo, On 20 May 2009, at 21:12, Aldo Bucchi wrote: Kingsley, On Wed, May 20, 2009 at 3:50 PM, Kingsley Idehen kide...@openlinksw.com wrote: Aldo Bucchi wrote: Hello, What's the fastest route to publish a MySQL database via V6 faceter? This is what we understand: 1) Connect the database via Virt-MySQL adapter 2) Configure, Generate and Install RDF Views We have some issues related to each point ;) Why not try the commercial edition so that you can test the Virtuoso--ODBC--MySQL approach. Or Virtuoso--[Replication via ODBC]--MySQL approach. You will more than likely have to use our ODBC Drivers for MySQL also. All the commercial bits are available on free 15 day eval basis. Yes of course. But does this apply to V6 as well? The tech preview release? [Hugh] The V6 TP1 release is only available in open source form current and thus does not require a license, but does not have VDB support for accessing SQL data in remote databases. What you need is a commercial V6 build ... Regards Hugh Kingsley Issue 1) How do we get/buy a Virt-MySQL adapter for V6? ( we have the Tech Preview version ) Issue 2) RDF Views on large databases have given us trouble before. I understand these are related to the size of the generated script. ( Cristián, can you please reproduce the error and attach it? ) For now we are using a manual frankenstein of a process which is OK but really time consuming. ( batch import data, create RDFViews by chunks ). Thanks, A -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com -- Aldo Bucchi U N I V R Z Office: +56 2 795 4532 Mobile:+56 9 7623 8653 skype:aldo.bucchi http://www.univrz.com/ http://aldobucchi.com/ PRIVILEGED AND CONFIDENTIAL INFORMATION This message is only for the use of the individual or entity to which it is addressed and may contain information that is privileged and confidential. If you are not the intended recipient, please do not distribute or copy this communication, by e-mail or otherwise. Instead, please notify us immediately by return e-mail. INFORMACIÓN PRIVILEGIADA Y CONFIDENCIAL Este mensaje está destinado sólo a la persona u organización al cual está dirigido y podría contener información privilegiada y confidencial. Si usted no es el destinatario, por favor no distribuya ni copie esta comunicación, por email o por otra vía. Por el contrario, por favor notifíquenos inmediatamente vía e-mail. -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] MySQL - Faceter
Cristian, On 20 May 2009, at 21:00, Cristian Vasquez wrote: On Wed, May 20, 2009 at 2:59 PM, Aldo Bucchi aldo.buc...@univrz.com wrote: Hello, What's the fastest route to publish a MySQL database via V6 faceter? This is what we understand: 1) Connect the database via Virt-MySQL adapter 2) Configure, Generate and Install RDF Views We have some issues related to each point ;) Issue 1) How do we get/buy a Virt-MySQL adapter for V6? ( we have the Tech Preview version ) Issue 2) RDF Views on large databases have given us trouble before. I understand these are related to the size of the generated script. ( Cristián, can you please reproduce the error and attach it? ) The problem arises when I generate RDF Views, selecting a large number of tables using 'Database' - 'RDF Schema Objects'- 'Generate Mappings' in conductor. The RDF View Definition script is always generated, but an error is thrown upon the excecution of the script. The error is: SQ074: Line 1820: SP031: SPARQL: Internal error: The length of generated SQL text has exceeded 1 lines of code Is there a way to configure the SQL text limit? [Hugh] What is the Virtuoso version and build date being used as their have been a number of updates to the RDF Schema Object UI over the past week, thus it would be best to get you running with this latest cut ? Are you running on an EC2 AMI or local instance ? Regards Hugh Regards, Cristian For now we are using a manual frankenstein of a process which is OK but really time consuming. ( batch import data, create RDFViews by chunks ). Thanks, A -- Aldo Bucchi U N I V R Z Office: +56 2 795 4532 Mobile:+56 9 7623 8653 skype:aldo.bucchi http://www.univrz.com/ http://aldobucchi.com/ PRIVILEGED AND CONFIDENTIAL INFORMATION This message is only for the use of the individual or entity to which it is addressed and may contain information that is privileged and confidential. If you are not the intended recipient, please do not distribute or copy this communication, by e-mail or otherwise. Instead, please notify us immediately by return e-mail. INFORMACIÓN PRIVILEGIADA Y CONFIDENCIAL Este mensaje está destinado sólo a la persona u organización al cual está dirigido y podría contener información privilegiada y confidencial. Si usted no es el destinatario, por favor no distribuya ni copie esta comunicación, por email o por otra vía. Por el contrario, por favor notifíquenos inmediatamente vía e-mail. -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] MySQL - Faceter
Cristian, On 21 May 2009, at 03:30, Cristian Vasquez wrote: On Wed, May 20, 2009 at 8:01 PM, Hugh Williams hwilli...@openlinksw.com wrote: Cristian, On 20 May 2009, at 21:00, Cristian Vasquez wrote: On Wed, May 20, 2009 at 2:59 PM, Aldo Bucchi aldo.buc...@univrz.com wrote: Hello, What's the fastest route to publish a MySQL database via V6 faceter? This is what we understand: 1) Connect the database via Virt-MySQL adapter 2) Configure, Generate and Install RDF Views We have some issues related to each point ;) Issue 1) How do we get/buy a Virt-MySQL adapter for V6? ( we have the Tech Preview version ) Issue 2) RDF Views on large databases have given us trouble before. I understand these are related to the size of the generated script. ( Cristián, can you please reproduce the error and attach it? ) The problem arises when I generate RDF Views, selecting a large number of tables using 'Database' - 'RDF Schema Objects'- 'Generate Mappings' in conductor. The RDF View Definition script is always generated, but an error is thrown upon the excecution of the script. The error is: SQ074: Line 1820: SP031: SPARQL: Internal error: The length of generated SQL text has exceeded 1 lines of code Is there a way to configure the SQL text limit? [Hugh] What is the Virtuoso version and build date being used as their have been a number of updates to the RDF Schema Object UI over the past week, thus it would be best to get you running with this latest cut ? Are you running on an EC2 AMI or local instance ? Regards Hugh [Cristian] I'm experiencing the same behaviour on a Virtuoso 5 EC2 AMI (Build Date May 20 2009) and a Virtuoso 6 instance. [Hugh] That is the latest Virtuoso 5 build you are running with the latest updates. Can you please enable additional server tracing as detailed at: http://docs.openlinksw.com/virtuoso/fn_trace_on.html#(NULL) Such that we can see what SQL is being generated when creating the Views and hence causing the error. This trace will probably be quite large thus email to me directly as the mailing list does not allow much more that 40K chars as I recall Regards Hugh Thanks, Cristian [...] ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Hibernate dialect
Hi Jem, This is related, albeit not the perfect fit. Have you tried out Elmo?[1] It is the analog of the Java Bean pool provided by traditional ORMs, but tailored for RDF. Of course there is no such thing as Object *Relational* Mapping when dealing with RDF's graph model ;) Java developers can work atop Elmo and you can shield them from the unfairly mythical realms of RDF. Best, A [1] http://www.openrdf.org/doc/elmo/1.4/ On Thu, May 21, 2009 at 4:41 AM, Jem Rayfield jem.rayfi...@bbc.co.uk wrote: Yup that's exactly what I want. I want to persist news.bbc.co.uk content within an ER model via JAVA/Hibernate/ORM. I will be using an RDF view ontop of this as well. Our pan BBC service layer infrastructure is usually built using Spring/Hibernate. We need standard SQL access to the data as well as SPARQL. I guess I can look at using iBatis or straight SQL. But our standard approach is hibernate. It will also help development speed as its more convienent than SQL and our devs are fully versed in Hibernate. Cheers Jem -Original Message- From: Kingsley Idehen [mailto:kide...@openlinksw.com] Sent: 21 May 2009 03:02 To: Hugh Williams Cc: Jem Rayfield; virtuoso-users@lists.sourceforge.net Subject: Re: [Virtuoso-users] Hibernate dialect Hugh Williams wrote: Hi Jem, Their is no hibernate dialect for Virtuoso that I am aware of or have been able to locate. I shall check with development to see if and work has been done with Hibernate. What are your requirements in this area ? No such thing. Jem: What are you trying to do here? I suspect work with an Object-Relational abstraction using Java? Kingsley Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support On 20 May 2009, at 16:36, Jem Rayfield wrote: I am after a Virtuoso Hibernate (JAVA ORM) dialect. I don't seem to be able to find one. Any pointers appreciated. Cheers Jem http://www.bbc.co.uk/ This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately. Please note that the BBC monitors e-mails sent or received. Further communication will signify your consent to this. - - Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net mailto:Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- -- -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com -- -- ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com http://www.bbc.co.uk/ This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated. If you have received it in error, please delete it from your system. Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately. Please note that the BBC monitors e-mails sent or received. Further communication will signify your consent to this. -- Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, iPhoneDevCamp asthey present alongside digital heavyweights like Barbarian Group, R/GA, Big Spaceship. http://www.creativitycat.com ___ Virtuoso-users
Re: [Virtuoso-users] Scalable SPARQL querying in PHP?
Daniel Alexander Smith wrote: Hi, I've been using the ARC PHP libraries to query my local Virtuoso SPARQL end point. While this works fine for small amounts of data, the memory usage of paging through hundreds of pages of results is too much for my PHP process to handle. Is there a better way to do SPARQL querying against a local Virtuoso than using ARC? Feel free to tell me to RTFM, but i'd appreciate any thoughts you might have. Thanks, Dan Dan, What's the configuration of your machine? Basically, how much RAM is in place? BTW - Have you looked at the Virtuoso tunning guide? Links: 1. http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html -- Regards, Kingsley Idehen Weblog: http://www.openlinksw.com/blog/~kidehen President CEO OpenLink Software Web: http://www.openlinksw.com
Re: [Virtuoso-users] Scalable SPARQL querying in PHP?
Hi Daniel, I've been using the ARC PHP libraries to query my local Virtuoso SPARQL end point. While this works fine for small amounts of data, the memory usage of paging through hundreds of pages of results is too much for my PHP process to handle. Is there a better way to do SPARQL querying against a local Virtuoso than using ARC? Feel free to tell me to RTFM, but i'd appreciate any thoughts you might have. Thanks, Dan Dan, What's the configuration of your machine? Basically, how much RAM is in place? BTW - Have you looked at the Virtuoso tunning guide? Links: 1. http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html I think this is related to ARC or PHP or the SPARQL query he sends and not the performance of the virtuoso data store. Daniel: make sure that what handle the paging is the sparql query by using LIMIT and OFFSET. Otherwise, a really big number of triples can be returned, and then PHP can choke with its memory if too many objects are created by ARC. So, if you are performing the paging using SPARQL, a small amount of data will be loaded in PHP objects (ARC) and will then be usable. Does this answer your question? Thanks, Take care, Fred
Re: [Virtuoso-users] Scalable SPARQL querying in PHP?
On 21 May 2009, at 17:30, Frederick Giasson wrote: Hi Daniel, I've been using the ARC PHP libraries to query my local Virtuoso SPARQL end point. While this works fine for small amounts of data, the memory usage of paging through hundreds of pages of results is too much for my PHP process to handle. Is there a better way to do SPARQL querying against a local Virtuoso than using ARC? Feel free to tell me to RTFM, but i'd appreciate any thoughts you might have. Thanks, Dan Dan, What's the configuration of your machine? Basically, how much RAM is in place? BTW - Have you looked at the Virtuoso tunning guide? Links: 1. http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html I think this is related to ARC or PHP or the SPARQL query he sends and not the performance of the virtuoso data store. Daniel: make sure that what handle the paging is the sparql query by using LIMIT and OFFSET. Otherwise, a really big number of triples can be returned, and then PHP can choke with its memory if too many objects are created by ARC. So, if you are performing the paging using SPARQL, a small amount of data will be loaded in PHP objects (ARC) and will then be usable. Does this answer your question? Hi Fred, You're right that it's a PHP issue - Virtuoso is returning results quickly. The problem is that even though PHP has a max memory of 4GB (out of the machine's 8GB) it still grinds to a halt and gets killed by the kernel after a number of hours of processing results. I'm using LIMIT and OFFSET in the SPARQL queries. As far as I can gather from looking at memory usage with xdebug, something that ARC uses (possibly the XML parser) is leaking memory even iteration, and this is adding up. Is there a better way to query virtuoso (with SPARQL queries) locally, rather than having to use the HTTP/XML endpoint? Thanks, Dan -- Daniel Alexander Smith IAM Group School of Electronics and Computer Science University of Southampton das...@ecs.soton.ac.uk
Re: [Virtuoso-users] Scalable SPARQL querying in PHP?
On 21 May 2009, at 17:34, Sören Auer wrote: Daniel Alexander Smith wrote: I've been using the ARC PHP libraries to query my local Virtuoso SPARQL end point. While this works fine for small amounts of data, the Why do you need the ARC libraries? You can just query Virtuoso via an ODBC connection. This is very scalable and there should be no performance problems on the PHP side. Aha! This sounds like what i've been looking for. Looks like there's tutorials on this too, it should be a snap. Thanks for everyone's quick replies! Best, Dan -- Daniel Alexander Smith IAM Group School of Electronics and Computer Science University of Southampton das...@ecs.soton.ac.uk
