Re: [Virtuoso-users] Virtuoso 5 encoding problems
Hello! Are there any news about about ADO.NET provider encoding problems? Regards, Alexander 2010/1/30 Alexander Sidorov alexi...@gmail.com So I have succeeded in uploading graph to database, but looks like it is not the end of the story :) After triples were uploaded using SPARQL INSERT DATA query, web-interface sparql showed non-english literals correctly. But then I tried to get these strings using .NET provider virtado3... and received garbage. As these strings are returned correctly through standard web-interface, the most probable problem reason was ADO.NET provider. I have looked through it's code using Reflector and found some code like: Encoding.GetEncoding(iso-8859-1).GetBytes(s) As iso-8859-1 is one-byte encoding, I think non-english symbols are just lost during conversion. Would be very grateful for any comments about this approach. 2010/1/30 Alexander Sidorov alexi...@gmail.com Hi Hugh, I have localized the problem and can be more specific now. I use two ways to add triples to the store: 1. SPARQL INSERT DATA query 2. DB.DBA.TTLP stored procedure The first way work normally, but the second stores triples with incorrect encoding (and nonenglish literals are displayed wrong). Regards, Alexander 2010/1/29 Hugh Williams hwilli...@openlinksw.com Hi Alexander, By what means are you inserting and retrieving the literals ? What are the literal values being inserted and what are the values that are being retrieved incorrectly ? If you can provide minimal steps to reproduce then we can attempt recreation in-house ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 29 Jan 2010, at 14:41, Alexander Sidorov wrote: Hello! I am using Virtuoso Open Source 5 and have problems storing and retrieving non-english literals. Virtuoso.ini: Charset = UTF-8 Is this a known problem? Regards, Alexander -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Virtuoso 5 encoding problems
Hi Alexander, The fix for this still being worked on and should be completed in the next few days ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 10 Feb 2010, at 00:59, Alexander Sidorov wrote: Hello! Are there any news about about ADO.NET provider encoding problems? Regards, Alexander 2010/1/30 Alexander Sidorov alexi...@gmail.com So I have succeeded in uploading graph to database, but looks like it is not the end of the story :) After triples were uploaded using SPARQL INSERT DATA query, web-interface sparql showed non-english literals correctly. But then I tried to get these strings using .NET provider virtado3... and received garbage. As these strings are returned correctly through standard web-interface, the most probable problem reason was ADO.NET provider. I have looked through it's code using Reflector and found some code like: Encoding.GetEncoding(iso-8859-1).GetBytes(s) As iso-8859-1 is one-byte encoding, I think non-english symbols are just lost during conversion. Would be very grateful for any comments about this approach. 2010/1/30 Alexander Sidorov alexi...@gmail.com Hi Hugh, I have localized the problem and can be more specific now. I use two ways to add triples to the store: 1. SPARQL INSERT DATA query 2. DB.DBA.TTLP stored procedure The first way work normally, but the second stores triples with incorrect encoding (and nonenglish literals are displayed wrong). Regards, Alexander 2010/1/29 Hugh Williams hwilli...@openlinksw.com Hi Alexander, By what means are you inserting and retrieving the literals ? What are the literal values being inserted and what are the values that are being retrieved incorrectly ? If you can provide minimal steps to reproduce then we can attempt recreation in-house ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 29 Jan 2010, at 14:41, Alexander Sidorov wrote: Hello! I am using Virtuoso Open Source 5 and have problems storing and retrieving non-english literals. Virtuoso.ini: Charset = UTF-8 Is this a known problem? Regards, Alexander -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Virtuoso 5 encoding problems
Hello Alexander, May I get a sample TTLP call statement that demonstrates the problem, please? (My mail client shows an attachment icon at your previous mail but no attachments, please re-attach in some different way if there were any) Best Regards, Ivan Mikhailov OpenLink Software http://virtuoso.openlinksw.com On Sat, 2010-01-30 at 01:04 +0600, Alexander Sidorov wrote: Hi Hugh, I have localized the problem and can be more specific now. I use two ways to add triples to the store: 1. SPARQL INSERT DATA query 2. DB.DBA.TTLP stored procedure The first way work normally, but the second stores triples with incorrect encoding (and nonenglish literals are displayed wrong). Regards, Alexander 2010/1/29 Hugh Williams hwilli...@openlinksw.com Hi Alexander, By what means are you inserting and retrieving the literals ? What are the literal values being inserted and what are the values that are being retrieved incorrectly ? If you can provide minimal steps to reproduce then we can attempt recreation in-house ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 29 Jan 2010, at 14:41, Alexander Sidorov wrote: Hello! I am using Virtuoso Open Source 5 and have problems storing and retrieving non-english literals. Virtuoso.ini: Charset = UTF-8 Is this a known problem? Regards, Alexander -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] Virtuoso 5 encoding problems
Hello Ivan, I use TTLP from .NET using virtado3. I have attached simplified source code and TTLP parameters values (.NET String is UTF-16). Regards, Alexander 2010/1/30 Ivan Mikhailov imikhai...@openlinksw.com Hello Alexander, May I get a sample TTLP call statement that demonstrates the problem, please? (My mail client shows an attachment icon at your previous mail but no attachments, please re-attach in some different way if there were any) Best Regards, Ivan Mikhailov OpenLink Software http://virtuoso.openlinksw.com On Sat, 2010-01-30 at 01:04 +0600, Alexander Sidorov wrote: Hi Hugh, I have localized the problem and can be more specific now. I use two ways to add triples to the store: 1. SPARQL INSERT DATA query 2. DB.DBA.TTLP stored procedure The first way work normally, but the second stores triples with incorrect encoding (and nonenglish literals are displayed wrong). Regards, Alexander 2010/1/29 Hugh Williams hwilli...@openlinksw.com Hi Alexander, By what means are you inserting and retrieving the literals ? What are the literal values being inserted and what are the values that are being retrieved incorrectly ? If you can provide minimal steps to reproduce then we can attempt recreation in-house ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 29 Jan 2010, at 14:41, Alexander Sidorov wrote: Hello! I am using Virtuoso Open Source 5 and have problems storing and retrieving non-english literals. Virtuoso.ini: Charset = UTF-8 Is this a known problem? Regards, Alexander -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users Source code: VirtuosoCommand cmd = new VirtuosoCommand(); cmd.CommandText = DB.DBA.TTLP(@data, @base, @graph, 1); cmd.Parameters.Add(data, data); cmd.Parameters.Add(base, baseUri); cmd.Parameters.Add(graph, baseUri); cmd.Connection = this._db; int result = cmd.ExecuteNonQuery(); Data: baseUri = http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl#; data = @base http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl#. @prefix rdf: http://www.w3.org/1999/02/22-rdf-syntax-ns#. @prefix rdfs: http://www.w3.org/2000/01/rdf-schema#. @prefix xsd: http://www.w3.org/2001/XMLSchema#. @prefix : http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl#. @prefix dc: http://purl.org/dc/elements/1.1/. @prefix CEEO: http://kms.cctpu.edu.ru/ontologies/2009/5/CEEO.owl#. @prefix owl2xml: http://www.w3.org/2006/12/owl2-xml#. @prefix TPU: http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl#. @prefix owl: http://www.w3.org/2002/07/owl#. @prefix CommonConceptOntology: http://kms.cctpu.edu.ru/ontologies/2009/5/CommonConceptOntology.owl#. @prefix TPU2: http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl#8. @prefix UniversityOntology: http://kms.cctpu.edu.ru/ontologies/2009/5/UniversityOntology.owl#. http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl rdf:type owl:Ontology. http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl owl:imports http://kms.cctpu.edu.ru/ontologies/2009/5/CEEO.owl. http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl owl:imports http://kms.cctpu.edu.ru/ontologies/2009/5/CommonConceptOntology.owl. http://kms.cctpu.edu.ru/ontologies/2009/5/TPU.owl
Re: [Virtuoso-users] Virtuoso 5 encoding problems
So I have succeeded in uploading graph to database, but looks like it is not the end of the story :) After triples were uploaded using SPARQL INSERT DATA query, web-interface sparql showed non-english literals correctly. But then I tried to get these strings using .NET provider virtado3... and received garbage. As these strings are returned correctly through standard web-interface, the most probable problem reason was ADO.NET provider. I have looked through it's code using Reflector and found some code like: Encoding.GetEncoding(iso-8859-1).GetBytes(s) As iso-8859-1 is one-byte encoding, I think non-english symbols are just lost during conversion. Would be very grateful for any comments about this approach. 2010/1/30 Alexander Sidorov alexi...@gmail.com Hi Hugh, I have localized the problem and can be more specific now. I use two ways to add triples to the store: 1. SPARQL INSERT DATA query 2. DB.DBA.TTLP stored procedure The first way work normally, but the second stores triples with incorrect encoding (and nonenglish literals are displayed wrong). Regards, Alexander 2010/1/29 Hugh Williams hwilli...@openlinksw.com Hi Alexander, By what means are you inserting and retrieving the literals ? What are the literal values being inserted and what are the values that are being retrieved incorrectly ? If you can provide minimal steps to reproduce then we can attempt recreation in-house ... Best Regards Hugh Williams Professional Services OpenLink Software Web: http://www.openlinksw.com Support: http://support.openlinksw.com Forums: http://boards.openlinksw.com/support Twitter: http://twitter.com/OpenLink On 29 Jan 2010, at 14:41, Alexander Sidorov wrote: Hello! I am using Virtuoso Open Source 5 and have problems storing and retrieving non-english literals. Virtuoso.ini: Charset = UTF-8 Is this a known problem? Regards, Alexander -- The Planet: dedicated and managed hosting, cloud storage, colocation Stay online with enterprise data centers and the best network in the business Choose flexible plans and management services without long-term contracts Personal 24x7 support from experience hosting pros just a phone call away. http://p.sf.net/sfu/theplanet-com___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
