Slow query when getting rdf:type

2017-10-26 Thread Mikael Pesonen
Hi, I have trouble understanding why the first query is slow and second one is fast. Using Jena Fuseki 3.4.0. So I want to get all resources that reference , and their types: SELECT * WHERE { GRAPH ?g { ?s ?p . ?s a ?type } } SELECT

Re: Slow query when getting rdf:type

2017-10-27 Thread Mikael Pesonen
er to run this as only a single process is permitted to access a TDB database at a time Rob On 26/10/2017 13:47, "Mikael Pesonen" wrote: Hi, I have trouble understanding why the first query is slow and second one is fast. Using Jena Fuseki 3.4.0. So I

Re: Slow query when getting rdf:type

2017-10-27 Thread Mikael Pesonen
10/17 10:22, Mikael Pesonen wrote: Hi, thanks! I'll try that when get chance to stop jena. Yes we are using TDB. On 26.10.2017 16:15, Rob Vesse wrote: Is TDB the underlying database? If so is there a stats.opt  file in your database directory? I remember there being issues in t

Re: Slow query when getting rdf:type

2017-10-27 Thread Mikael Pesonen
/1999/02/22-rdf-syntax-ns#type> ?type) ) (quadpattern   (quad ?g ?s ?p )   (quad ?g ?s ?p2 ?o2) ))) Are you using inference as well? Is it the same ? Is the timing for the rdf:type variant on a cold system?     Andy On 27/10/17 10:22, Mikael Pesonen wrote: Hi, thanks! I'll try that

Re: Slow query when getting rdf:type

2017-11-07 Thread Mikael Pesonen
)   (<http://purl.org/dc/terms/type> 1624)   (<http://purl.org/dc/terms/accessRights> 2)   (<http://purl.org/dc/terms/identifier> 78) ... On 30.10.2017 17:10, Andy Seaborne wrote: Mikael, I can't find anything that makes rdf:type special.  Maybe some distribution of data is th

distinct in SPARQL group_concat

2017-11-07 Thread Mikael Pesonen
with language labels stripped out of the values? If this works how it should, is there an easy way to remove duplicates? Br, Mikael -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer'

Re: Slow query when getting rdf:type

2017-11-07 Thread Mikael Pesonen
ent you again. Please read the _entire_ page carefully. Under: http://jena.apache.org/documentation/tdb/optimizer.html#generating-a-statistics-file You will see: "The command line tdbstats will scan the data and produce a rules file based on the frequency of properties. The output should f

Re: distinct in SPARQL group_concat

2017-11-07 Thread Mikael Pesonen
e but different language tags ar not identical. On Tue, Nov 7, 2017 at 3:34 PM, Mikael Pesonen wrote: Hi, in FOAF schema there are values rdfs:label <https://insight-dev.lingsoft.fi/browse.php?s=http%3A%2F%2Fw ww.w3.org%2F2000%2F01%2Frdf-schema%23label> Agent rdfs:label <h

Re: Slow query when getting rdf:type

2017-11-07 Thread Mikael Pesonen
optimize the execution of queries. Any change you would expect to see in behavior will occur at query time. Try your queries again and see if there are changes in the execution times or query explanations. ajs6f Mikael Pesonen wrote on 11/7/17 9:43 AM: Thanks for the help. So outputted stats into

Re: Slow query when getting rdf:type

2017-11-08 Thread Mikael Pesonen
is "fixed".     Andy -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...

Re: distinct in SPARQL group_concat

2017-11-10 Thread Mikael Pesonen
Thanks, that worked! Br On 7.11.2017 20:31, Andy Seaborne wrote: Try adding a STR: SELECT (group_concat(distinct STR(?o_label_g); separator=", ") as ?o_label) On 07/11/17 14:55, Mikael Pesonen wrote: That is true, but since language tags are stripped from literals in group_c

Re: Slow query when getting rdf:type

2017-11-14 Thread Mikael Pesonen
ndy (the overall query counts would be useful as well). On 08/11/17 10:37, Mikael Pesonen wrote: Hi, only opt file is the stats.opt, and I made sure there was not such file before running the tool. Br On 8.11.2017 11:13, Andy Seaborne wrote: Mikael, Did the database directory have a stat

Similar results with full text search

2017-11-22 Thread Mikael Pesonen
Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Tu

Re: Similar results with full text search

2017-11-23 Thread Mikael Pesonen
37: Hi Mikael! Fuzzy search is a basic Lucene feature, just like prefix searches. You should be able to use it directly via jena-text using a query like ?s text:query "word~" or ?s text:query "word~1" There is AFAICT nothing to implement on the jena-text side as this alre

Re: Similar results with full text search

2017-11-23 Thread Mikael Pesonen
in ES, so it can also be queried outside Jena. If you had the documents + jena-text indexed metadata in ES, you could use ES facilities for similarity search and still do some things in SPARQL. -Osma Mikael Pesonen kirjoitti 23.11.2017 klo 12:59: Hi Osma! we have a set of documents and

Insert binary data using SPARQL

2017-12-08 Thread Mikael Pesonen
- E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Insert binary data using SPARQL

2017-12-08 Thread Mikael Pesonen
Thanks, that works! On 8.12.2017 13:41, Andy Seaborne wrote: By using xsd:base64Binary or xsd:hexBinary (and you'll need to encode them IIRC)     Andy On 08/12/17 10:10, Mikael Pesonen wrote: Hi, is it possible to insert few kBs of binary data into Jena (3.5.0) triplet using SPARQ

Fuseki export and import

2017-12-12 Thread Mikael Pesonen
1 column 1 of the JSON data" Tried exporting .ttl and .xml also. This worked before with some older version. Br, -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Te

Re: Fuseki export and import

2017-12-12 Thread Mikael Pesonen
Looks like s-get outputs now turtle regardless of file name extension. Is this changed at some point? On 12.12.2017 16:48, ajs6f wrote: What is in dump.rdf? You don't show any of your actual data here. Is it JSON? ajs6f On Dec 12, 2017, at 9:46 AM, Mikael Pesonen wrote: Hi,

Re: Fuseki export and import

2017-12-12 Thread Mikael Pesonen
VERB datasetURI graphName [file] e.g. s-put http://localhost:3030/dataset http://example/graph data.ttl ajs6f On Dec 12, 2017, at 9:58 AM, Mikael Pesonen wrote: Looks like s-get outputs now turtle regardless of file name extension. Is this changed at some point? On 12.12.2017 16:48, ajs6f

Reading JSON-LD into Jena

2017-12-22 Thread Mikael Pesonen
Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5

Re: Reading JSON-LD into Jena

2017-12-22 Thread Mikael Pesonen
Awesome, thanks for the tip! On 22.12.2017 13:34, ajs6f wrote: If your HTTP headers are correctly set (Content-type: application/ld+json), Fuseki can read JSON-LD perfectly well. ajs6f On Dec 22, 2017, at 6:26 AM, Mikael Pesonen wrote: Hi, this is not directly related to Jena, but we

Links in JSON-LD

2018-01-02 Thread Mikael Pesonen
;,         "dcterms": "http://purl.org/dc/terms/"; ... add datatype descriptions for dcterms:subject here     } } Thanks -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's

Re: Links in JSON-LD

2018-01-02 Thread Mikael Pesonen
    dcterms:subject <https://finto.fi/koko/fi/page/p57158> ;     dcterms:subject <https://finto.fi/koko/fi/page/p57159> . --- which agrees with the JSON playground. Which version are you using?     Andy On 02/01/18 12:36, Mikael Pesonen wrot

Re: Links in JSON-LD

2018-01-02 Thread Mikael Pesonen
<https://finto.fi/koko/fi/page/p57158> ;     dcterms:subject <https://finto.fi/koko/fi/page/p57159> . --- which agrees with the JSON playground. Which version are you using?     Andy On 02/01/18 12:36, Mikael Pesonen wrote: Hi, following JSON-L

Re: Links in JSON-LD

2018-01-02 Thread Mikael Pesonen
.org/dc/terms/> . _:b0    dc:identifier    "1234" ;     dcterms:subject <https://finto.fi/koko/fi/page/p57158> ;     dcterms:subject <https://finto.fi/koko/fi/page/p57159> .     Andy On 02/01/18 15:06, Mikael Pesonen wrote: Also tried with context {  

Re: Links in JSON-LD

2018-01-03 Thread Mikael Pesonen
Sorry I had a post processing that broke the code, so all good. Thanks, Mikael On 2.1.2018 22:49, Andy Seaborne wrote: Because curl does magic @ or {}?     Andy On 02/01/18 15:59, Mikael Pesonen wrote: Any idea what could be causing these? I'm using curl: $ch = curl

Getting JSON+LS with GSP

2018-01-03 Thread Mikael Pesonen
ng application/sparql-results+json also. What am I doing wrong? Thanks -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen Syste

Re: Getting JSON+LS with GSP

2018-01-04 Thread Mikael Pesonen
:27, Andy Seaborne wrote: JSON-LD is an RDF serialization, and not a SPARQL result set serialization. Make a CONSTRUCT query.     Andy On 03/01/18 10:23, Mikael Pesonen wrote: Hi, I'm making a simple query SELECT * WHERE {    GRAPH ?g    { <https://.../9f6c495c-1f99-4

Re: Getting JSON+LS with GSP

2018-01-05 Thread Mikael Pesonen
Hi, so the best way to achieve ordering is to export JSON-LD and reorder the result array in Jena client code and add "@list": true to context. Mikael On 4.1.2018 21:28, James Anderson wrote: good evening, On 2018-01-04, at 15:25, Mikael Pesonen wrote: Thanks, got it w

Re: Getting JSON+LS with GSP

2018-01-05 Thread Mikael Pesonen
anks On 4.1.2018 21:28, James Anderson wrote: good evening, On 2018-01-04, at 15:25, Mikael Pesonen wrote: Thanks, got it working now! This is not Jena related anymore, but any tip how to create an ordered list in JSON-LD format? CONSTRUCT just serializes triplets in unordered fashion. So I

Concurrency with Jena/GSP

2018-01-24 Thread Mikael Pesonen
ement www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 H

Re: Concurrency with Jena/GSP

2018-01-24 Thread Mikael Pesonen
Sorry meant to ask, if I POST a large dataset, is it possible that reader gets just some of the triplets but not all? On 24.1.2018 15:25, Mikael Pesonen wrote: I'm using Jena directly with HTTP (curl) and GSP. Are all db opetations atomic? If I PUT large JSON-LD data and rea

Fuseki errors with concurrent requests

2018-01-24 Thread Mikael Pesonen
) -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time z

Re: Fuseki errors with concurrent requests

2018-01-24 Thread Mikael Pesonen
going wrong when we don't know what is supposed to happen. ajs6f On Jan 24, 2018, at 10:26 AM, Mikael Pesonen wrote: Hi, I have a test script running 10 concurrent CRUD operations in a loop. After few operations I get HTTP error 500 and these are in fuseki server output. Am I doing so

Re: Fuseki errors with concurrent requests

2018-01-24 Thread Mikael Pesonen
en we don't know what is supposed to happen. ajs6f On Jan 24, 2018, at 10:26 AM, Mikael Pesonen wrote: Hi, I have a test script running 10 concurrent CRUD operations in a loop. After few operations I get HTTP error 500 and these are in fuseki server output. Am I doing something wrong here?

Re: Concurrency with Jena/GSP

2018-01-25 Thread Mikael Pesonen
e it is an MRSW lock so visibility is atomic unless you have some quite complex multi-dataset setup with shared models. What's behind the question? Andy On 24 January 2018 at 08:35, Mikael Pesonen wrote: Sorry meant to ask, if I POST a large dataset, is it possible that reader g

Re: Fuseki errors with concurrent requests

2018-01-29 Thread Mikael Pesonen
4) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) On Jan 24, 2018, at 10:31 AM, Mikael Pesonen wrote: And running the test set with 1 concurrent loop, it was repeated 1 times without errors. So error occ

Re: Fuseki errors with concurrent requests

2018-01-30 Thread Mikael Pesonen
of updates should be going on on the server-side. I haven't had time to look at this issue, and it's difficult to say much without a reproducible phenomenon. Do you either of y'all have test code we can use to demonstrate this? ajs6f On Jan 29, 2018, at 5:43 AM, Mikael Pesonen

Re: Fuseki errors with concurrent requests

2018-01-30 Thread Mikael Pesonen
Fuseki?     Andy On 30/01/18 09:28, Mikael Pesonen wrote: Hi, My test is dependent of REST API we developed. So basically simultaneous calls to Apahe web server which loads php which calls Fuseki using curl. On 29.1.2018 16:56, ajs6f wrote: That might be worth trying, although since TDB1 i

Limit memory usage of Fuseki server?

2018-02-05 Thread Mikael Pesonen
www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-0013

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
memory it wants. You can do this with cgroups. Sent: Monday, February 05, 2018 at 12:56 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Limit memory usage of Fuseki server? We have a cloud server with 4gb of memory and after a while system is killing Fuseki server j

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
) and monitor how your VM responds Sent: Tuesday, February 06, 2018 at 9:22 AM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? Hi, config.ttl is defaut, Fuseki is ran as service, here is the log from around the kill (notice

Re: Fuseki errors with concurrent requests

2018-02-06 Thread Mikael Pesonen
ent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) On Jan 24, 2018, at 10:31 AM, Mikael Pesonen wrote: And running the test set with 1 concurrent loop, it

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
so it is not the system killing Fuseki, its the JVM exiting. With a single TDB, 12G is way too much heap (try 2G) but the figure may include mapped files.     Andy On 06/02/18 09:56, Mikael Pesonen wrote: Hi, ok I'll try that. I had out of memory error on other server now. Is there

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
so it is not the system killing Fuseki, its the JVM exiting. With a single TDB, 12G is way too much heap (try 2G) but the figure may include mapped files.     Andy On 06/02/18 09:56, Mikael Pesonen wrote: Hi, ok I'll try that. I had out of memory error on other server now. Is there

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
ld you provide those please? and a complete minimal example.  The fact you can't create one points towards an environment/config/hardware issue, not a code bug.     Andy On 06/02/18 13:14, Mikael Pesonen wrote: Do you have now enough info for figuring out what's going on? It's a bu

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
-fuseki.service On 6.2.2018 16:46, Andy Seaborne wrote: What is the dataset/service setup? On 06/02/18 14:33, Mikael Pesonen wrote: I'm not good with Linux so don't know what setup means. We have Ubuntu 14.04, Jena Fuseki 3.6.0 with default config.ttl and running as a service. Test se

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
Hi, config.ttl is default from package. On 6.2.2018 16:58, Lorenz Buehmann wrote: I guess Andy was hoping to see the Fuseki config file(s) On 06.02.2018 15:56, Mikael Pesonen wrote: Is it this one? File: /lib/systemd/system/apache-jena-fuseki.service: [Unit] Description=Apache Jena Fuseki

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
a:cxtName "arq:queryTimeout" ;  ja:cxtValue "3" ] ;    # Add any custom classes you want to load.    # Must have a "public static void init()" method.    # ja:loadClass "your.code.Class" ;    # End triples.    . On 6.2.2018 16:58, Lorenz Buehmann wrote: I gu

Re: Limit memory usage of Fuseki server?

2018-02-14 Thread Mikael Pesonen
/18 16:11, Laura Morales wrote: You should have another file for the dataset configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # License

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
On Jan 24, 2018, at 10:31 AM, Mikael Pesonen wrote: And running the test set with 1 concurrent loop, it was repeated 1 times without errors. So error occurs only with more than one concurrent operations. On 24.1.2018 17:40, ajs6f wrote: Please show your code, including Fuseki

List of deployments

2018-03-05 Thread Mikael Pesonen
Is there available any kind of public list of production deployments of Jena databases? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-boo

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
rom a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. What would be pre

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
TDB instance from a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. Wha

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
_any_ database, proper operation includes regular and frequent backups and a plan for rebuilding the store independently of any instance. You _do_ have backups, right? ajs6f On Mar 5, 2018, at 9:43 AM, Mikael Pesonen wrote: Hi, we are using Jena TDP as THE database for document metadata. Data

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
would you not start with them? Dumping RDF files on the side is not a bad idea either, but TDB backups (such as are produced by the software itself) should be fine for most disaster-recovery purposes. ajs6f On Mar 5, 2018, at 9:48 AM, Mikael Pesonen wrote: Fortunately this is our develo

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
producible measure. Many sites use Jena in production at all kinds of scales for all kinds of dimensions, including HA setups. If you can explain more about your specific situation, you will get more useful advice. ajs6f On Mar 5, 2018, at 9:45 AM, Mikael Pesonen wrote: To be clear: c

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18 15:04, Mikael Pesonen wrote: We are using GSP and our test script is doing ~20 json-ld inserts and sparql updates in a row ASAP, and we are running 10 test scripts concurrently. This test is

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
nment? On 6.3.2018 12:32, Martynas Jusevičius wrote: Maybe you can make a reproducible using JMeter or such. On Tue, Mar 6, 2018 at 11:24 AM, Mikael Pesonen wrote: Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18 15:04, Mikael Pesonen wrote:

Re: Fuseki errors with concurrent requests

2018-03-07 Thread Mikael Pesonen
ith a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. What would be preferred way to rebuild data? Data folder: 5226102

Splitting data into graphs vs datasets

2018-03-20 Thread Mikael Pesonen
ons - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
ew version in the same graph. You probably would not want to do this with a large default graph. On Tue, Mar 20, 2018 at 1:16 PM, Mikael Pesonen wrote: Hi, I'm using Fuseki GSP, and so far have put all data into one default dataset and using graphs to split it. If I'm right there wou

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
an run many datasets by using the --config argument and specifying an appropriate configuration file. This should be used instead of the --loc argument which is a convenience short cut to run a server with a single dataset. http://jena.apache.org/documentation/fuseki2/fuseki-configuration

Re: Splitting data into graphs vs datasets

2018-03-22 Thread Mikael Pesonen
performance)? (Jena has a permissions framework that can secure information down to the individual triple.) ajs6f On Mar 21, 2018, at 6:35 AM, Mikael Pesonen wrote: Those sure are good reasons for using named graphs. But what about using different datasets too? btw, I couldn't fin

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
figuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apache.org/licenses/LICENSE-2.0 ## Fu

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
he dataset configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apache.org/licenses/LICENSE-2.0

Re: Limit memory usage of Fuseki server?

2018-04-11 Thread Mikael Pesonen
leaving it enabled to protect the wider system. Rob On 10/04/2018, 14:38, "Mikael Pesonen" wrote: More info: latest Fuseki query returned 200 so no error there. Apr 10 15:54:29 -- kernel: curl invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_

Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
sd:boolean } ) } } GROUP BY ?p ?label ?range ORDER BY ASC(?label) -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesone

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
How do I get it? Fuseki is not crashing, just returns then error. Br On 23.5.2018 13:40, Rob Vesse wrote: A stack trace would be helpful... Rob On 23/05/2018, 11:15, "Mikael Pesonen" wrote: Hi, I'm geting this Java error with following query (prefixes omitted)

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
14:16:38] Fuseki INFO  [1771] 500 Comparison method violates its general contract! (4.752 s) On 23.5.2018 14:14, Andy Seaborne wrote: The issue is data and query dependent. A shorter query and some data please!     Andy On 23/05/18 12:05, Mikael Pesonen wrote: How do I get it? Th

Querying used disk size

2018-06-04 Thread Mikael Pesonen
estimate. Thank you -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi T

Re: Querying used disk size

2018-06-05 Thread Mikael Pesonen
would end up over estimating to some extent. Rob On 04/06/2018, 13:18, "Mikael Pesonen" wrote: Hi, what would be best way to estimate how much disk space (bytes) a single graph is using in Fuseki? Only option that came to mind is to get entire db

How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you

Re: How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
Jun 14, 2018, at 7:55 AM, Mikael Pesonen wrote: Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you -- Lingsoft - 30 years of Leading Language Management

Re: Fuseki errors with concurrent requests

2018-06-15 Thread Mikael Pesonen
he details that can be run by someone else including how the server is being run, what disk storage you are using, and whether the database starts from fresh or not. Does it happen on earlier versions of Fuseki?     Andy On 30/01/18 09:28, Mikael Pesonen wrote: Hi, My test is dependent

Re: Fuseki errors with concurrent requests

2018-06-18 Thread Mikael Pesonen
Hi Andy, On 18.6.2018 12:05, Andy Seaborne wrote: On 15/06/18 15:36, Mikael Pesonen wrote: Hi, unfortunately I haven't been able to make a standalone package yet. However with jena 3.7.0 things are bit better now - errors occur less than before. "The errors" are whi

Re: Fuseki errors with concurrent requests

2018-06-18 Thread Mikael Pesonen
On 18.6.2018 13:30, Andy Seaborne wrote: On 18/06/18 10:55, Mikael Pesonen wrote: Hi Andy, On 18.6.2018 12:05, Andy Seaborne wrote: On 15/06/18 15:36, Mikael Pesonen wrote: Hi, unfortunately I haven't been able to make a standalone package yet. However with jena 3.7.0 thing

Re: Fuseki errors with concurrent requests

2018-06-20 Thread Mikael Pesonen
anslation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: How ro restore from backup?

2018-06-21 Thread Mikael Pesonen
", so part of what you are seeing may be the absence of mappings that aren't in use. Andy can say more about what might be happening with the indexes themselves or how this does or doesn't apply to TDB2. ajs6f On Jun 14, 2018, at 10:00 AM, Mikael Pesonen wrote: Just managed

Suppressing SPARQL queries from log

2018-06-28 Thread Mikael Pesonen
Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppi

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
ePattern='.'-MM-dd-HH log4j.appender.FusekiFileLog.layout=org.apache.log4j.PatternLayout log4j.appender.FusekiFileLog.layout.ConversionPattern=[%d{MMdd-HH:mm:ss}] %-10c{1} %-5p %m%n Mikael Pesonen wrote on 6/28/18 7:37 AM: Hi, we are having trouble with Fuseki log size. Easiest wou

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
t you can do something like: log4.logger.org.apache.jena.sparql=WARN would set all the sparql logs to WARN level. Assuming you are using log4j. On Fri, Jun 29, 2018 at 12:40 PM, Mikael Pesonen wrote: Thanks for the reply. Our log is going to journald so I think it's compressed already. On

Re: Fuseki errors with concurrent requests

2018-08-01 Thread Mikael Pesonen
Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could sleep and retry later allowing db to finish the transaction? On 19.6.2018 23:56, Andy Seaborne wrote: On 18/06/18 11:36, Mikael Pesonen wrote

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
ore On 2.8.2018 11:03, Andy Seaborne wrote: (subject line changed - this is not the original thread report) On 01/08/18 10:32, Mikael Pesonen wrote: Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
3.7.0. On 2.8.2018 12:40, Andy Seaborne wrote: version? On 02/08/18 10:06, Mikael Pesonen wrote: It does happen in our test environment on high load quite often. More sleep I put in the test script, less frequently error happens. Most of the time transactions are executed after the

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
56, Andy Seaborne wrote: Fuseki configuration? The stacktrace isn't GSP. Im only calling /ds endpoint with php+curl >>> I'm not able to produce a sendable script that >>> would case these errors. It (still) looks like there is an environment factor.     Andy

Re: TransactionManager ERROR There are now active transactions

2018-08-03 Thread Mikael Pesonen
error to client or sleep until there is more space in request queue. Br On 2.8.2018 17:18, Andy Seaborne wrote: On 02/08/18 12:56, Mikael Pesonen wrote: I dont have any configuration, so it's default? Command line: /usr/bin/java -Dlog4j.configuration=file:...log4j.properties -Xmx

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
ajs6f On Aug 3, 2018, at 8:01 AM, Mikael Pesonen wrote: Easier fix that sleeping was to add system wide semaphore which puts all concurrent requests to single queue. So the problem is in the way how Fuseki handles situation where (concurrent) requests are coming in faster that it can proce

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
Sorry upcloud is Finnish cloud service provider. On 6.8.2018 12:55, Mikael Pesonen wrote: With in-memory db everything works. Ran ~5 operations x10 (10 scripts in parallel) and no problems. Mem usage was 3g-5,5g (java xmx4000) and vm 10g. So what does this tell? System is upcloud

Re: TransactionManager ERROR There are now active transactions

2018-08-07 Thread Mikael Pesonen
Are there any further tests I could do that might help solving this? On 6.8.2018 14:01, aj...@apache.org wrote: It tells us that the problem seems more likely to be with TDB than with Fuseki, which is a step towards isolating it. Adam On Mon, Aug 6, 2018, 5:55 AM Mikael Pesonen wrote

Re: TransactionManager ERROR There are now active transactions

2018-08-09 Thread Mikael Pesonen
requests the scripts are making, then with a copy of the data, it might be possible to recreate the situation. Otherwise it's "something happened".  I can't see how to recreate it without a use case.     Andy On 07/08/18 10:06, Mikael Pesonen wrote: Are there any further t

Re: TransactionManager ERROR There are now active transactions

2018-08-10 Thread Mikael Pesonen
Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.2018 16:28, Andy Seaborne wrote: On 09/08/18 13:20, Mikael Pesonen wrote: Does Fuseki info level

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
e same place in the sequence of operations every time?     Andy On 10/08/18 15:17, Mikael Pesonen wrote: Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
Sorry https://www.dropbox.com/s/xy9d06ixjv8stif/fuseki_test.zip?dl=0 On 13.8.2018 13:32, Andy Seaborne wrote: On 13/08/18 11:12, Mikael Pesonen wrote: This was just an example, here is the test set with instructions: https://www.dropbox.com/s/r1fd48v62822u2n/How%20to%20use%20the

Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
;>http://schema.org/name"</a>;     }   } } Google's validation says name is not a known valid target type for the name property and error is pointing to line containing the first  "name" : { Anyone got an idea what is wrong and how to fix the data? Sorry if this

Re: Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
Okay so looks like it might be better to look at microdata or RDFa at this point... I'll send them a note just in case. Thanks! On 16.8.2018 16:31, Damian Steer wrote: On 16 Aug 2018, at 14:07, Mikael Pesonen wrote: I'm exporting JSON-LD from Fuseki into web page, bu

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
gsoft, Inc." }, by “name” : "Lingsoft, Inc.”, then the structured data testing tool doesn’t complain anymore. I’d be curious to know what schema.org’s people say about that. fps Le 16 août 2018 à 15:07, Mikael Pesonen a écrit : I'm exporting JSON-LD from Fuseki into we

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
t;http://schema.org/category";     }   } } {   "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6";,   "@type" : "http://schema.org/Organization";,   "name" : "Lingsoft, Inc.",   "@context" : {     &qu

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
rg/Organization";, "schema:name" : "Lingsoft, Inc." } ] } I didn’t check whether this would be returned by the jena API (it should). Note the: "schema:provider" : { "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6";

  1   2   3   4   5   >