Highlighting text results

2019-05-27 Thread Mikael Pesonen
any idea what is wrong here? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
is On May 2, 2019, at 5:56 AM, Mikael Pesonen wrote: I'm using Jena 3.11, full server as jar, and have following text index config: <#indexLucene> a text:TextIndexLucene ; text:directory ; text:entityMap <#entMap> ; text:storeValues true ; text:an

Re: Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
ly collected at all? What would be the correctway to make this query? Number of documents is about 3000, and number or triplets per document is 10. On 02/05/2019 13:56, Mikael Pesonen wrote: I'm using Jena 3.11, full server as jar, and have following text index config: <#indexLucene> a text

Trouble with querying with language in Jena text

2019-05-02 Thread Mikael Pesonen
eading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki authentication

2019-04-30 Thread Mikael Pesonen
The data-access-control.html applies to Fuseki Main. 3.10.0 works for me. [] rdf:type fuseki:Server ;    fuseki:passwd "passwdFile";    fuseki:auth   "basic" ;    fuseki:allowedUsers "*";    .     Andy On 29/04/2019 16:26, Mikael Pesonen wrote: Entire config.ttl:

Re: Fuseki authentication

2019-04-29 Thread Mikael Pesonen
ot; ; fuseki:auth    "basic" ;      fuseki:allowedUsers    "*" ; Br On 29/04/2019 18:09, Andy Seaborne wrote: On 29/04/2019 15:42, Mikael Pesonen wrote: I'm using Fuseki 3.10.0 and following this guide: http://jena.staging.apache.org/documentation/fuseki2/data-acces

Re: Fuseki authentication

2019-04-29 Thread Mikael Pesonen
vice      fuseki:serviceUpdate    "update" ;   # SPARQL update service fuseki:serviceUpload    "upload" ;   # Non-SPARQL upload service fuseki:serviceReadWriteGraphStore "data" ; # SPARQL Graph store protocol (read and write) fuseki:dataset  

Fuseki authentication

2019-04-29 Thread Mikael Pesonen
ader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Using content with meta on text index

2019-02-28 Thread Mikael Pesonen
and Chris. My limited understanding of Lucene implies that only one JVM at a time can lock an index, but the last time I looked at that question was years ago, so take that with a bucket of salt. ajs6f On Feb 21, 2019, at 9:02 AM, Mikael Pesonen wrote: Reason I'm asking this is that now

Re: Using content with meta on text index

2019-02-21 Thread Mikael Pesonen
. For example we have query like content matches "language AND technology" & metadata matches dcterms:created > "2019-01-01" On 20/02/2019 10:46, Mikael Pesonen wrote: Not sure. Reading Jena text documentation, it states that external document contents can be added i

Re: Using content with meta on text index

2019-02-20 Thread Mikael Pesonen
AM, Mikael Pesonen wrote: Hi, Our system stores documents with separate rest API and document id's are stored, along with document metadata, to Jena db. we would like to make text queries that target both the document contents and meta data. Is there a recommended/supported way to make

Using content with meta on text index

2019-02-14 Thread Mikael Pesonen
and Lucene? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone

Re: Out of memory

2019-02-06 Thread Mikael Pesonen
profilers available. Rob On 05/02/2019, 11:07, "Mikael Pesonen" wrote: Tested with 16GB, and java mem usage goes up to 10G (virt 14G). Wondering what does the java -Xms do actually... There was no way to limit mem

Re: Out of memory

2019-02-05 Thread Mikael Pesonen
, 2019 at 9:43 AM Mikael Pesonen wrote: On 29/01/2019 16:28, Rob Vesse wrote: This may be partly a case of a simple looking query having unexpected execution semantics. Strictly speaking your query says select all triples in the specific graph then join them with these list of values for ?s. Now

Re: Out of memory

2019-01-30 Thread Mikael Pesonen
nd see how it does; watch the total memory usage. On Tue, Jan 29, 2019 at 9:43 AM Mikael Pesonen wrote: On 29/01/2019 16:28, Rob Vesse wrote: This may be partly a case of a simple looking query having unexpected execution semantics.  Strictly speaking your query says select al

Re: Out of memory

2019-01-30 Thread Mikael Pesonen
/2019, 14:06, "Mikael Pesonen" wrote: Server: /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/log4j.properties -Xmx5600M -jar fuseki-server.jar --update --port 3030 --loc=/home/text/tools/jena_data_test/ /ds

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
running and making GSP calls. Rob On 29/01/2019, 14:06, "Mikael Pesonen" wrote: Server: /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/log4j.properties -Xmx5600M -jar fuseki-server.jar --update --port 3030 -

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
In addition to reply to Andy, all queries are run in serial. On 29/01/2019 15:52, Rob Vesse wrote: Comments inline: On 29/01/2019, 11:34, "Mikael Pesonen" wrote: I'm not able to run a basic read-only script without running out of memory on

Re: Out of memory

2019-01-29 Thread Mikael Pesonen
ention the suspects like sorting. With all the questions on the list, I personally don't track the details of each installation so please also remind me of your current setup.     Andy On 29/01/2019 11:32, Mikael Pesonen wrote: I'm not able to run a basic read-only script without runni

Out of memory

2019-01-29 Thread Mikael Pesonen
. All settings are default, using GSP. -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso

Out of memory

2019-01-29 Thread Mikael Pesonen
. All settings are default, using GSP. Should I set some settings to avoid this behaviour? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael

Re: Using Jena text search with all predicates

2019-01-23 Thread Mikael Pesonen
- Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-23 Thread Mikael Pesonen
/fuseki-configuration.html You need to add fuseki:serviceQuery "sparql" as an additional entry to your fuseki:Service definition in order for it to respond to SPARQL queries on /ds/sparql Rob On 22/01/2019, 15:28, "Mikael Pesonen" wrote: This is the call Skosmos m

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
, but you may have trouble when restarting Fuseki text:directory Le 22/01/2019 à 16:21, Mikael Pesonen a écrit : Sorry had issues with permissions. So now I can load configuration from cmd line /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0/log4j.properties

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
This is the call Skosmos makes: GET http://localhost:3030/ds/sparql?query=... On 22/01/2019 17:21, Mikael Pesonen wrote: Sorry had issues with permissions. So now I can load configuration from cmd line /usr/bin/java -Dlog4j.configuration=file:/home/text/tools/apache-jena-fuseki-3.9.0

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
  [ text:field "label" ;    text:predicate skos:prefLabel ]      ) . <#service> rdf:type fuseki:Service ;     fuseki:name "/ds" ;   # http://host:port/ds-ro     fuseki:serviceQuery "query" ;    # SPARQL query servic

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
;     text:map ( [ text:field "label" ;    text:predicate skos:prefLabel ] ) . <#service> rdf:type fuseki:Service ;     fuseki:name "/ds" ;   # http://host:port/ds-ro     fuseki:serviceQuery "query" ;    # SPARQL q

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
eki:dataset   :text_dataset ;     . -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-22 Thread Mikael Pesonen
aph" ; ## enable graph-specific indexing text:map ( [ text:field "label" ; text:predicate skos:prefLabel ] ) ; . hth, Chris On Jan 21, 2019, at 5:21 AM, Mikael Pesonen wrote: Hi, On 18/01/2019 18:13, Chris Tomlinson wrote: Hi, 1)

Re: Text search from sparql

2019-01-21 Thread Mikael Pesonen
y is invoked, but may be a noop Thanks, Chris On Jan 18, 2019, at 8:08 AM, Mikael Pesonen wrote: On 18/01/2019 13:40, Andy Seaborne wrote: On 17/01/2019 15:45, Mikael Pesonen wrote: On 17/01/2019 17:38, Andy Seaborne wrote: On 17/01/2019 12:51, Mikael Pesonen wrote: On 17/01/2019 13:5

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
On 17/01/2019 17:38, Andy Seaborne wrote: On 17/01/2019 12:51, Mikael Pesonen wrote: On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be faster

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
Is that path file:///home/text/tools/apache-jena-fuseki-3.9.0/webapp/ correct, should it be file:/home/text/tools/apache-jena-fuseki-3.9.0/webapp/ ? Where does that setting come from? On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying

Re: Text search from sparql

2019-01-17 Thread Mikael Pesonen
On 17/01/2019 13:58, Andy Seaborne wrote: On 16/01/2019 12:50, Mikael Pesonen wrote: Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be faster. Application is term search using SKOS ontology.   First tested if it's enabled

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
on the page could be useful too. In the code I used I had to replace "<#dataset>" with ":tdb_dataset_readwrite Le 16/01/2019 à 15:47, Mikael Pesonen a écrit : Thanks for reply. Didn't find any info on fixed Uri on that page, it seemed to be about timeouts?

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
is in the config file (pasted on the page) but I thought the links on the page could be useful too. In the code I used I had to replace "<#dataset>" with ":tdb_dataset_readwrite Le 16/01/2019 à 15:47, Mikael Pesonen a écrit : Thanks for reply. Didn't find any info on f

Re: Text search from sparql

2019-01-16 Thread Mikael Pesonen
a fixed Uri for the dataset (see my question here : https://stackoverflow.com/questions/48318966/fuseki-config-for-2-datasets-text-index-how-to-use-turtle-files) Le 16/01/2019 à 13:50, Mikael Pesonen a écrit : Hi, I'm trying to get text search work. Sparql REGEX takes few seconds

Text search from sparql

2019-01-16 Thread Mikael Pesonen
Hi, I'm trying to get text search work. Sparql REGEX takes few seconds to finish so hoping this would be faster. Application is term search using SKOS ontology.  First tested if it's enabled by default  ?concept text:query (skos:prefLabel "medi") .   ?concept skos:prefLabel ?prefLabel

Error 500: RecordRangeIterator: records not strictly increasing

2018-09-07 Thread Mikael Pesonen
+) SELECT count(?subject) WHERE { graph ?g { ?subject ?predicate ?object }} -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen

Re: TransactionManager ERROR There are now active transactions

2018-08-23 Thread Mikael Pesonen
a simulator for your environment. Then, maybe, it will cause show the log message.  Or maybe not, because of all the different machinery. Maybe it is something to do with connection patterns.     Andy On 22/08/18 14:57, Mikael Pesonen wrote: Any luck reproducing the error yet? Br On 13.8.2018

Re: TransactionManager ERROR There are now active transactions

2018-08-22 Thread Mikael Pesonen
Any luck reproducing the error yet? Br On 13.8.2018 13:59, Mikael Pesonen wrote: Sorry https://www.dropbox.com/s/xy9d06ixjv8stif/fuseki_test.zip?dl=0 On 13.8.2018 13:32, Andy Seaborne wrote: On 13/08/18 11:12, Mikael Pesonen wrote: This was just an example, here is the test set

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
e" : "Lingsoft, Inc." } ] } I didn’t check whether this would be returned by the jena API (it should). Note the: "schema:provider" : { "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6; } instead of "schema:p

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
} } {   "@id" : "https://resource.lingsoft.fi/13229bdf-99bf-4030-a6e0-6afa8f281dc6;,   "@type" : "http://schema.org/Organization;,   "name" : "Lingsoft, Inc.",   "@context" : {     "name" : {   "@id" : "http://sc

Re: Attaching JSON-LD to web page for Google SEO

2018-08-17 Thread Mikael Pesonen
soft, Inc." }, by “name” : "Lingsoft, Inc.”, then the structured data testing tool doesn’t complain anymore. I’d be curious to know what schema.org’s people say about that. fps Le 16 août 2018 à 15:07, Mikael Pesonen a écrit : I'm exporting JSON-LD from Fuseki into web page, but Goo

Re: Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
Okay so looks like it might be better to look at microdata or RDFa at this point... I'll send them a note just in case. Thanks! On 16.8.2018 16:31, Damian Steer wrote: On 16 Aug 2018, at 14:07, Mikael Pesonen wrote: I'm exporting JSON-LD from Fuseki into web page, but Google's

Attaching JSON-LD to web page for Google SEO

2018-08-16 Thread Mikael Pesonen
>http://schema.org/name&quot</a>;     }   } } Google's validation says name is not a known valid target type for the name property and error is pointing to line containing the first  "name" : { Anyone got an idea what is wrong and how to fix the data? Sorry if this is

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
Sorry https://www.dropbox.com/s/xy9d06ixjv8stif/fuseki_test.zip?dl=0 On 13.8.2018 13:32, Andy Seaborne wrote: On 13/08/18 11:12, Mikael Pesonen wrote: This was just an example, here is the test set with instructions: https://www.dropbox.com/s/r1fd48v62822u2n/How%20to%20use%20the

Re: TransactionManager ERROR There are now active transactions

2018-08-13 Thread Mikael Pesonen
in the sequence of operations every time?     Andy On 10/08/18 15:17, Mikael Pesonen wrote: Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.2018 16:28, And

Re: TransactionManager ERROR There are now active transactions

2018-08-10 Thread Mikael Pesonen
Is this suitable format? Im not able to play with proxies and our technical support is not available for summer time. https://www.dropbox.com/s/3we10p1vsc89hnl/fuseki_dump.log?dl=0 On 9.8.2018 16:28, Andy Seaborne wrote: On 09/08/18 13:20, Mikael Pesonen wrote: Does Fuseki info level

Re: TransactionManager ERROR There are now active transactions

2018-08-07 Thread Mikael Pesonen
Are there any further tests I could do that might help solving this? On 6.8.2018 14:01, aj...@apache.org wrote: It tells us that the problem seems more likely to be with TDB than with Fuseki, which is a step towards isolating it. Adam On Mon, Aug 6, 2018, 5:55 AM Mikael Pesonen wrote

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
Sorry upcloud is Finnish cloud service provider. On 6.8.2018 12:55, Mikael Pesonen wrote: With in-memory db everything works. Ran ~5 operations x10 (10 scripts in parallel) and no problems. Mem usage was 3g-5,5g (java xmx4000) and vm 10g. So what does this tell? System is upcloud

Re: TransactionManager ERROR There are now active transactions

2018-08-06 Thread Mikael Pesonen
On Aug 3, 2018, at 8:01 AM, Mikael Pesonen wrote: Easier fix that sleeping was to add system wide semaphore which puts all concurrent requests to single queue. So the problem is in the way how Fuseki handles situation where (concurrent) requests are coming in faster that it can process

Re: TransactionManager ERROR There are now active transactions

2018-08-03 Thread Mikael Pesonen
error to client or sleep until there is more space in request queue. Br On 2.8.2018 17:18, Andy Seaborne wrote: On 02/08/18 12:56, Mikael Pesonen wrote: I dont have any configuration, so it's default? Command line: /usr/bin/java -Dlog4j.configuration=file:...log4j.properties -Xmx5600M

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
ndy Seaborne wrote: Fuseki configuration? The stacktrace isn't GSP. Im only calling /ds endpoint with php+curl >>> I'm not able to produce a sendable script that >>> would case these errors. It (still) looks like there is an environment factor.     Andy On 02/08/18

Re: TransactionManager ERROR There are now active transactions

2018-08-02 Thread Mikael Pesonen
:03, Andy Seaborne wrote: (subject line changed - this is not the original thread report) On 01/08/18 10:32, Mikael Pesonen wrote: Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could sleep and retry lat

Re: Fuseki errors with concurrent requests

2018-08-01 Thread Mikael Pesonen
Hi, is it somehow possible to get this error (TransactionManager ERROR There are now active transactions ) from Fuseki GSP so that client could sleep and retry later allowing db to finish the transaction? On 19.6.2018 23:56, Andy Seaborne wrote: On 18/06/18 11:36, Mikael Pesonen wrote

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
can do something like: log4.logger.org.apache.jena.sparql=WARN would set all the sparql logs to WARN level. Assuming you are using log4j. On Fri, Jun 29, 2018 at 12:40 PM, Mikael Pesonen wrote: Thanks for the reply. Our log is going to journald so I think it's compressed already. On 28.6.2018

Re: Suppressing SPARQL queries from log

2018-06-29 Thread Mikael Pesonen
log4j.appender.FusekiFileLog.layout=org.apache.log4j.PatternLayout log4j.appender.FusekiFileLog.layout.ConversionPattern=[%d{MMdd-HH:mm:ss}] %-10c{1} %-5p %m%n Mikael Pesonen wrote on 6/28/18 7:37 AM: Hi, we are having trouble with Fuseki log size. Easiest would be to switch to WARN level

Suppressing SPARQL queries from log

2018-06-28 Thread Mikael Pesonen
Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5

Re: How ro restore from backup?

2018-06-21 Thread Mikael Pesonen
e seeing may be the absence of mappings that aren't in use. Andy can say more about what might be happening with the indexes themselves or how this does or doesn't apply to TDB2. ajs6f On Jun 14, 2018, at 10:00 AM, Mikael Pesonen wrote: Just managed to load using tdbloader2, it even reads

Re: Fuseki errors with concurrent requests

2018-06-20 Thread Mikael Pesonen
Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki errors with concurrent requests

2018-06-18 Thread Mikael Pesonen
On 18.6.2018 13:30, Andy Seaborne wrote: On 18/06/18 10:55, Mikael Pesonen wrote: Hi Andy, On 18.6.2018 12:05, Andy Seaborne wrote: On 15/06/18 15:36, Mikael Pesonen wrote: Hi, unfortunately I haven't been able to make a standalone package yet. However with jena 3.7.0 things

Re: Fuseki errors with concurrent requests

2018-06-15 Thread Mikael Pesonen
that can be run by someone else including how the server is being run, what disk storage you are using, and whether the database starts from fresh or not. Does it happen on earlier versions of Fuseki?     Andy On 30/01/18 09:28, Mikael Pesonen wrote: Hi, My test is dependent of REST API we

Re: How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
On Jun 14, 2018, at 7:55 AM, Mikael Pesonen wrote: Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you -- Lingsoft - 30 years of Leading Language Management

How ro restore from backup?

2018-06-14 Thread Mikael Pesonen
Hi, made backup using Fuseki HTTP Administration Protocol: ds_2018-06-14_14-43-32.nq.gz How do I restore it in Linux? Empty existing data and use tdbloader2? How exactly? Thank you

Re: Querying used disk size

2018-06-05 Thread Mikael Pesonen
up over estimating to some extent. Rob On 04/06/2018, 13:18, "Mikael Pesonen" wrote: Hi, what would be best way to estimate how much disk space (bytes) a single graph is using in Fuseki? Only option that came to mind is to get entire db disk usag

Querying used disk size

2018-06-04 Thread Mikael Pesonen
estimate. Thank you -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
:38] Fuseki INFO  [1771] 500 Comparison method violates its general contract! (4.752 s) On 23.5.2018 14:14, Andy Seaborne wrote: The issue is data and query dependent. A shorter query and some data please!     Andy On 23/05/18 12:05, Mikael Pesonen wrote: How do I get it? The log

Re: Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
How do I get it? Fuseki is not crashing, just returns then error. Br On 23.5.2018 13:40, Rob Vesse wrote: A stack trace would be helpful... Rob On 23/05/2018, 11:15, "Mikael Pesonen" <mikael.peso...@lingsoft.fi> wrote: Hi, I'm geting this Java error with

Comparison method violates its general contract!

2018-05-23 Thread Mikael Pesonen
olean } ) } } GROUP BY ?p ?label ?range ORDER BY ASC(?label) -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engine

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" <mikael.peso...@lingsoft.fi> To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apach

Re: Limit memory usage of Fuseki server?

2018-04-10 Thread Mikael Pesonen
too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" <mikael.peso...@lingsoft.fi> To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? # Licensed under the terms of http://www.apache.org/licenses/LIC

Re: Splitting data into graphs vs datasets

2018-03-22 Thread Mikael Pesonen
has a permissions framework that can secure information down to the individual triple.) ajs6f On Mar 21, 2018, at 6:35 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Those sure are good reasons for using named graphs. But what about using different datasets too? btw, I couldn'

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
an run many datasets by using the --config argument and specifying an appropriate configuration file. This should be used instead of the --loc argument which is a convenience short cut to run a server with a single dataset. http://jena.apache.org/documentation/fuseki2/fuseki-configuration.html

Re: Splitting data into graphs vs datasets

2018-03-21 Thread Mikael Pesonen
in the same graph. You probably would not want to do this with a large default graph. On Tue, Mar 20, 2018 at 1:16 PM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Hi, I'm using Fuseki GSP, and so far have put all data into one default dataset and using graphs to split it. If I'm

Splitting data into graphs vs datasets

2018-03-20 Thread Mikael Pesonen
Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Fuseki errors with concurrent requests

2018-03-07 Thread Mikael Pesonen
with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest server. What would be preferred way to rebuild data?

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
? On 6.3.2018 12:32, Martynas Jusevičius wrote: Maybe you can make a reproducible using JMeter or such. On Tue, Mar 6, 2018 at 11:24 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18

Re: Fuseki errors with concurrent requests

2018-03-06 Thread Mikael Pesonen
Yes, clean install of Ubuntu, Jena etc. On 5.3.2018 17:40, Andy Seaborne wrote: On 05/03/18 15:04, Mikael Pesonen wrote: We are using GSP and our test script is doing ~20 json-ld inserts and sparql updates in a row ASAP, and we are running 10 test scripts concurrently. This test

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
producible measure. Many sites use Jena in production at all kinds of scales for all kinds of dimensions, including HA setups. If you can explain more about your specific situation, you will get more useful advice. ajs6f On Mar 5, 2018, at 9:45 AM, Mikael Pesonen <mikael.peso...@lings

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
you not start with them? Dumping RDF files on the side is not a bad idea either, but TDB backups (such as are produced by the software itself) should be fine for most disaster-recovery purposes. ajs6f On Mar 5, 2018, at 9:48 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Fortu

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
_any_ database, proper operation includes regular and frequent backups and a plan for rebuilding the store independently of any instance. You _do_ have backups, right? ajs6f On Mar 5, 2018, at 9:43 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Hi, we are using Jena TDP as THE da

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
instance from a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
a corrupted TDB instance. You should start with a known-good backup or original RDF files. ajs6f On Mar 5, 2018, at 9:32 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Still having these issues on all of our installations. I'm going to rule out corrupted database on our oldest

List of deployments

2018-03-05 Thread Mikael Pesonen
Is there available any kind of public list of production deployments of Jena databases? -- Lingsoft - 30 years of Leading Language Management www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael

Re: Fuseki errors with concurrent requests

2018-03-05 Thread Mikael Pesonen
On Jan 24, 2018, at 10:31 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: And running the test set with 1 concurrent loop, it was repeated 1 times without errors. So error occurs only with more than one concurrent operations. On 24.1.2018 17:40, ajs6f wrote: Please show

Re: Limit memory usage of Fuseki server?

2018-02-14 Thread Mikael Pesonen
/18 16:11, Laura Morales wrote: You should have another file for the dataset configuration too, inside "run/configuration/". Sent: Tuesday, February 06, 2018 at 4:13 PM From: "Mikael Pesonen" <mikael.peso...@lingsoft.fi> To: users@jena.apache.org Subject: Re: Limit mem

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
a:cxtName "arq:queryTimeout" ;  ja:cxtValue "3" ] ;    # Add any custom classes you want to load.    # Must have a "public static void init()" method.    # ja:loadClass "your.code.Class" ;    # End triples.    . On 6.2.2018 16:58, Lorenz Buehmann wrote: I gu

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
Hi, config.ttl is default from package. On 6.2.2018 16:58, Lorenz Buehmann wrote: I guess Andy was hoping to see the Fuseki config file(s) On 06.02.2018 15:56, Mikael Pesonen wrote: Is it this one? File: /lib/systemd/system/apache-jena-fuseki.service: [Unit] Description=Apache Jena Fuseki

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
-fuseki.service On 6.2.2018 16:46, Andy Seaborne wrote: What is the dataset/service setup? On 06/02/18 14:33, Mikael Pesonen wrote: I'm not good with Linux so don't know what setup means. We have Ubuntu 14.04, Jena Fuseki 3.6.0 with default config.ttl and running as a service. Test server which

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
it is not the system killing Fuseki, its the JVM exiting. With a single TDB, 12G is way too much heap (try 2G) but the figure may include mapped files.     Andy On 06/02/18 09:56, Mikael Pesonen wrote: Hi, ok I'll try that. I had out of memory error on other server now. Is there a place I could

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
it is not the system killing Fuseki, its the JVM exiting. With a single TDB, 12G is way too much heap (try 2G) but the figure may include mapped files.     Andy On 06/02/18 09:56, Mikael Pesonen wrote: Hi, ok I'll try that. I had out of memory error on other server now. Is there a place I could

Re: Fuseki errors with concurrent requests

2018-02-06 Thread Mikael Pesonen
hreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) On Jan 24, 2018, at 10:31 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: And running t

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
) and monitor how your VM responds Sent: Tuesday, February 06, 2018 at 9:22 AM From: "Mikael Pesonen" <mikael.peso...@lingsoft.fi> To: users@jena.apache.org Subject: Re: Limit memory usage of Fuseki server? Hi, config.ttl is defaut, Fuseki is ran as service, here is the log from

Re: Limit memory usage of Fuseki server?

2018-02-06 Thread Mikael Pesonen
memory it wants. You can do this with cgroups. Sent: Monday, February 05, 2018 at 12:56 PM From: "Mikael Pesonen" <mikael.peso...@lingsoft.fi> To: users@jena.apache.org Subject: Limit memory usage of Fuseki server? We have a cloud server with 4gb of memory and after a while sy

Limit memory usage of Fuseki server?

2018-02-05 Thread Mikael Pesonen
www.lingsoft.fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki

Re: Fuseki errors with concurrent requests

2018-01-30 Thread Mikael Pesonen
Fuseki?     Andy On 30/01/18 09:28, Mikael Pesonen wrote: Hi, My test is dependent of REST API we developed. So basically simultaneous calls to Apahe web server which loads php which calls Fuseki using curl. On 29.1.2018 16:56, ajs6f wrote: That might be worth trying, although since TDB1 i

Re: Fuseki errors with concurrent requests

2018-01-30 Thread Mikael Pesonen
of updates should be going on on the server-side. I haven't had time to look at this issue, and it's difficult to say much without a reproducible phenomenon. Do you either of y'all have test code we can use to demonstrate this? ajs6f On Jan 29, 2018, at 5:43 AM, Mikael Pesonen <mikael.p

Re: Fuseki errors with concurrent requests

2018-01-29 Thread Mikael Pesonen
cutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) On Jan 24, 2018, at 10:31 AM, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: And running the test set with 1 concurrent l

Re: Concurrency with Jena/GSP

2018-01-25 Thread Mikael Pesonen
is an MRSW lock so visibility is atomic unless you have some quite complex multi-dataset setup with shared models. What's behind the question? Andy On 24 January 2018 at 08:35, Mikael Pesonen <mikael.peso...@lingsoft.fi> wrote: Sorry meant to ask, if I POST a large dataset

<    1   2   3   4   5   >