Re: Fuseki growing in size and need for compaction

2024-04-23 Thread Mikael Pesonen
ion - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen Semantic Technologies e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: Text indexing stopped working

2023-11-30 Thread Mikael Pesonen
Unfortunately that's all there is. There was nothing in the log at the time of last index update. On 30/11/2023 13.56, Andy Seaborne wrote: There isn't much information to go. On 29/11/2023 09:50, Mikael Pesonen wrote: No idea? On 16/11/2023 13.11, Mikael Pesonen wrote: What could

Re: Text indexing stopped working

2023-11-29 Thread Mikael Pesonen
No idea? On 16/11/2023 13.11, Mikael Pesonen wrote: What could be the reason why new data is suddenly not added to text index and not found with Jena text queries? The newest files in Jena text index folder are zero sized _b_Lucene85FieldsIndexfile_pointers_n.tmp _b_Lucene85FieldsIndex

Text indexing stopped working

2023-11-16 Thread Mikael Pesonen
What could be the reason why new data is suddenly not added to text index and not found with Jena text queries? The newest files in Jena text index folder are zero sized _b_Lucene85FieldsIndexfile_pointers_n.tmp _b_Lucene85FieldsIndex-doc_ids_m.tmp dated 2023-11-13 although I have added lots

Re: Jena hangs on deleted files

2023-10-05 Thread Mikael Pesonen
and prolong the life of the drive Rob From: Mikael Pesonen Date: Monday, 11 September 2023 at 12:17 To: users@jena.apache.org Subject: Re: Jena hangs on deleted files There should not be other processes accessing the files. When jena is restarted, space from deleted files is released. On 09/09

Re: Post big file with curl

2023-09-28 Thread Mikael Pesonen
This was too obvious. Thanks! On 28/09/2023 14.13, Simon Bin wrote: combine -T with -X POST On Thu, 2023-09-28 at 13:11 +0300, Mikael Pesonen wrote: How do you do that? -T is PUT and -data-binary loads entire file into memory before sending so it's out of memory. -- Lingsoft - 30 years

Post big file with curl

2023-09-28 Thread Mikael Pesonen
How do you do that? -T is PUT and -data-binary loads entire file into memory before sending so it's out of memory.

Re: Jena hangs on deleted files

2023-09-13 Thread Mikael Pesonen
optimisation to not actually delete files until the holding process exits to avoid unnecessary write operations and prolong the life of the drive Rob From: Mikael Pesonen Date: Monday, 11 September 2023 at 12:17 To: users@jena.apache.org Subject: Re: Jena hangs on deleted files There should

Re: Jena hangs on deleted files

2023-09-11 Thread Mikael Pesonen
,not nece3ssarily java) is accessing the files. A process holding them open will stop them becoming recyclable by the OS.     Andy On 08/09/2023 13:09, Mikael Pesonen wrote: Just on a command line (dev system) /usr/bin/java -Xmx8G -jar fuseki-server.jar --update --port 3030 --config=../jena_config

Re: Jena hangs on deleted files

2023-09-08 Thread Mikael Pesonen
Just on a command line (dev system) /usr/bin/java -Xmx8G -jar fuseki-server.jar --update --port 3030 --config=../jena_config/fuseki_config.ttl On 08/09/2023 11.47, Andy Seaborne wrote: In a container? As a VM? On 08/09/2023 07:36, Mikael Pesonen wrote: We are using Ubuntu. On Thu, 7 Sept

Re: Jena hangs on deleted files

2023-09-08 Thread Mikael Pesonen
enJDK bug database such as: > > https://bugs.openjdk.org/browse/JDK-4715154 > > Andy > > On 07/09/2023 13:06, Mikael Pesonen wrote: > > > > We used deleteOld param. The 50 gigs are ghost files that are deleted > > but not released, that's what I meant by hangi

Re: Jena hangs on deleted files

2023-09-07 Thread Mikael Pesonen
compact https://jena.apache.org/documentation/fuseki2/fuseki-server-protocol.html#compact You can also delete the Data- that isn't the latest one in the database folder. Best regards, Øyvind On Thu, Sep 7, 2023 at 1:33 PM Mikael Pesonen wrote: After a while 25 gigs of files on data folder

Jena hangs on deleted files

2023-09-07 Thread Mikael Pesonen
After a while 25 gigs of files on data folder becomes 80 gigs of disk usage because Jena (4.6.1) doen't release files. Same with compact. Is this fixed in newer versions?

Re: NodeTableTRDF/Read exception

2023-06-19 Thread Mikael Pesonen
]: at org.apache.jena.fuseki.servlets.SPARQL_Update.execute(SPARQL_Update.java:229) ~[fuseki-server.jar:4.6.1] Jun 19 11:35:22 xxx.fi java[1047205]: [2023-06-19 11:35:22] Fuseki INFO  [34] 500 Server Error (30 ms) On 19/06/2023 12.45, Mikael Pesonen wrote: I deleted jena data folder

Re: NodeTableTRDF/Read exception

2023-06-19 Thread Mikael Pesonen
. TDB is not proof again other processes accessing the same files, including with shared network drives where different computers access the same filesystem.     Andy On 21/03/2022 11:39, Mikael Pesonen wrote: Got this again after few days of little usage after TDB2 was rebuilt from empty. Would

Re: NodeTableTRDF/Read exception

2023-05-15 Thread Mikael Pesonen
Normal updates work but this comes with clear graph. On 12/05/2023 14.58, Mikael Pesonen wrote: Got this NodeTableTRDF/Read again in our production environment. I got message from admin that Jena had unusually high memory consumption and it suddenly normalized yesterday. Maybe it could

Re: NodeTableTRDF/Read exception

2023-05-12 Thread Mikael Pesonen
similar to this is on Android where something other process is messing about the files. TDB is not proof again other processes accessing the same files, including with shared network drives where different computers access the same filesystem.     Andy On 21/03/2022 11:39, Mikael Pesonen wrote

Re: Combine two columns in SPARQL

2023-04-27 Thread Mikael Pesonen
| ||| <https://example.org/foo#Animals> | "animalsfauna"@en ||| ||| <https://example.org/foo#Animals> | "animalsfaune" ||| ||-----| Do you have named graphs or something? I mean, is just one column empty or the whole resultse

Re: Combine two columns in SPARQL

2023-04-24 Thread Mikael Pesonen
Thanks for testing it. So wonder what it causing the empty values on my case. On 24/04/2023 16.42, James Anderson wrote: that would matter. i make a dataset with strings: https://dydra.com/test/test/first_10_types.html On 24. Apr 2023, at 15:22, Mikael Pesonen wrote: Okay so it should

Re: Combine two columns in SPARQL

2023-04-24 Thread Mikael Pesonen
Okay so it should work? I'm getting empty on Jena 4.6.1. Also tried bind(concat(str(?pl), str(?al)) as ?pl_al) just in case. On 24/04/2023 16.16, James Anderson wrote: good afternoon; On 24. Apr 2023, at 14:18, Mikael Pesonen wrote: Not Jena question but hope someone can help. I have

Combine two columns in SPARQL

2023-04-24 Thread Mikael Pesonen
Not Jena question but hope someone can help. I have two columns with always equal amount of rows. How can they be combined into one column (variable)? This method doesn't work (example has different predicates): select ?s ?pl_al where {     ?s skos:prefLabel ?pl .     ?s skos:altLabel ?al .

Re: Server error with large truncated log

2023-04-24 Thread Mikael Pesonen
Do you have any idea what could mess up the log, or how to fix it? On 22/04/2023 15.57, Andy Seaborne wrote: On 20/04/2023 13:55, Mikael Pesonen wrote: Removing fi section results same error and also when removing OPTIONAL from en too. Query with all three languages work without OPTIONALs

Re: Server error with large truncated log

2023-04-21 Thread Mikael Pesonen
I forgot to mention that the query is done as federated call. Local call results an server error but bit more detail: check(??0, null): null node value On 20/04/2023 15.36, Andy Seaborne wrote: On 20/04/2023 13:23, Mikael Pesonen wrote: I have a query with some counts for statistics

Re: Server error with large truncated log

2023-04-20 Thread Mikael Pesonen
/mikael1234/a0ed6b4947d392b5798ca29cdab69b1f On 20/04/2023 15.36, Andy Seaborne wrote: On 20/04/2023 13:23, Mikael Pesonen wrote: I have a query with some counts for statistics (only way I got them working)   { SELECT ?ls_id (count(distinct ?pl_fi) as ?fi_count) WHERE { GRAPH ?ls_id

Server error with large truncated log

2023-04-20 Thread Mikael Pesonen
I have a query with some counts for statistics (only way I got them working) { SELECT ?ls_id (count(distinct ?pl_fi) as ?fi_count) WHERE { GRAPH ?ls_id {   ?c skos:prefLabel ?pl_fi FILTER(LANG(?pl_fi) = "fi")     }}  GROUP BY ?ls_id   }     OPTIONAL {     { SELECT ?ls_id

Re: Strategies to avoid log flooding

2023-03-29 Thread Mikael Pesonen
s these warnings Issuing millions of instances of the same identical warning certainly seems like a bug to me, especially since this is elicited by query input it could potentially be abused as a DoS attack vector. Rob From: Mikael Pesonen Date: Wednesday, 29 March 2023 at 10:22 To:

Re: Strategies to avoid log flooding

2023-03-29 Thread Mikael Pesonen
eate a Log4j configuration that disables logging for the specific offending logger (assuming that this is a sufficiently specific logger to not suppress actually relevant logging) Rob From: Mikael Pesonen Date: Tuesday, 28 March 2023 at 11:21 To: users@jena.apache.org Subject: Strategies to avoi

Strategies to avoid log flooding

2023-03-28 Thread Mikael Pesonen
Hi, there are some cases where Jena generates dozens of gigs, maybe even terabytes, of log in one query. If you add a bad REGEX, it generates a long warning level exception for every row in db, or atleast million of them (disk filled up so don't know). Is there another way to avoid this

Re: Minus in shortened URL

2023-02-16 Thread Mikael Pesonen
Thanks! On Wed, 15 Feb 2023 at 21:08, Andy Seaborne wrote: > > > On 15/02/2023 14:05, Mikael Pesonen wrote: > > > > This works: > > <https://www.example.com/-30> > > > > but this results error Expected IRI for predicate: got: [INTEGER:-30]:

Minus in shortened URL

2023-02-15 Thread Mikael Pesonen
This works: but this results error Expected IRI for predicate: got: [INTEGER:-30]: @prefix id: . id:-30 a skos:Concept Latter should be legal?

Re: How to handle optional lists in SPARQL

2022-12-21 Thread Mikael Pesonen
)              ] . Cheers, Lorenz On 12.12.22 13:49, Mikael Pesonen wrote: Is there a shortcut for making queries where a data value can be single item or list of items? For example this is how I do a query now using UNION. Both parts are id

How to handle optional lists in SPARQL

2022-12-12 Thread Mikael Pesonen
Is there a shortcut for making queries where a data value can be single item or list of items? For example this is how I do a query now using UNION. Both parts are identical except for the single/list section in owl:someValuesFrom []. This is still somewhat readable but if there are

Re: Weird sparql problem

2022-11-15 Thread Mikael Pesonen
69p [2]: http://daslab.seas.harvard.edu/reading-group/papers/volcano.pdf From: Mikael Pesonen Date: Tuesday, 8 November 2022 at 11:04 To: users@jena.apache.org Subject: Re: Weird sparql problem Both your suggestions for rewriting the query worked. I'm lost with the reasons, but for future cases, br

Re: Weird sparql problem

2022-11-08 Thread Mikael Pesonen
:b0 . ?cskos:inScheme lsu:SNOMEDCT_US } without stats and based on heuristics (e.g. number of variables in triple pattern), otherwise the last triple pattern might always be evaluated first On 03.11.22 11:11, Mikael Pesonen wrote: Here's the parse, hope it helps: WHERE { VALUES ?sct_code

Re: Weird sparql problem

2022-11-08 Thread Mikael Pesonen
ristics (e.g. number of variables in triple pattern), otherwise the last triple pattern might always be evaluated first On 03.11.22 11:11, Mikael Pesonen wrote: Here's the parse, hope it helps: WHERE   { VALUES ?sct_code { "298314008" }     ?c    skosxl:prefLabel  _:b0 .     _:b0  lsu:co

Re: Weird sparql problem

2022-11-03 Thread Mikael Pesonen
ggests this may be the optimiser making a bad guess at the appropriate order in which to evaluate the triple patterns within the BGP but without the larger query context or the algebra all we can do is guess. Rob From: Mikael Pesonen Date: Tuesday, 1 November 2022 at 12:53 To: users@jena.apache.

Re: Weird sparql problem

2022-11-03 Thread Mikael Pesonen
From: Mikael Pesonen Date: Tuesday, 1 November 2022 at 12:53 To: users@jena.apache.org Subject: Re: Weird sparql problem Diferent case, but again hanging makes no sense to user, whatever are the technical reasons. VALUES ?sct_code { "298314008" } ?c skosxl:prefLabel [ lsu:code

Re: Compact does nothing

2022-11-03 Thread Mikael Pesonen
Ah, forgot that, thanks! On 02/11/2022 18.58, Andy Seaborne wrote: On 02/11/2022 16:25, Mikael Pesonen wrote: Should compact wok without additional configuration? This curl -X POST http://localhost:3030/$/compact/ds ran for maybe 30 minutes but didn't free any disk space. I have Jena

Compact does nothing

2022-11-02 Thread Mikael Pesonen
Should compact wok without additional configuration? This curl -X POST http://localhost:3030/$/compact/ds ran for maybe 30 minutes but didn't free any disk space. I have Jena data size of 110Gb and deleted about half of data with sparql before compact.

Re: Weird sparql problem

2022-11-02 Thread Mikael Pesonen
8" AS ?sct_code ) it would work for the second query? Looks the the query optimizer does the join in wrong order @Andy? On 01.11.22 13:52, Mikael Pesonen wrote: Diferent case, but again hanging makes no sense to user, whatever are the technical reasons.  VALUES ?sct_code { "298314008&

Re: Weird sparql problem

2022-11-01 Thread Mikael Pesonen
[ lsu:code ?sct_code ]; skos:inScheme lsu:SNOMEDCT_US hangs forever  skos:inScheme lsu:SNOMEDCT_US; On 18/10/2022 9.08, Lorenz Buehmann wrote: Hi, comments inline On 17.10.22 14:35, Mikael Pesonen wrote: This works as a separate query, but not in a the middle, since ?s gets new values instead of bi

Re: Jena won't start (404)

2022-10-21 Thread Mikael Pesonen
4.6.1 gui I also get 404 on the same path you use. When I click around in the new UI the URI is http://localhost:3030/#/ for dataset and http://localhost:3030/#/manage for admin actions. Best regards, Øyvind Gjesdal On Fri, Oct 21, 2022 at 12:27 PM Mikael Pesonen wrote: jena-fuseki-4.3.2 works

Re: Jena won't start (404)

2022-10-21 Thread Mikael Pesonen
jena-fuseki-4.3.2 works in same setup, 4.6.0 and 4.6.1 don't. Any idea? On 17/10/2022 16.45, Mikael Pesonen wrote: Also /opt/xx/jena is link to /opt/xx/apache-jena-fuseki-4.6.1 On 17/10/2022 16.42, Mikael Pesonen wrote: We have installation where jena data and text folders are soft links

Re: SPARQL limit doesn't work

2022-10-20 Thread Mikael Pesonen
I had to reset all Jena data since server ran out of memory with drop graph. Now with clean data paging works. I'll let you know if problem repeats. On 20/10/2022 9.37, Lorenz Buehmann wrote: On 19.10.22 13:44, Mikael Pesonen wrote: On 19/10/2022 10.18, Lorenz Buehmann wrote: Honestly

Re: SPARQL limit doesn't work

2022-10-19 Thread Mikael Pesonen
ce? Unfortunately I can't share the data. Of course when time, I could create similar dummy index. What happens for a single property only? What does this mean? Pagination should work as you're doing, the Lucene query is internally executed once, then cached - for later requests the same Lucen

Re: SPARQL limit doesn't work

2022-10-19 Thread Mikael Pesonen
LIMIT would make it to the Lucene request On 18.10.22 13:35, Mikael Pesonen wrote: I have a bigger query that starts with inner select  { SELECT ?s ?score WHERE {     (?s ?score) text:query (skos:prefLabel skos:altLabel "\"xx yy\"" "lang:en" ) .     } order by de

SPARQL limit doesn't work

2022-10-18 Thread Mikael Pesonen
I have a bigger query that starts with inner select  { SELECT ?s ?score WHERE {     (?s ?score) text:query (skos:prefLabel skos:altLabel "\"xx yy\"" "lang:en" ) .     } order by desc(?score) offset 0 limit 1000 } There are about 1 results. limit 1000 returns ~560 and limit 100 ~75

Re: Jena won't start (404)

2022-10-17 Thread Mikael Pesonen
Also /opt/xx/jena is link to /opt/xx/apache-jena-fuseki-4.6.1 On 17/10/2022 16.42, Mikael Pesonen wrote: We have installation where jena data and text folders are soft links to another drive (not sure if related). When starting server, this occurs: Oct 17 16:24:45 systemd[1

Jena won't start (404)

2022-10-17 Thread Mikael Pesonen
We have installation where jena data and text folders are soft links to another drive (not sure if related). When starting server, this occurs: Oct 17 16:24:45 systemd[1]: fuseki.service: Consumed 7.547s CPU time. Oct 17 16:24:45 systemd[1]: Started Apache Jena Fuseki. Oct 17 16:24:46

Re: Weird sparql problem

2022-10-17 Thread Mikael Pesonen
This works as a separate query, but not in a the middle, since ?s gets new values instead of binding to previous ?s. { select ?t where { ?s a ?t .  } limit 10}   ?t skos:prefLabel ?l On 17/10/2022 14.56, Mikael Pesonen wrote: ?s a ?t .   ?t skos:prefLabel ?l returns 3 million triples. Maybe

Re: Weird sparql problem

2022-10-17 Thread Mikael Pesonen
? Is it also stuck of your run the query directly after you restart Fuseki? On 19.09.22 13:49, Mikael Pesonen wrote: On 15/09/2022 17.48, Lorenz Buehmann wrote: Forgot: - size of result for each triple pattern? Might affect if hash join can be used. It's one row for each. - your hardware? Normal

Re: Weird sparql problem

2022-09-21 Thread Mikael Pesonen
? Is it also stuck of your run the query directly after you restart Fuseki? On 19.09.22 13:49, Mikael Pesonen wrote: On 15/09/2022 17.48, Lorenz Buehmann wrote: Forgot: - size of result for each triple pattern? Might affect if hash join can be used. It's one row for each. - your hardware? Normal

Re: Weird sparql problem

2022-09-19 Thread Mikael Pesonen
? Note, there was also a bug in a recent Jena version, but only with TDB and too many open connections. It has been resolved with release 4.6.1. Jena has been running quite a while. Might not be related, but I'm mentioning all things here nevertheless. On 15.09.22 11:16, Mikael Pesonen wrote

Re: Weird sparql problem

2022-09-19 Thread Mikael Pesonen
.09.22 11:16, Mikael Pesonen wrote: This returns one row fast, say :C1 SELECT * FROM <https://a.b.c> WHERE {   <https://x.y.z> a ?t .   #?t skos:prefLabel ?l } and this too: SELECT * FROM <https://a.b.c> WHERE {   #<https://x.y.z> a ?t .   :C1 skos:prefLabel ?l }

Weird sparql problem

2022-09-15 Thread Mikael Pesonen
This returns one row fast, say :C1 SELECT * FROM WHERE {   a ?t .   #?t skos:prefLabel ?l } and this too: SELECT * FROM WHERE {   # a ?t .   :C1 skos:prefLabel ?l } But this always hangs until timeout SELECT * FROM

Re: Store data in text/owl-functional format

2022-04-05 Thread Mikael Pesonen
, that would be a useful contribution to the community.  The brass ring would be to also enable use of reasoners via the owlapi reasoner interface. On 4/5/2022 4:52 AM, Mikael Pesonen wrote: Owlapi will work, thanks! On 04/04/2022 18.17, Steve Vestal wrote: I have done this manually using Protege

Re: Store data in text/owl-functional format

2022-04-05 Thread Mikael Pesonen
Owlapi will work, thanks! On 04/04/2022 18.17, Steve Vestal wrote: I have done this manually using Protege (convert ofn to RDF/XML). You could also look at https://github.com/owlcs/owlapi/ On 4/4/2022 8:53 AM, Mikael Pesonen wrote: Is it possible to send OWL in functional syntax to Jena

Store data in text/owl-functional format

2022-04-04 Thread Mikael Pesonen
Is it possible to send OWL in functional syntax to Jena? Fuseki says Unknown content type for triples: [text/owl-functional] when posting with curl.

Re: Safe delete & insert with Fuseki

2022-03-31 Thread Mikael Pesonen
{ ... } ; INSERT DATA { ... } Also, the WHERE clause in a DELETE-INSERT-WHERE can be used to "switch off" an operation.     Andy On 24/03/2022 13:17, Mikael Pesonen wrote: We have occasionally an issue with replace where inserting new data may fail after old data has been del

Re: Safe delete & insert with Fuseki

2022-03-28 Thread Mikael Pesonen
E { ... } WHERE { ... } > ; > INSERT DATA { ... } > > Also, the WHERE clause in a DELETE-INSERT-WHERE can be used to "switch > off" an operation. > > Andy > > On 24/03/2022 13:17, Mikael Pesonen wrote: > > > > We have occasionally an issue with repla

Safe delete & insert with Fuseki

2022-03-24 Thread Mikael Pesonen
We have occasionally an issue with replace where inserting new data may fail after old data has been deleted. What is the recommended way to do this kind of multipart SPARQL with Fuseki (not java)? First option comes to mind is to test if SPARQL insert is correct and WOULD be executed. Is

Re: NodeTableTRDF/Read exception

2022-03-22 Thread Mikael Pesonen
network drives where different computers access the same filesystem.     Andy On 21/03/2022 11:39, Mikael Pesonen wrote: Got this again after few days of little usage after TDB2 was rebuilt from empty. Would you suggest this is hw error? No possibility that its Jena error? On 28/05/2021 17.25

Re: NodeTableTRDF/Read exception

2022-03-21 Thread Mikael Pesonen
Got this again after few days of little usage after TDB2 was rebuilt from empty. Would you suggest this is hw error? No possibility that its Jena error? On 28/05/2021 17.25, Andy Seaborne wrote: On 28/05/2021 14:59, Mikael Pesonen wrote: I should try some older Jena/Fuseki version

Re: SPARQL optional limiting results

2022-03-18 Thread Mikael Pesonen
hen joined to ensure ?graph is the right value. On 18/03/2022 12:52, Mikael Pesonen wrote: Hi Martynas, So query below returns some extra columns (but fewer rows) with OPTIONAL. With OPTIONAL only one item is returned from graph http://www.yso.fi/onto/mesh/ <http://www.yso.fi/onto/mes

Re: SPARQL optional limiting results

2022-03-18 Thread Mikael Pesonen
s easy to see what's going on, for example on http://sparql.org/sparql.html. On Fri, Mar 18, 2022 at 11:52 AM Mikael Pesonen wrote: Is this a problem with query, not with Jena? On 15/03/2022 9.30, Lorenz Buehmann wrote: Hi, I'm probably misunderstanding the query, but what is the purp

Re: SPARQL optional limiting results

2022-03-18 Thread Mikael Pesonen
(quadpattern (quad ?*g0 ??5 skos:topConceptOf ?graph) Can you say what you want to achieve with the OPTIONAL maybe, it won't return any additional data as far as I can see. On 14.03.22 14:30, Mikael Pesonen wrote: Hi, not directly related to Jena, but I have a query in which o

Re: SPARQL optional limiting results

2022-03-15 Thread Mikael Pesonen
Can you say what you want to achieve with the OPTIONAL maybe, it won't return any additional data as far as I can see. On 14.03.22 14:30, Mikael Pesonen wrote: Hi, not directly related to Jena, but I have a query in which optional clause limits the number of results. I thought it's never possi

SPARQL optional limiting results

2022-03-14 Thread Mikael Pesonen
Hi, not directly related to Jena, but I have a query in which optional clause limits the number of results. I thought it's never possible. So below query returns less results with optional enabled. Wonder why is that and what would be the correct way to get optional data so than all rows are

Re: Does Jena need maintainance regarding to disk space?

2022-03-01 Thread Mikael Pesonen
nly) backup, rebuild from backup then stop the server and swap the databases.     Andy On 14/02/2022 11:39, Mikael Pesonen wrote: Hi, we have now 13M triples and space usage of Jena data folder is 88G which seems high. This is not including text index. Should we cleanup/compress/rebu

Re: Does Jena need maintainance regarding to disk space?

2022-02-18 Thread Mikael Pesonen
and see if anything unusual is in it.     Andy On 17/02/2022 13:46, Mikael Pesonen wrote: I get this exception with compact after couple of hours: 15:38:41 WARN  Compact :: [10] Exception in compact org.apache.jena.tdb2.TDBException: NodeTableTRDF/Read at org.apache.jena.tdb2

Re: Does Jena need maintainance regarding to disk space?

2022-02-17 Thread Mikael Pesonen
the server and swap the databases.     Andy On 14/02/2022 11:39, Mikael Pesonen wrote: Hi, we have now 13M triples and space usage of Jena data folder is 88G which seems high. This is not including text index. Should we cleanup/compress/rebuild etc the database regularly in order to k

Does Jena need maintainance regarding to disk space?

2022-02-14 Thread Mikael Pesonen
Hi, we have now 13M triples and space usage of Jena data folder is 88G which seems high. This is not including text index. Should we cleanup/compress/rebuild etc the database regularly in order to keep disk usage lower, or is this normal disk usage? BR

Access control for federated queries

2021-12-10 Thread Mikael Pesonen
Hi, is there a recommended way to handle access control for servers which are serving federated queries? So is it possible to configure which servers may access which graphs or datasets, for example?

Fuseki GUI 400 error on all queries

2021-12-09 Thread Mikael Pesonen
I've got strange problem with one Fuseki setup. Web GUI is generating somehow incorrect queries resulting error 400. Endpoint in GUI is set to /fuseki/ds which works on other setups. Also sparql update works, error occurs only on all select etc queries. Looking from browser developer tools,

Escaped control characters in strings with Fuseki

2021-06-02 Thread Mikael Pesonen
Hi, when posting turtle data with newlines, for example lsr:82b9a3b5-6cba-4bd3-95c3-d309e8362c5e         dcterms:title                 """2380 Bellow Control Valve"""@en . it's returned for construct query in escaped form lsr:82b9a3b5-6cba-4bd3-95c3-d309e8362c5e    dcterms:title

Re: NodeTableTRDF/Read exception

2021-05-28 Thread Mikael Pesonen
I should try some older Jena/Fuseki version? On 28/05/2021 16.49, Andy Seaborne wrote: On 28/05/2021 14:03, Mikael Pesonen wrote: No this is the fresh db, started from empty today. And plenty of disk space. So it's repeatble. With no Minimal, Verifiable, Complete Example, it'll have

Re: NodeTableTRDF/Read exception

2021-05-28 Thread Mikael Pesonen
No this is the fresh db, started from empty today. And plenty of disk space. On 28/05/2021 15.58, Andy Seaborne wrote: Why are you adding data to a broken database? On 28/05/2021 12:02, Mikael Pesonen wrote: Actually now it happened again. Same size, about 80MB of turtle, imported without

Re: NodeTableTRDF/Read exception

2021-05-28 Thread Mikael Pesonen
    Andy On 27/05/2021 15:56, Mikael Pesonen wrote: Tried with the invalid data on fresh db and it didn't cause this exception. So root cause happened probably way earlier and is unknown. On 20/05/2021 14.10, Andy Seaborne wrote: Please can we have a complete, minimal example. On 19/05/

Re: NodeTableTRDF/Read exception

2021-05-27 Thread Mikael Pesonen
Tried with the invalid data on fresh db and it didn't cause this exception. So root cause happened probably way earlier and is unknown. On 20/05/2021 14.10, Andy Seaborne wrote: Please can we have a complete, minimal example. On 19/05/2021 11:12, Mikael Pesonen wrote: More info

Re: Construct Quads on Apache Jena Fuseki

2021-05-26 Thread Mikael Pesonen
<http://example.com/> CONSTRUCT { GRAPH ?g { ?s  ?p ?o } } WHERE {   VALUES ?g { :g1 :g2 }   GRAPH ?g { ?s  ?p ?o } }     Andy On 26/05/2021 12:46, Mikael Pesonen wrote: Hi, sorry for replying to old thread. I would like to dump some graphs from corrupted db. Is there a way to dum

Re: Construct Quads on Apache Jena Fuseki

2021-05-26 Thread Mikael Pesonen
Hi, sorry for replying to old thread. I would like to dump some graphs from corrupted db. Is there a way to dump them with one quad query instead of dumping each graph separately as triples? On 03/12/2020 16.23, Ahmed Helal wrote: Hi, My query is: CONSTRUCT { graph ?g {?s ?p ?o}

Re: NodeTableTRDF/Read exception

2021-05-21 Thread Mikael Pesonen
Unfortunately the data is confidential. I can try to generate the same errors on reseted db if same thing happens. On 20/05/2021 14.10, Andy Seaborne wrote: Please can we have a complete, minimal example. On 19/05/2021 11:12, Mikael Pesonen wrote: More info on this. When the causes

Re: NodeTableTRDF/Read exception

2021-05-19 Thread Mikael Pesonen
org.apache.jena.tdb2.store.nodetable.NodeTableTRDF.readNodeFromTable(NodeTableTRDF.java:82) ~[fuseki-server.jar:3.17.0] ... 108 more 14:52:06 INFO  Fuseki  :: [24] 500 Server Error (12 ms) On 27/04/2021 13.22, Andy Seaborne wrote: On 27/04/2021 09:59, Mikael Pesonen wrote:

Re: NodeTableTRDF/Read exception

2021-05-19 Thread Mikael Pesonen
This error occurs with all actions related to same graph. So I can't for example drop or clear the graph anymore. Actions on other graphs work as usual. On 18/05/2021 18.02, Andy Seaborne wrote: On 18/05/2021 13:03, Mikael Pesonen wrote: This occurred again on another server. There were

Re: NodeTableTRDF/Read exception

2021-05-18 Thread Mikael Pesonen
/2021 13.22, Andy Seaborne wrote: On 27/04/2021 09:59, Mikael Pesonen wrote: That's our guess too, but would be nice to have some idea where to look for the cause. Does Jena/Fuseki handle disk full situations without corruption? It should do (the transaction aborts) which is why I was as

Re: Terms context

2021-04-29 Thread Mikael Pesonen
fi Speech Applications - Language Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kaup

Re: NodeTableTRDF/Read exception

2021-04-27 Thread Mikael Pesonen
Server just ran out of disk space, but it's since been on low usage so could have happened few months ago. And logs are only for 1 month... On 27/04/2021 13.22, Andy Seaborne wrote: On 27/04/2021 09:59, Mikael Pesonen wrote: That's our guess too, but would be nice to have some idea

Re: NodeTableTRDF/Read exception

2021-04-27 Thread Mikael Pesonen
Management - Translation - Reader's and Writer's Tools - Text Tools - E-books and M-books Mikael Pesonen System Engineer e-mail: mikael.peso...@lingsoft.fi Tel. +358 2 279 3300 Time zone: GMT+2 Helsinki Office Eteläranta 10 FI-00130 Helsinki FINLAND Turku Office Kauppiaskatu 5 A FI-20100 Turku FINLAND

Re: NodeTableTRDF/Read exception

2021-04-26 Thread Mikael Pesonen
Error (26.663 s) On 26/04/2021 13.24, Mikael Pesonen wrote: There are few of these too (I'm grepping journalctl with 'fuseki'): Mar 22 16:04:22 solid java[1398]: [2021-03-22 16:04:22] WebAppContext WARN  Failed startup of context o.e.j.w.WebAppContext@15dd5ac2{Apache Jena Fuseki Server,/,file

Re: NodeTableTRDF/Read exception

2021-04-26 Thread Mikael Pesonen
]: at org.apache.jena.assembler.assemblers.AssemblerGroup$PlainAssemblerGroup.openBySpecificType(AssemblerGroup.java:157) ~[fuseki-server.jar:3.17.0] On 26/04/2021 13.00, Andy Seaborne wrote: On 26/04/2021 10:19, Mikael Pesonen wrote: Is this correct one: Well, it's not the one you showed

Re: Dumping RDF data as human readable table

2021-04-26 Thread Mikael Pesonen
get a better idea of what you want to do. It won't work in a general case because RDF resources can have duplicate properties but CSV shouldn't have duplicate columns. On Thu, Apr 22, 2021 at 11:41 AM Mikael Pesonen wrote: I think that is for serializing the triplets as they are, in cleaner for

Re: NodeTableTRDF/Read exception

2021-04-26 Thread Mikael Pesonen
, Andy Seaborne wrote: On 23/04/2021 14:57, Mikael Pesonen wrote: Sorry here is the entire log It's a different log. [2] is now [5] Apr 23 16:23:49 solid java[1153]: [2021-04-23 16:23:49] Fuseki INFO  [5] POST http://nimisampo.lingsoft.fi:3030/ds Apr 23 16:23:49 solid java[1153]: [2021-04

Re: NodeTableTRDF/Read exception

2021-04-23 Thread Mikael Pesonen
-server.jar:3.17.0] Apr 23 16:23:49 solid java[1153]: at org.apache.jena.tdb2.store.nodetable.NodeTableTRDF.readNodeFromTable(NodeTableTRDF.java:82) ~[fuseki-server.jar:3.17.0] Apr 23 16:23:49 solid java[1153]: [2021-04-23 16:23:49] Fuseki INFO  [5] 500 Server Error (568 ms) On 23/04

NodeTableTRDF/Read exception

2021-04-23 Thread Mikael Pesonen
Hi, we get this exception now when starting Jena and it's not loading any data. I have no idea what is changed on the server. Apr 23 13:51:09 solid java[6846]: [2021-04-23 13:51:09] Fuseki WARN  [2] RC = 500 : NodeTableTRDF/Read Apr 23 13:51:09 solid java[6846]:

Re: Dumping RDF data as human readable table

2021-04-22 Thread Mikael Pesonen
t/csv" with SELECT results. On Thu, Apr 22, 2021 at 11:30 AM Mikael Pesonen wrote: Hi, not exactly Jena related, but does anyone know if there is a tool or sparql query that would read (almost) any kind of RDF data and make a csv sheet where each column has predicates as headers and value

Dumping RDF data as human readable table

2021-04-22 Thread Mikael Pesonen
Hi, not exactly Jena related, but does anyone know if there is a tool or sparql query that would read (almost) any kind of RDF data and make a csv sheet where each column has predicates as headers and values as cells. It would also be nice to get linked resources into the table the same

Re: 'Failed startup of context'

2021-03-23 Thread Mikael Pesonen
That was it, existing lock file in data folder. On 23/03/2021 10.33, Andy Seaborne wrote: That stacktrace looks like two stacktraces sliced together.  Maybe overlap, maybe missing cause line, maybe from two different processes. One is failing - On 22/03/2021 16:01, Mikael Pesonen wrote: We

'Failed startup of context'

2021-03-22 Thread Mikael Pesonen
We have updated Jena config from TDB to TDB2 and get error below the config. Identical config is working on another server with same setup... PREFIX :    <#> PREFIX fuseki:  PREFIX rdf: PREFIX rdfs:   

Re: Out of place: [EOF] while importing trig file

2021-03-15 Thread Mikael Pesonen
ast parsed graph/triple is. On 12/03/2021 15:17, Mikael Pesonen wrote: Hi, I'm trying to import 8G trig file which is dumped from Jena. However 16G of RAM isn't enough so I'm trying to split the trig file and import in parts. First part is 2600 lines, but import fails: ER

Re: Out of place: [EOF] while importing trig file

2021-03-15 Thread Mikael Pesonen
Or maybe a better question, is it possible to stream into Jena TDB big amounts of data with limited RAM? On 15/03/2021 12.22, Mikael Pesonen wrote: Sorry how do I get riot? It's not in Jena/Fuseki bin folder. On 12/03/2021 19.04, Andy Seaborne wrote: Maybe an unclosed string literal

  1   2   3   4   5   >