[ANN] Apache Jena 4.5.0

2022-05-04 Thread Andy Seaborne
The Apache Jena development community is pleased to announce the release of Apache Jena 4.5.0 Next release: new in-memory graph In Apache Jena 4.6.0, the implementation of the standard memory graph (GraphMem) will change based on the contribution of a faster, more compact

Re: Interaction between Text indexing, Fuseki services & Data Access Control

2022-05-03 Thread Andy Seaborne
On 03/05/2022 15:56, Vilnis Termanis wrote: (fixing up the quote): My understanding is that, for updates, the stack of datasets is respected when deciding whether access the text index whereas for querying the dataset context is used, which is not stacked. I'm confused. "understanding of

Re: JSON-LD: 1.0 or 1.1

2022-04-27 Thread Andy Seaborne
Given the input so far, it seems JSON-LD 1.1 should be the default for both parsing and writing in the next release (Jena 4.5.0). Written JSON-LD would not include a @content entry "@version" - that breaks JSON-LD 1.0 processing. Andy On 11/03/2022 10:38, Andy Seaborne wrote

Re: JSON-LD: 1.0 or 1.1

2022-04-25 Thread Andy Seaborne
at 1:23 PM Andy Seaborne wrote: On 24/04/2022 12:05, Dan Brickley wrote: On Sun, 24 Apr 2022 at 11:12, Andy Seaborne wrote: Hi Dan, Could you point to this dependency in the specs because I can't find mention of JSONschema. "schema" mentions are schema.org (for examples),

Re: JSON-LD: 1.0 or 1.1

2022-04-24 Thread Andy Seaborne
On 24/04/2022 12:05, Dan Brickley wrote: On Sun, 24 Apr 2022 at 11:12, Andy Seaborne wrote: Hi Dan, Could you point to this dependency in the specs because I can't find mention of JSONschema. "schema" mentions are schema.org (for examples), XMLSchema (for datatypes) and

Re: JSON-LD: 1.0 or 1.1

2022-04-24 Thread Andy Seaborne
22 at 2:40 PM Paul Tyson wrote: On Apr 23, 2022, at 12:16, Andy Seaborne wrote: What should the default settings be JSON-LD 1.0 or 1.1? 1.1 would better meet my use cases. Thanks, —Paul

Re: JSON-LD: 1.0 or 1.1

2022-04-23 Thread Andy Seaborne
2022 at 11:39 AM Andy Seaborne wrote: Jena has both JSON 1.0, provided by jsonld-java, and JSON-LD 1.1, provided by Titanium. What should the default settings be? For parsing that means what is bound to "application/ld+json" and file extension .jsonld. For writing, it means what is s

Re: querying lots of quad files in block storage

2022-04-20 Thread Andy Seaborne
Justin, Are the query patterns spanning across the files? If not, then Another thought: filter the data in some way. keep the NQ files are the primary copy but if there are subsets of the data that make sense, run a process to extracts relevant part and build the database on that data.

Apache Jena - 10 years as an Apache Project.

2022-04-18 Thread Andy Seaborne
Today is the 10th anniversary of Apache Jena as a Top Level Project of the Apache Software Foundation!

Re: Interaction between Text indexing, Fuseki services & Data Access Control

2022-04-16 Thread Andy Seaborne
. We'll re-rest the aforementioned 2b & 3b cases. Regards, Vilnis On Fri, 8 Apr 2022 at 11:51, Andy Seaborne wrote: Hi Vilnis, On 07/04/2022 11:10, Vilnis Termanis wrote: Hi, In brief: Can Fuseki Data ACL be applied to text indexing? As a general point - a text index itself is not ACL

Re: ARQ variables with dashes

2022-04-08 Thread Andy Seaborne
to use a parser rule - either full query or modify the parser. Thanks for your help! Best regards, Barry -Original Message- From: Andy Seaborne Sent: dinsdag 5 april 2022 14:07 To: users@jena.apache.org Subject: Re: ARQ variables with dashes Inline. Summary : it didn't con

Re: Interaction between Text indexing, Fuseki services & Data Access Control

2022-04-08 Thread Andy Seaborne
Hi Vilnis, On 07/04/2022 11:10, Vilnis Termanis wrote: Hi, In brief: Can Fuseki Data ACL be applied to text indexing? As a general point - a text index itself is not ACL aware. It is setup ahead of time and does not index triples directly. The GeoSPARQL cache is probably similar (I'm less

Re: ARQ variables with dashes

2022-04-05 Thread Andy Seaborne
Inline. Summary : it didn't consume the whole input, only up to the end of the legal part. On 05/04/2022 12:43, Lorenz Buehmann wrote: Hi Barry, Did you try SPARQL1.1 parser instead? Afaik, ARQ was always beyond SPARQL 1.1 or better said, already before SPARQL 1.1 with some extensions.

Re: Ontology URI vs document URI

2022-04-01 Thread Andy Seaborne
On 26/03/2022 15:46, Martynas Jusevičius wrote: Hi, Using the ontology API, if one owl:imports an ontology URI such as into ontology model, the imported model gets cached under the "http://www.w3.org/ns/org#; key. However, given

Re: SHACL-based data extraction from a knowledge graph

2022-03-28 Thread Andy Seaborne
Some inspiration from ShEx may help. The "validation" process is defined by assigning triples to non-overlapping partitions defined by constraints. There can be more then one way to partition the triples in a disjunction or conjunction when there are multiple occurrences of triples matching

Re: error starting up jena

2022-03-28 Thread Andy Seaborne
Fuseki does not work with Tomcat 10. Tomcat 9 applications are incompatible with Tomcat 10. Tomcat 10 is a migration of JavaEE from javax.* to jakarta.* https://tomcat.apache.org/migration-10.html#Specification_APIs If you can't run Tomcat 9, try their conversion tool:

Re: Safe delete & insert with Fuseki

2022-03-26 Thread Andy Seaborne
If you put all the changes in one update request, they will be done atomically. DELETE { ... } WHERE { ... } ; INSERT DATA { ... } Also, the WHERE clause in a DELETE-INSERT-WHERE can be used to "switch off" an operation. Andy On 24/03/2022 13:17, Mikael Pesonen wrote: We have

Re: NodeTableTRDF/Read exception

2022-03-21 Thread Andy Seaborne
On 21/03/2022 11:39, Mikael Pesonen wrote: Got this again after few days of little usage after TDB2 was rebuilt from empty. Would you suggest this is hw error? No possibility that its Jena error? On 28/05/2021 17.25, Andy Seaborne wrote: On 28/05/2021 14:59, Mikael Pesonen wrote: I should try

Re: fuseki-4.4.0: --file option forces read-only mode

2022-03-21 Thread Andy Seaborne
Hi olivier, No reason I can think of except being clear that updates to the file will not be written back to the file. Given the user has explicitly given "--update", allowing update seems quite reasonable. Recorded: https://github.com/apache/jena/issues/1228 (we now have github issues

Re: SPARQL optional limiting results

2022-03-18 Thread Andy Seaborne
The OPTIONAL uses ?graph. So it isn't simple a matter of "optional adds rows" After the optional happens, there is a new condition on ?graph. The inside of GRAPH ?graph { inner } is executed then joined to ensure ?graph is the right value. On 18/03/2022 12:52, Mikael Pesonen wrote: Hi

Re: "oh dear, already have a slot" exception

2022-03-17 Thread Andy Seaborne
On 17/03/2022 11:56, Élie Roux wrote: Because that is the source being copied from. Is it TIM or TDB1? Oh it's all in memory, I read a dataset in a trig file, extract a graph, modify it, create a new dataset, add the new modified graph and save the file in trig. TIM = "Transactions In

Re: "oh dear, already have a slot" exception

2022-03-17 Thread Andy Seaborne
On 17/03/2022 10:53, Élie Roux wrote: addGraph is copying data from the m.getGraph into the new dataset. "createGeneral" is the version that does not copy, and makes a link to the original. By the way : DatasetGraphFactory Thanks, that actually made the bug disappear! It's still quite

Re: "oh dear, already have a slot" exception

2022-03-17 Thread Andy Seaborne
On 17/03/2022 09:22, Andy Seaborne wrote: On 17/03/2022 08:13, Élie Roux wrote: Dear all, I have some code that write hundreds of thousands of trig files (converting some XML data to RDF). I recently introduced a relatively minor change: some literals are now in a custom datatype, defined

Re: "oh dear, already have a slot" exception

2022-03-17 Thread Andy Seaborne
On 17/03/2022 08:13, Élie Roux wrote: Dear all, I have some code that write hundreds of thousands of trig files (converting some XML data to RDF). I recently introduced a relatively minor change: some literals are now in a custom datatype, defined here:

Re: JSON-LD: 1.0 or 1.1

2022-03-15 Thread Andy Seaborne
On 15/03/2022 18:13, Martynas Jusevičius wrote: Hi, Are the output "flavors" for JSON-LD 1.0 only then? https://jena.apache.org/documentation/io/rdf-output.html#json-ld Yes. On Fri, Mar 11, 2022 at 11:39 AM Andy Seaborne wrote: Jena has both JSON 1.0, provided by j

Github changes : issues and discussions features enabled.

2022-03-14 Thread Andy Seaborne
Hi - we've enabled the github "issues" and "discussions" areas on the code repo. These are additional channels for the project. There are no chanages to JIRA and no existing JIRA reports are lost. Gihub allows people to subscribe and get notifications to your github inbox. As well as github

JSON-LD: 1.0 or 1.1

2022-03-11 Thread Andy Seaborne
Jena has both JSON 1.0, provided by jsonld-java, and JSON-LD 1.1, provided by Titanium. What should the default settings be? For parsing that means what is bound to "application/ld+json" and file extension .jsonld. For writing, it means what is setup for Lang.JSONLD. This is two decisions

Re: Streaming JSON RowSets (JENA-2302)

2022-03-10 Thread Andy Seaborne
This PR is looking good. It'll be great to have true stream implementation of JSON results for the normal cases of a result set that "head" then the "results" array. Andy On 09/03/2022 10:37, Claus Stadler wrote: Dear all, I want to inform you of an active PR for making RowSets over

Re: Question about Jena capabilities/requirements

2022-03-09 Thread Andy Seaborne
On 09/03/2022 09:33, Goławski, Paweł wrote: Most of data being stored could be treat as dictionaries, so updates will be rather big but rarely. The number of simultaneous reads could be a few hundred maybe. Queries will need also Micro OWL Reasoner (at least) and acceptable response time is

Re: [4.3.2] Cannot invoke "org.apache.jena.rdf.model.Property.asNode()" because "org.apache.jena.vocabulary.RDF.type" is null

2022-03-09 Thread Andy Seaborne
On 09/03/2022 11:16, Martynas Jusevičius wrote: Hi, This appeared after Java upgrade from 11 to 17: WARN LocationMapper:188 - Error in configuration file: Cannot invoke "org.apache.jena.rdf.model.Property.asNode()" because "org.apache.jena.vocabulary.RDF.type" is null May be init related

Re: Moving triples from named graph to default graph

2022-03-08 Thread Andy Seaborne
SPARQL: MOVE GRAPH TO DEFAULT Doing an API copy then clear will work as well. Because the destination is the default graph and that already exists and may have data in it, it is a copy operation. Andy On 08/03/2022 06:03, Aayush Yadav wrote: Hi, I just wanted to check if there is

Re: Question about Jena capabilities/requirements

2022-03-08 Thread Andy Seaborne
Hi Paweł, The amount CPU is more determined by the number of concurrent users or other services. Even if a system is supporting 1000's, the number actually active at any given moment is much lower. The kinds of application using the system influence the complexity of the queries as well.

Re: JSON-LD writer always casts @language tags to lower-case

2022-03-07 Thread Andy Seaborne
for the time being we could add an option for our users to switch between 1.0 and 1.1. Holger On 2022-03-04 8:10 pm, Andy Seaborne wrote: Jena uses   jsonld-java for JSON-LD 1.0   titanium-json-ld for JSON-LD 1.1. (The default is JSON-LD 1.0.) jsonld-java lowercases titanium-json-ld does

Re: count the number of RDF triples

2022-03-06 Thread Andy Seaborne
On 06/03/2022 15:06, Hashim Khan wrote: Hi, I need to know, how can I count the number of RDF triples in a graph using jena? Model.size() https://jena.apache.org/documentation/javadoc/jena/org/apache/jena/rdf/model/Model.html#size() In SPARQL, use COUNT. Andy

Re: Can Fuseki SHACL-validate data before inserting them into the graph?

2022-03-05 Thread Andy Seaborne
On 04/03/2022 17:24, Moritz Orth wrote: Hello everyone, I’m currently playing around with SHACL in Jena and just asked myself: Can Fuseki validate data against SHACL shapes prior to inserting them into the graph, refusing to add them when they don’t conform with the shapes? No, not

Re: JSON-LD writer always casts @language tags to lower-case

2022-03-04 Thread Andy Seaborne
Jena uses jsonld-java for JSON-LD 1.0 titanium-json-ld for JSON-LD 1.1. (The default is JSON-LD 1.0.) jsonld-java lowercases titanium-json-ld does not. Is it an option for jsonld-java and jena just does not set it? Please confirm: The graph are isomorphic. c.f. bnodes. FWIW: RDFParser

Re: Fuseki Data Access Control + Shiro + webapp/fulljar

2022-03-03 Thread Andy Seaborne
untu 20.04 packaged maven is old (3.6.3) - so I hesitated before installing a standalone one :-) Regards, Vilnis On Wed, 2 Mar 2022 at 16:59, Andy Seaborne wrote: Hi Vilnis, Is it because of UI+admin that you are using Fuseki Webapp? Nothing else? The Metrics API is in Fuseki Main.

Re: Fuseki Data Access Control + Shiro + webapp/fulljar

2022-03-02 Thread Andy Seaborne
Hi Vilnis, Is it because of UI+admin that you are using Fuseki Webapp? Nothing else? The Metrics API is in Fuseki Main. --ping Enable /$/ping --statsEnable /$/stats --metrics Enable /$/metrics and Shiro can be plugged in to Fuseki

Re: WG: Broken GND dataset after loading with tdb2.xloader+tdb2.tdbloader

2022-02-27 Thread Andy Seaborne
Hi Joachim, Yes, there is a bug in xloader. I have managed to create an example test case using a small amount of data. It is the xloader. Running the load-then-load test case with all other loaders hasn't shown a problem so it isn't the second data load. I'm not sure what the cause is yet

Re: Geo indexing Wikidata

2022-02-21 Thread Andy Seaborne
On 21/02/2022 09:07, Lorenz Buehmann wrote: Any experience or comments so far? Using SubsystemLifecycle, could make the conversions by GeoSPARQLOperations.convertGeoPredicates extensible. Andy But having coordinate location (P625), located on astronomical body (P376) as

Re: Broken GND dataset after loading with tdb2.xloader+tdb2.tdbloader

2022-02-21 Thread Andy Seaborne
On 21/02/2022 08:27, Neubert, Joachim wrote: I've reloaded the GND dataset at http://zbw.eu/beta/sparql/gnd/query with 4.5.0-SNAPSHOT. The sources were a 133G .nt.gz file, plus several small .ttl files with ontology etc. I loaded the large one with tdb2.xloader, and immediately after that

Re: Duplicates in the "Available services" list in UI?

2022-02-20 Thread Andy Seaborne
ces" list in UI? Maybe we could add help icons to the UI, with a brief description to users about things like the endpoints (including duplicates are OK), the editable sparql endpoint added yesterday, content types, etc. Bruno On Sun, 20 Feb 2022, 08:23 Andy Seaborne, wrote: On 19/02

Re: Duplicates in the "Available services" list in UI?

2022-02-19 Thread Andy Seaborne
On 19/02/2022 17:15, Neubert, Joachim wrote: In the Fuseki UI, I get apparent duplicates in the service list (see also screenshot): SPARQL Update /wikidata/ SPARQL Update /wikidata/update That's fine. That's two endpoints both of which provide update. Because you used

Re: Text indexing Wikidata

2022-02-19 Thread Andy Seaborne
On 19/02/2022 08:00, Lorenz Buehmann wrote: Hi, so far you can't do anything else - the whole indexing pipeline is single-threaded as far as I know. It simply iterates all properties declared to be used for fetching the RDF triple values - Lucene indexing itself would be threadsafe, so

Re: Does Jena need maintainance regarding to disk space?

2022-02-18 Thread Andy Seaborne
On 18/02/2022 11:05, Mikael Pesonen wrote: Yes I think we ran out of disk space also last time and it might corrupt something. How does one dump the database without fuseki? tdb2.tdbdump Thanks! On 17/02/2022 23.07, Andy Seaborne wrote: Mikael, You've had this problem before

Re: Does Jena need maintainance regarding to disk space?

2022-02-17 Thread Andy Seaborne
  Server  :: [Task 1] finishes : Compact 15:40:43 INFO  Admin   :: [21] Tasks Data-0002 folder was created with 2,5G of data (Data-0001 has 88G). On 14/02/2022 21.30, Andy Seaborne wrote: Yes, it's a good idea. TDB2 in Fuseki has the "compact" operation to do this withou

Re: Loading Wikidata

2022-02-16 Thread Andy Seaborne
On 16/02/2022 11:56, Neubert, Joachim wrote: I've loaded the Wikidata "truthy" dataset with 6b triples. Summary stats is: 10:09:29 INFO Load node table = 3 seconds 10:09:29 INFO Load ingest data = 25165 seconds 10:09:29 INFO Build index SPO = 11241 seconds 10:09:29 INFO Build index

Re: Fuseki HTTPS config

2022-02-16 Thread Andy Seaborne
Hi Vladimir, Thanks for the information! It is good to know what things still work. Does the reload on keystore change work with "Lets Encrypt!"? I've created JENA-2284 [1] to make sure the example gets updated. Fuseki/Main has a special support --https=CONF https certificate access

Re: Idiom for creating test instances of Node, Triple, etc?

2022-02-15 Thread Andy Seaborne
There are the functions in SSE. e.g. Node SSE.parseNode(string) It has built-in prefixes so ":s" works. SSE.parseNode(":s") -> NodeFactory.createURI("http://example/s;); Triples are 3-tuples: "(:s :p :o)" or "(triple :s :p :o)" RDF-star supported SSE.parseNode("(qtriple :s :p :o)"); or <<>>

Re: Fuseki context path?

2022-02-14 Thread Andy Seaborne
On 14/02/2022 21:31, Andy Seaborne wrote: On 14/02/2022 20:59, aj...@apache.org wrote: I'm afraid that doesn't work because I'm interested in proxying the entire application, not a single dataset. I want to expose the whole UI, admin, SPARQL editor and all. I've tried proxying as you

Re: Fuseki context path?

2022-02-14 Thread Andy Seaborne
PS JENA-2281 for improving the path routing. Adam On Mon, Feb 14, 2022, 2:27 PM Andy Seaborne wrote: On 14/02/2022 17:30, aj...@apache.org wrote: I'm probably missing something obvious, because I haven't looked at Fuseki in quite some time. I cannot seem to find any way to set the s

Re: How to resolve a transaction error

2022-02-14 Thread Andy Seaborne
Hi Erik, Do you have a small example that reproduces this? (outisde of your docker setup) The SLF4J warning shouldn't happen either. Andy On 14/02/2022 16:56, Erik Bijsterbosch wrote: Hi Lorenz, We base all functionality on docker, so we dockerise every new application we develop

AW: xloader "Can't find gzip program"

2022-02-14 Thread Andy Seaborne
eX.java:198) at java.base/java.util.ArrayList.forEach(ArrayList.java:1541) at org.apache.jena.tdb2.xloader.ProcBuildNodeTableX.lambda$exec2$1(ProcBuildNodeTableX.java:194) at java.base/java.lang.Thread.run(Thread.java:829) Cheers, Joachim -Ursprüngliche Nachricht- Von: Andy Seabor

Re: Does Jena need maintainance regarding to disk space?

2022-02-14 Thread Andy Seaborne
Yes, it's a good idea. TDB2 in Fuseki has the "compact" operation to do this without stopping the server. It creates a new "Data-/" directory and you can delete lower numbered databases. TDB1 - needs the server stopping for a rebuild. If you can stop updates, stop updates, 9server now

Re: Fuseki context path?

2022-02-14 Thread Andy Seaborne
On 14/02/2022 17:30, aj...@apache.org wrote: I'm probably missing something obvious, because I haven't looked at Fuseki in quite some time. I cannot seem to find any way to set the servlet context path for Fuseki in its standalone (non-WAR) incarnation, which I want to do in order to get it

Re: AW: AW: AW: AW: xloader "Can't find gzip program"

2022-02-14 Thread Andy Seaborne
or somethign else? -- My experience is that gz is faster to load. bz2 emphases compactness over speed. Andy Cheers, Joachim -Ursprüngliche Nachricht- Von: Andy Seaborne Gesendet: Samstag, 12. Februar 2022 11:15 An: users@jena.apache.org Betreff: Re: AW: AW: AW: xloader "Can't

Re: AW: AW: AW: xloader "Can't find gzip program"

2022-02-12 Thread Andy Seaborne
Hi Joachim, Aside: I've realised why the timestampes are fixed at "2022-01-30 15:03". The build setup is for repeatable builds of releases. Any build from the X.Y.Z release source, with the same JDK, will generate the byte-wise same jar files. Each release build fixes the timestamp and uses

Re: AW: AW: xloader "Can't find gzip program"

2022-02-11 Thread Andy Seaborne
217 Jan 30 15:02 fuseki.service -rw-r--r-- 1 root root 2124 Jan 30 15:02 log4j2.properties drwxr-xr-x 4 root root 121 Jan 30 15:02 webapp Cheers, Joachim -Ursprüngliche Nachricht- Von: Andy Seaborne Gesendet: Freitag, 11. Februar 2022 22:30 An: users@jena.apache.org Betre

Re: AW: xloader "Can't find gzip program"

2022-02-11 Thread Andy Seaborne
- Von: Andy Seaborne Gesendet: Freitag, 11. Februar 2022 21:07 An: users@jena.apache.org Betreff: Re: xloader "Can't find gzip program" Hi Joachim, https://issues.apache.org/jira/browse/JENA-2277 https://issues.apache.org/jira/browse/JENA-2279 There are two fixes for tdb2.xloader whi

Re: xloader "Can't find gzip program"

2022-02-11 Thread Andy Seaborne
Hi Joachim, https://issues.apache.org/jira/browse/JENA-2277 https://issues.apache.org/jira/browse/JENA-2279 There are two fixes for tdb2.xloader which are now in the development builds: https://repository.apache.org/content/groups/snapshots/org/apache/jena/ (these are not official releases

Re: [TDB2 & Fuseki 4.4.0] Huge tdb2 database disk size when performing incremental SPARQL update to endpoint.

2022-02-11 Thread Andy Seaborne
for the time being, but it is highly encouraged to move to the newer one as the old one might not receive support in the near or distant future? Best regards, Cédric -Original Message- From: Andy Seaborne Sent: Thursday, February 10, 2022 6:49 PM To: users@jena.apache.org Subject: Re: [TDB2

Re: [TDB2 & Fuseki 4.4.0] Huge tdb2 database disk size when performing incremental SPARQL update to endpoint.

2022-02-10 Thread Andy Seaborne
On 10/02/2022 17:18, Dave Reynolds wrote: While I can't help with the substance of this question ... > Since, as far as I know, the latest fuseki (4.4.0) no longer supports TDB1 I don't think that's correct. While there are new features of TDB2 in the new release (the faster loader) I

Re: Query performance with an ORDER BY

2022-02-10 Thread Andy Seaborne
Hi Andrew, On 09/02/2022 16:42, Andrii Berezovskyi wrote: Hello, We need to do paging in our app and as we don’t have a single property on which we can do a WHERE cutoff, we use an OFFSET/LIMIT. The OFFSET works fairly fast on the small values, however when we add an ORDER BY clause (as per

Re: Turtle-star formatted output with annotation syntax?

2022-02-09 Thread Andy Seaborne
On 09/02/2022 16:14, Shaw, Ryan wrote: Jena riot handles parsing Turtle-star annotation syntax, but AFAICT Turtle-star output always uses quoted triples. Are there any plans to support the annotation syntax for output? More an aspiration. A plan is an aspiration and a timescale :-)

Re: Configure fuseki-server with geosparql assembler

2022-02-09 Thread Andy Seaborne
Hi Erik, The jena-geosparql code isn't there by default. Unfortuately, just adding it to the standard build is messy. All users will see there will be several start-up warnings even if the GeoSPARQL code isn't being used. At the moment, add jena-geosparql and also the dependencies it needs.

Re: Disabling BNode UID generation

2022-02-09 Thread Andy Seaborne
On Feb 5, 2022, at 12:48 PM, Andy Seaborne wrote: On 04/02/2022 19:09, Shaw, Ryan wrote: Hello, I am trying to experiment with generating diffable N-Triples or flat Turtle files. ... Thanks, Ryan Info: There is work on a charter for "RDF Dataset Canonicalization and Hash Working Group&qu

Re: Java APIs

2022-02-06 Thread Andy Seaborne
On 06/02/2022 00:34, Hans-Juergen Rennau wrote: Would the integration of Jena components into an OpenSource project under the 3-clause BSD License be possible? Firstly - it's good to get this sorted out at the start. Changing licenses is messy and sometimes impossible. This is not

Re: Java APIs

2022-02-06 Thread Andy Seaborne
On 06/02/2022 00:34, Hans-Juergen Rennau wrote: Hello, I am interested in the integration of SPARQL into XQuery. The essential requirement is a Java API for (a) parsing RDF resources into triples, (b) evaluating SPARQL queries. Would Jena be a candidate to offer these? Yes. Would the

Re: Disabling BNode UID generation

2022-02-05 Thread Andy Seaborne
On 04/02/2022 19:09, Shaw, Ryan wrote: Hello, I am trying to experiment with generating diffable N-Triples or flat Turtle files. ... Thanks, Ryan Info: There is work on a charter for "RDF Dataset Canonicalization and Hash Working Group" https://w3c.github.io/rch-wg-charter/ The end

Re: Disabling BNode UID generation

2022-02-05 Thread Andy Seaborne
rg/1999/02/22-rdf-syntax-ns#nil> . _:B <http://example/q> _:B0001 . <http://example/s> <http://example/p> _:B . and JenaParameters.disableBNodeUIDGeneration is not used when https://issues.apache.org/jira/browse/JENA-2274 happens. Andy On 04/02/2022 21:20, Shaw, Ryan wro

Re: Disabling BNode UID generation

2022-02-04 Thread Andy Seaborne
Ryan, Please, could you show example code that illustrates what you are seeing? Presumably it isn't a mix in one parser run because it looks like "Annn" come from a different place than UUIDs Ids. Which version of Jena are you running? Andy On 04/02/2022 19:09, Shaw, Ryan wrote:

Re: xloader - jq: command not found

2022-02-03 Thread Andy Seaborne
Hi Robert, jq (JSON query) is a sudo apt-get install jq https://stedolan.github.io/jq/download/ On 03/02/2022 11:35, robert.ba...@tiscali.it wrote: Hi everyone, I am using jena fuseki 4.2.0. Jena Fuseki 4.4.0 has just been released. I created a dataset "test" and tried to load

[ANN] Apache Jena 4.4.0

2022-02-02 Thread Andy Seaborne
The Apache Jena development community is pleased to announce the release of Apache Jena 4.4.0. == New Fuseki UI The main item in this release is the updated Fuseki UI thanks to work by Bruno. The UI has been rewritten for improved maintenance and style. We look forward to evolving this new

Re: Howto address a named graph with a geosparql server in an existing persistent store

2022-02-02 Thread Andy Seaborne
recommendations here first: https://sis.apache.org/epsg.html Op wo 2 feb. 2022 om 09:33 schreef Andy Seaborne : On 01/02/2022 17:13, Erik Bijsterbosch wrote: Hi all, I created a new jena tdb2 database and loaded it with 256 million triples in a named graph, using a fuseki2/tdb2 4.3.2 docker

Re: Using Fuseki2 with a new backend store

2022-02-02 Thread Andy Seaborne
Hi jerven, Firstly, better to copy the whole package ... one package split across jars goes wrong in weird and mysterious ways sometimes. While there a few protected methods in FusekiMain, it doesn't look like it can be done - adding the arguments is easy enough, but processing them doesn't

Re: Howto address a named graph with a geosparql server in an existing persistent store

2022-02-02 Thread Andy Seaborne
On 01/02/2022 17:13, Erik Bijsterbosch wrote: Hi all, I created a new jena tdb2 database and loaded it with 256 million triples in a named graph, using a fuseki2/tdb2 4.3.2 docker setup. The data also consist of geometries so I built a new docker image based on jena-fuseki-geosparql 4.3.2

Re: tdb2.tdbloader "No such type" problem

2022-01-30 Thread Andy Seaborne
ain, Bob On 2022-01-29 10:53, Andy Seaborne wrote: Hi Bob, Seems to be working for me. The <http://jena.apache.org/2016/tdb#DatasetTDB2> looks right. What does myDataset.ttl look like? Does   tdb2.tdbloader --loc DB2 myData.ttl work? The error would be caused if Jena initialization

Re: FW: Validation issue

2022-01-29 Thread Andy Seaborne
? We already have a language for describing validation in SHACL itself. You could write the form a shape that you want - you can modularize using owl:imports and sh:node. Andy I am very grateful for your help. Yasir -Original Message- From: Andy Seaborne Sent: 28 January

Re: tdb2.tdbloader "No such type" problem

2022-01-29 Thread Andy Seaborne
Hi Bob, Seems to be working for me. The looks right. What does myDataset.ttl look like? Does tdb2.tdbloader --loc DB2 myData.ttl work? The error would be caused if Jena initialization failed but tdb2.tdbloader needs the TDB2 code to run at

Re: FW: Validation issue

2022-01-28 Thread Andy Seaborne
.createURI ("http://www.semanticweb.org/yas#Car_1;); ValidationReport report = ShaclValidator.get() .validate(shapes, data, target); RDFDataMgr.write(System.out, report.getGraph(), Lang.TTL); } Andy Apologies if I bothered you with this. Yasir -Original Message

Re: How to optimize TDB disk storage?

2022-01-27 Thread Andy Seaborne
Hi Vinay, On 27/01/2022 06:14, Vinay Mahamuni wrote: Hello, I am using Apache Jena v4.3.2 + Fuseki + TDB2 persistent disk storage. I am using jena RDFConnection to connect to the Fuseki server. I am sending 50k triples in one update. This is mostly new data(only a few triples will match

Re: FW: Validation issue

2022-01-27 Thread Andy Seaborne
violations. Are these methods designed to work this way? I was using Jena 4.1.0 and even when I updated to Jena 4.3.2, I still get the same results. I used the old (TQ) shacl playground, which returned 2 violations as well. Many thanks Yasir -Original Message- From: Andy Seaborne

Re: FW: Validation issue

2022-01-26 Thread Andy Seaborne
eShape[] ] ] . Andy On 26/01/2022 16:38, Alani, Yasir wrote: From: Alani, Yasir Sent: 26 January 2022 14:07 To: Andy Seaborne Subject: Validation issue Hi, I have a shape that doesn’t seem to work with Jena (always conforms) but works when I try it on SHACL Playground. The

Re: Mapping multiple files into the same namespace

2022-01-25 Thread Andy Seaborne
On 24/01/2022 22:37, Martynas Jusevičius wrote: Hi, I want to merge multiple RDF files into a single ontology under one namespace URI. E.g. to add custom assertions to ontologies without touching their original files. Can LocationMapper/FileManager be made/extended to do this, or do I need

Re: Dynamically restricting graph access at SPARQL query time

2022-01-25 Thread Andy Seaborne
, Andy Seaborne wrote: On 21/01/2022 15:26, Martynas Jusevičius wrote: WebAccessControl ontology might be relevant here: https://www.w3.org/wiki/WebAccessControl We're using a request filter that controls access against authorizations using SPARQL. On Fri, Jan 21, 2022 at 4:13 PM Vilnis

Re: Replacing FileManager with Dataset

2022-01-23 Thread Andy Seaborne
FileManager does two things - finding data and caching data. FileManager only exists for code in jena-core: Ont API with some internal only operations for the rules engine. There is FileManagerImpl to make jena-core run its own tests - running jena-core on its own is not a good idea for an

Re: Dynamically restricting graph access at SPARQL query time

2022-01-22 Thread Andy Seaborne
On 21/01/2022 15:26, Martynas Jusevičius wrote: WebAccessControl ontology might be relevant here: https://www.w3.org/wiki/WebAccessControl We're using a request filter that controls access against authorizations using SPARQL. On Fri, Jan 21, 2022 at 4:13 PM Vilnis Termanis wrote: Hi,

Re: Handling Deleted nodes in TDB2 storage

2022-01-13 Thread Andy Seaborne
On 13/01/2022 06:33, Aayush Yadav wrote: Hi, I just had a query regarding how JENA handles deleted nodes in TDB2? I read in the documentation and even saw while implementing, that the nodes that are deleted are not removed from storage until compact is run. So how are these nodes handled

Re: Help troubleshooting problems loading a large dataset

2022-01-05 Thread Andy Seaborne
Hi Nicolas On 05/01/2022 20:32, Rouquette, Nicolas F (US 319K) wrote: Once, I got a server error like this: 18:00:40 INFO Fuseki :: [45]

Re: Fuseki 4.* increased RAM consumption

2022-01-05 Thread Andy Seaborne
and those recent versions (we observed these issues on 4.1.0 and 4.3.1). We use Fuseki on prod and a lot of our API calls depend on it so I will investigate this anomaly further and let you know if I find something new. Best, Piotr śr., 5 sty 2022 o 14:54 Andy Seaborne napisał(a): Hi Piotr

Re: Fuseki 4.* increased RAM consumption

2022-01-05 Thread Andy Seaborne
Hi Piotr, For that in-memory setup, I don't know of any changes that might lead to increased memory use. Might it be related to the queries received? Service Unavailable --> That looks like a reverse proxy can't contact the Fuseki server. What's the Fuseki server log say around that point?

Re: Fuseki 4.* increased RAM consumption

2022-01-05 Thread Andy Seaborne
Hi Piotr, Could you remind us what your setup is? Andy On 05/01/2022 09:15, Piotr Nowara wrote: Hi, we've recently upgraded Fuseki from 3.13.1 to 4.3.1 because of log4shell. 4.3.2 is available. Our old Fuseki was super stable and reliable, but now after the upgrade we are getting

Re: Using Fuseki to host IRIs / Using Fuseki as an LDP

2022-01-05 Thread Andy Seaborne
Hi Jakub In addition to others mentioned: TrellisLDP : https://www.trellisldp.org/ https://github.com/trellis-ldp In theory, Fuseki supports GSP Direct naming (The request URL is the URI of a named graph). GSP (SPARQL Graph Store Protocol) has indirect and direct modes - indirect is

Re: Use command tdbquery

2022-01-03 Thread Andy Seaborne
On 03/01/2022 17:44, robert.ba...@tiscali.it wrote: Hi, you are right, I was not clear in the request. I try to explain myself better. I have a knowledge base of over a billion triples. I am testing a query that returns about 2 million results (in the future I will have many queries

Re: Request for adding log4j 2.17.1 to Fuseki Jena

2022-01-03 Thread Andy Seaborne
On 03/01/2022 11:30, Lorenz Buehmann wrote: That has already been addressed and will be provided with Jena 4.4.0: https://issues.apache.org/jira/browse/JENA-2233?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel I doubt there will be another minor version 4.3.3, Andy?

Re: Request for adding log4j 2.17.1 to Fuseki Jena

2022-01-03 Thread Andy Seaborne
See https://issues.apache.org/jira/browse/JENA-2233 https://issues.apache.org/jira/browse/JENA-2224 https://github.com/apache/jena/blob/main/pom.xml for the releases currently in the main branch which will be in the next version 4.4.0 log4j2: 2.17.1 jackson: 2.13.1 Note: Jena does not use

Re: Datatype format exception : float - detect the incorrect triple

2022-01-01 Thread Andy Seaborne
et concurrency right for you. Andy Jean-Marc Vanel <http://semantic-forms.cc:9112/display?displayuri=http://jmvanel.free.fr/jmv.rdf%23me> +33 (0)6 89 16 29 52 Le sam. 1 janv. 2022 à 22:36, Andy Seaborne a écrit : On 01/01/2022 20:50, Andy Seaborne wrote: On 01/01/2022 19:45,

Re: Datatype format exception : float - detect the incorrect triple

2022-01-01 Thread Andy Seaborne
On 01/01/2022 22:04, Jean-Marc Vanel wrote: Le sam. 1 janv. 2022 à 21:50, Andy Seaborne a écrit : On 01/01/2022 19:45, Jean-Marc Vanel wrote: During TDB initialization, I get this warning : WARN o.apache.jena.sparql.expr.NodeValue - Datatype format exception: "4,77962"^^xsd:fl

Re: Datatype format exception : float - detect the incorrect triple

2022-01-01 Thread Andy Seaborne
On 01/01/2022 20:50, Andy Seaborne wrote: On 01/01/2022 19:45, Jean-Marc Vanel wrote: During TDB initialization, I get this warning : WARN  o.apache.jena.sparql.expr.NodeValue - Datatype format exception: "4,77962"^^xsd:float But I am unable to detect the incorr

Re: Datatype format exception : float - detect the incorrect triple

2022-01-01 Thread Andy Seaborne
On 01/01/2022 19:45, Jean-Marc Vanel wrote: During TDB initialization, I get this warning : WARN o.apache.jena.sparql.expr.NodeValue - Datatype format exception: "4,77962"^^xsd:float But I am unable to detect the incorrect triple , with this query : PREFIX xsd:

<    1   2   3   4   5   6   7   8   9   10   >