Re: State of Elastic/Open Search support in Fuseki

On 16.06.23 21:53, Andy Seaborne wrote: Hi Andy, From the documentation: ah thanks, I read it but have to wrap my head around it with some examples to understand what happens. There is also the model of "One document equals one entity" model that might be more appropriate faceted search.

Re: State of Elastic/Open Search support in Fuseki

On 14.06.23 14:45, Øyvind Gjesdal wrote: Hi Øyvind, Facet/aggregation was not implemented as extension functions in SPARQL and I believe that it also used the same abstraction described in the jena-text docs: One Jena*triple* equals one Lucene*document* which makes aggregations/facets

State of Elastic/Open Search support in Fuseki

According to https://jena.apache.org/documentation/query/text-query.html there was support for text search using Elastic instead of Lucene in Fuseki at some point at least. But from what I can see it was removed (?) in 4.x. We have a use-case where faceted search is important and this is

Re: ARQ: query from passed string

On 07.12.22 17:02, Andy Seaborne wrote: Hi Andy, --query, --file File containing a query is that not showing up? yes that is showing up but there is no hint that one could pass a string as an option, at least I did not had this idea after reading the help output. I don't see it on the

Re: ARQ: query from passed string

On 07.12.22 15:00, Lorenz Buehmann wrote: Hi Lorenz, arq --data /path/to/file.rdf  "SELECT * WHERE { ?s ?p ?o }" --query only if you provide it as file ah indeed that works thanks! I really can't see that based on the help page, am I missing something? regards Adrian

ARQ: query from passed string

his cannot be passed as simple one-liner argument, as in this example? regards Adrian -- Adrian Gschwend CEO Zazuko GmbH, Biel, Switzerland Phone +41 32 510 60 31 Email adrian.gschw...@zazuko.com

Re: Configure fuseki-server with geosparql assembler

On 10.02.22 22:18, Erik Bijsterbosch wrote: Hi Erik, I pursued my attempt to set up a dockerised fuseki-server and fuseki-geosparql combi application. I created one image for boh services which I can start with docker-compose arguments. You might want to try the work my colleague Ludovic

Re: SHACL & TDB

On 27.09.21 18:05, Andy Seaborne wrote: Hi Andy, > Other than the service name - where does it say in-memory only? The> > validation API works on any graphs. The CLI tools do work in-memory. Thanks for the clarification. I then over-interpreted the documentation and draw that wrong conclusion.

SHACL & TDB

Hi group, I recently started playing with SHACL validation in Jena, worked well with the cli for the few things I tested, thanks for the work! What I don't really get is where SHACL support in Jena is heading. From what I understand in the documentation this is currently only usable in in-memory

Re: Scalability

On 24.07.21 11:35, Matt Whitby wrote: > I did say it was somewhat of a 'length of a piece of string' type > question. Having just dealt with relational databases for 25 years I know > pretty much nothing about triplestores. Realistically I don't see us > storing over 250m triples and if you say

Re: Fuseki Graph Store Protocol: Streaming or not?

On 29.06.21 20:29, Andy Seaborne wrote: Hi Andy, > I'd expect faster though there are a lot of environmental factors. Lots > of question below ... good point > I've loaded 200+million on the default setup into a live server using > TDB2 before. ok good to know. I started to have some doubts,

Fuseki Graph Store Protocol: Streaming or not?

Hi everyone, We have automated pipelines that write to Fuseki using the SPARQL Graph Store protocol. This seems to work fine for smaller junks of data but when we write a larger dataset of around 15 million triples in one batch, this seems to fail. After checking out what happens, we see an OOM

Join heavy query does not return

Hi everyone, I got a dataset of around 5 million triples where I do relatively join heavy queries on it. It's a OLAP cube like structure that combines a bunch of them in a view. Fuseki never returns, we configured it with -Xmx60g. I could not find any other options that could/should be adjusted

Re: SHACL: parse does not have --out

On 24.11.20 00:37, Andy Seaborne wrote: Hi Andy, > (3.17.0 will have compact syntax output, 3.16.0 does not) Ah that explains, thanks for the info. regards Adrian

SHACL: parse does not have --out

Hi, According to the SHACL cli docs there should be a --out option: shacl p --out=FMT FILE I tried this with 3.16.0 and I get: shacl p --out t cube-shape.ttl Unknown argument: out did that get lost somewhere? regards Adrian

Re: simple SPARQL query with UNION => timeout

On 06.10.20 16:24, Jean-Marc Vanel wrote: > PREFIX dcat: > PREFIX void: > CONSTRUCT { > ?thing a ?CLASS . } > WHERE { > ?thing a ?CLASS . > { ?thing a dcat:Dataset .} UNION > { ?thing a void:Dataset .} > } UNION surely works but for

Re: Jena transpiled to TypeScript/JavaScript?

On 15.05.20 12:39, Martynas Jusevičius wrote: Hi > RDF JavaScript frameworks are still ~20 years behind Java. So this had > me thinking for a while -- instead of reinventing the wheel, would it > be possible to transpile Jena to TypeScript or JavaScript? When my colleague sees that I answer

Re: Fuseki's Cache-Control

On 19.03.20 12:05, Martynas Jusevičius wrote: > Cache-Control: must-revalidate,no-cache,no-store > Pragma: no-cache YMMV, but my take here is: - a SPARQL endpoint should always return the latest results - If caching is needed, it should be transparent for the user, as in the SPARQL endpoint can

Re: Migrate CVS data into RDF

On 08.04.19 15:13, Glenn Eriksson wrote: Hi Glenn, > Use case: I want to migrate CVS data in GTFS (General Transit Feed > Specification) format into RDF > > * I have a ontology of GTFS in Turtle format (gtfs.ttl) * There > are 12-13 CVS files with data that I want to merge (one at a time) >

Re: CSV to rdf

On 15.02.19 09:50, Conal Tuohy wrote: > I have used (and I can recommend) CSV2RDF from > https://github.com/theodi/csv2rdf which is compliant to the W3C's CSV on > the Web specification. You can generate RDF from CSV file by creating a > metadata file (in JSON format) which describes the CSV. It

Re: Converting TriX to N-Quads with riot

On 11.11.18 23:38, Martynas Jusevičius wrote: > Nice to know, thanks! > > We should put together a Docker image with all these utilities ;) https://github.com/zazukoians/docker-node-java-jena :-D https://github.com/zazukoians/docker-node-java-jena/blob/master/Dockerfile#L22 for tools. I will

Re: Converting TriX to N-Quads with riot

On 11.11.18 18:36, Martynas Jusevičius wrote: > I got a tip that rapper should be able to convert N-Quads to N-Triples. > http://librdf.org/raptor/rapper.html I did use rapper too for that but for large datasets it was too slow. I use "serd" now for batch-conversion, this is by far the fastest

BNODE & simple literal argument

Hi, I run a query in Stardog and Fuseki with completely different results. The query does this (simplifyed): -- SELECT ?datasetNotation ?propertyNotation ?b_property ?property WHERE { ?dataset a qb:DataSet ; skos:notation ?datasetNotation ;

Re: Streaming CONSTRUCT/INSERTs in TDB

On 12.03.18 14:37, Andy Seaborne wrote: > Yes - all this was just using the command line tools. > > Default heap but that's different for me and for you.  I'm running with > 8G heap (25% of 32G). > > 4G didn't work. right I tested it now, for the current set 7GB seems to be the barrier. >

Re: Streaming CONSTRUCT/INSERTs in TDB

On 10.03.18 00:36, Andy Seaborne wrote: Hi Andy, > Executes in 2m 20s (java8) for me (and 1m 49s with java9 which is . > Default heap which is IIRC 25% of RAM or 8G. Cold JVM, cold file cache. wow, did you do that with TDB commandline tools? Default heap in terms of default settings of Fuseki?

Re: Streaming CONSTRUCT/INSERTs in TDB

On 03.03.18 17:11, Andy Seaborne wrote: Hi Andy, > Do you have an example of such an update? yes I can deliver two use-cases, with data and query. First one is this dataset: http://ktk.netlabs.org/misc/rdf/fuseki-lock.nq.gz Query: https://pastebin.com/7TbsiAii This returns reliably in

Streaming CONSTRUCT/INSERTs in TDB

Hi group, I had some discussions with Andy before outside the list. I have a pipeline that creates a bunch of new triples via CONSTRUCT or INSERT queries. The patterns are in my opinion pretty easy to stream, if I do not do an insert but just a count, the query executes fine in TDB. As soon as I

Re: tdbquery: INSERT & graph output format

On 14.01.18 13:49, ajs6f wrote: > Try tdbquery --help and you will see the flags it takes. They include: > > --results= Results format (Result set: text, XML, JSON, CSV, TSV; > Graph: RDF serialization) > > Feel free to send an improvement for >

Re: tdbquery: INSERT & graph output format

On 14.01.18 15:11, Andy Seaborne wrote: >  tdbquery --loc DB -results=NT 'CONSTRUCT WHERE { ?s ?p ?o}' > > or N-TRIPLES > > (but not the MIME type :-() ah great tnx, I did try the mime-type writing indeed regards Adrian

tdbquery: INSERT & graph output format

Hi, I am using tdbquery in some pipelines I created. Is there a way to use INSERT statements as well instead of CONSTRUCTS? From the error message I got I get the impression that it behaves like executing on the query interface on Fuseki and not the update, so INSERT is not valid in that context.

Re: SPIN support

On 06.09.17 00:21, Holger Knublauch wrote: Hi Holger, > Is this about SPARQL functions or functions called from Java? For SPARQL > functions written in JavaScript, see > > https://w3c.github.io/data-shapes/shacl-js/#js-functions ok but that still expects the SPARQL engine to support that

Re: SPIN support

On 05.09.17 11:58, Andy Seaborne wrote: Hi Andy, > No progress from me - my open-source time has been going elsewhere (TDB2 > - see dev@jena email yesterday). oh great, will check that out > This is a restricted case where maybe there is another way? > > Would a custom function do the same?

Re: SPIN support

On 05.09.17 00:07, Holger Knublauch wrote: Hi Holger, > out of interest: which features of SPIN would be of interest, and which > of these are not covered by SHACL? > > See also http://spinrdf.org/spin-shacl.html A simple one actually :) I saw that there is a camelcase function in SPIN and

Re: SPIN support

On 30.12.16 17:24, Andy Seaborne wrote: Hi Andy, > For integration with Fuseki there are a couple of things needed: it's a while ago, did you make any progress on SPIN API support in Fuseki? Some stuff in SPIN would be useful. regards Adrina

Fuseki error: BindingHashMap WARN Binding.add: null value - ignored

Hi, We have a query with property paths which is very slow. We suspected that it's related to this Jena bug: https://issues.apache.org/jira/browse/JENA-1195 I'm now on apache-jena-fuseki-2.4.1-SNAPSHOT of today and when I had a look at the log when executing the slow query I see tons of entries

Re: Fuseki INSERT: GC overhead limit exceeded

On 27.04.16 17:48, Andy Seaborne wrote: Hi Andy, > Depending on version of the Fuseki script the heap setting can be rather > low (non aggressive when running on a user machine, not server). > > JVM_ARGS to the fuseki-server script. > JAVA_OPTIONS to the fuseki service script. ok thanks will

Fuseki INSERT: GC overhead limit exceeded

Hi group, I did some performance tests with different triplestores on a complex query I had, results can be found here: https://gist.github.com/ktk/a04e267dd776da2511692e96fc2b5d99#jena-fuseki So far I tested Virtuoso, Stardog & Blazegraph. Jena fails with GC issues: [2016-04-26 21:41:47]

Re: riot, streaming & memory

On 31.03.16 11:28, Andy Seaborne wrote: Hi Andy, > If you find a JSON-LD parser that can convert this file to N-triples, > could you let the list know please? Talked to my colleague Reto last week and he had mercy: https://github.com/zazuko/jsonldparser See the README, currently it only

Re: riot, streaming & memory

On 31.03.16 11:28, Andy Seaborne wrote: Hi Andy, > The whole chain JSON->JSON-LD->RDF is designed around small/medium sized > data. > > If you find a JSON-LD parser that can convert this file to N-triples, > could you let the list know please? will do so, might be that we have some streaming

Re: riot, streaming & memory

On 30.03.16 18:49, Andy Seaborne wrote: Hi Andy, > The start of the file is somewhat long literal heavy for the geo data. > There are some serious yeah it is a Swiss geodata set which should be published later this year as RDF. It gets generated as JSON-LD from its original INTERLIS format

Re: riot, streaming & memory

On 29.03.16 19:13, Andy Seaborne wrote: Hi Andy, > So JSON-LD does not stream end-to-end. Ok I thought something like this. We have the same problem with the JavaScript JSON-LD library. > At 800Mb I would have expected a large enough heap to work for N-triples > output. Is the file available

riot, streaming & memory

According to the documentation riot should try streaming if possible, is that not available for JSON-LD or am I missing something else? regards Adrian -- Adrian Gschwend Bern University of Applied Sciences

Script creation of a new database in Fuseki 2.3

Hi, I can't seem to figure out how I can create a new (persistent) database via scripts in Fuseki 2.3, documentation didn't help. I need this for Travis so everything I do needs to be fully automated. Any hints on what I would have to execute towards the Fuseki endpoint? regards Adrian

Re: Script creation of a new database in Fuseki 2.3

On 10.11.15 20:37, A. Soroka wrote: Hi, > That’s Java, but it should be pretty easy to translate. The important > point is to realize that the administrative forms are at the > “{your-fuseki-instance}/$” url. In your case you want the > “{your-fuseki-instance}/$/datasets” section, to which you

Re: Fuseki 2.0 configuration issues

On 25.08.15 14:06, Andy Seaborne wrote: Hi Andy, The problem is that the configuration of the bfs dataset is picked up from the configuration database. Presumably you created it through the UI. I did! Thanks a lot for the hint. Is this somewhere written in the documentation? I know that I am

Re: Fuseki 2.0 configuration issues

On 24.08.15 13:05, Andy Seaborne wrote: Hi Andy, Adrian - That would be perfect. I don't think I need the data, just the setup. It would also be useful to know exactly how you are making the call. A per-query timeout is possible with the header Timeout: or parameter timeout=. I use this

Re: Fuseki 2.0 configuration issues

On 24.06.15 15:12, Andy Seaborne wrote: Hi Andy, This is the first answer on your email, expect more in the comming days :-) When it's using the run/ area, the sources are run/config.ttl (the server setup), configuration/, one file per service+dataset and the system database (like

Re: SPARQL FILTER non standard data types

On 15.06.15 17:38, Andy Seaborne wrote: Hi Andy, Some thoughts: If you can translate to xsd date/time values, and will work. thanks for the various hints, James Anderson proposed another type to use (outside of the list), I listed the response here:

Re: Fuseki Union Default Graph

On 18.06.15 00:55, Andy Seaborne wrote: Hi Andy, If you are not seeing the default graph as the union of the two named graphs, then something is amiss with the setup. How are you setting unionDefaultGraph? (and which version of code are you running?) So turns out the config file I was

Fuseki 2.0 configuration issues

Hi group, I can't seem to understand the new structure of Fuseki 2.0 configuration. In the documentation I read: https://jena.apache.org/documentation/fuseki2/fuseki-configuration.html The directory FUSEKI_BASE/configuration/ with one data service assembler per file (includes endpoint details

Re: Fuseki Union Default Graph

On 18.06.15 00:55, Andy Seaborne wrote: Hi Andy, This is TDB? yes If your turn unionDefaultGraph on, then the stored default graph is not visible in a query (it can be accessed via a special graph name that is not included in the union of named graphs) so I'd expect it to be inaccessible.

Fuseki Union Default Graph

Hi, In my GTFS Fuseki endpoint I loaded the data set to the default graph using tdbloader. Later I added two new graphs to the store with a smaller set of data. This seems to work fine, I can address the triples in each graph. Now I would like to expose everything in the default graph for easier

SPARQL FILTER non standard data types

Hi, I'm using Pieter Colpaerts script for transforming GTFS public transport schedule data to RDF, see https://github.com/OpenTransport/gtfs-csv2rdf/ According to the GTFS specification arrivalTime and departureTime can have more than 24 hours to represent connections which are technically on a

Re: Fuseki 2.0 frontend localhost

On 05.05.15 17:29, Andy Seaborne wrote: Hi Andy, Are you running the standalone server as it comes striaght out of the distribution? yes By default, the admin interface only responds to localhost for security reasons. ah ok. Makes sense Have you modified shiro.ini at all? No, I

Fuseki 2.0 frontend localhost

Hi group, While the new Fuseki 2.0 seems to work quite well on localhost I was not very successful getting it to work on anything else than that. It's pretty much broken in a sense that I can't create databases and thus not much else either. Is that a known problem and if not, should I file

Split strings with SPARQL

Hi group, I'm moving a lot of legacy data to RDF these days and in several, mostly unrelated datasets I came across fields which had multiple values in it which should be split up into multiple entries. Imagine multiple names as an example. This is quite common in SQL datasets which are not

Re: Split strings with SPARQL

On 04.07.14 14:41, Andy Seaborne wrote: http://jena.apache.org/documentation/query/library-propfunc.html apf:strSplit fantastic, thanks! regards Adrian

Re: Building Semantic Web Application

On 18.04.14 08:32, Mohammad Hailmizan Bin Jafar wrote: Hi Mohammad, Hi, I am new at developing semantic web apps. I have downloaded e-book called Semantic Web Programming by Wiley 2009 which is I think already outdated. Do you have any new book that you recommend ? it really depends on what

Re: Building Semantic Web Application

On 18.04.14 12:09, Mohammad Hailmizan Bin Jafar wrote: Hi Mohammad, I would like to build e-govt service application (e-services) such as Land Information System. I was asked by my superior to do a research study on this. Can this be done? yes this can be done, I think semantic web

SPARQL Service Description

Hi group, Am I right that currently Fuseki is not supporting SPARQL Service Description: http://www.w3.org/TR/sparql11-service-description/ ? If so any special reason or just no one did it so far? regards Adrian

Fwd: Re: @context vs. Turtle @prefix

think? regards Adrian ---BeginMessage--- On Sep 6, 2013, at 12:19 AM, Adrian Gschwend ml-...@netlabs.org wrote: Hi group, (repost, didn't make it trough the queue last night it seems) I'm working on a Pubby-like basic LDP frontend which so far can return classical RDF representations

Re: JSON-LD as a Fuseki output format

On 21.07.13 15:38, Andy Seaborne wrote: Hi guys, Joachim brings up an issue that I've seen several times now - not everything is table shaped - and CONSTRUCT is one way to address that. was just running into the same issue today, I want to make the DESCRIBE/CONSTRUCT queries available to

Re: JSON-LD as a Fuseki output format

On 05.09.13 22:05, Andy Seaborne wrote: In particular, whether the pure RDF to JSON-LD synatx produces something a normal web dev would relate to. good point, I'm just trying to understand that too (will post to their list as I don't get it yet). IMHO json-ld is only useful if everything is

Re: JSON-LD as a Fuseki output format

On 05.09.13 22:33, Adrian Gschwend wrote: IMHO json-ld is only useful if everything is prefixed, otherwise we can directly work with application/rdf+json as it looks pretty much the same (to me at least). ok I correct myself, you do get some kind of nesting so it's a bit more readable

Re: Suggested JVM Settings

On 03.09.13 14:53, Andy Seaborne wrote: Hi Andy, TDB will use the rest of unused memory via memory mapped files - these are not part of the heap and don't count for -Xmx. Is this true for all platforms or only Unix? Thought you once mentioned that this is not available on Windows. regards

Re: Suggested JVM Settings

On 03.09.13 16:26, Andy Seaborne wrote: But mmap files do not give the speed up as they do on Linux. It's been reported as being neutral. It still flexs the memory size and avoids the need to size the heap at start-up. ok thanks for the clarification. Is there a difference between Linux and

Re: Suggested JVM Settings

On 03.09.13 16:45, Andy Seaborne wrote: I'd expect them to be the same but I don't have any input to confirm that. Do you have any figures? Problem is that currently I don't run the systems on the same hardware so it's not possible to directly compare results right now. If I find some time I

Restricting Fuseki to localhost

Hi group, According to the Fuseki documentation there is a --host argument for restricting it to some IPs: https://jena.apache.org/documentation/serving_data/index.html#running-a-fuseki-server but: ./fuseki-server --config=fuseki-persistent.ttl --host=127.0.0.1 Unknown argument: host --port

Re: Restricting Fuseki to localhost

On 02.09.13 21:12, Rob Vesse wrote: Hi Rob, It's a known bug - JENA-499 (https://issues.apache.org/jira/browse/JENA-499) thanks for the pointer The --host argument is not actually supported in past versions of Fuseki The fix which is available in the dev snapshots (1.0.0-SNAPSHOT) adds a

Re: Jena 2.10.0 : request for pre-release testing

On 12.02.13 14:11, Claude Warren wrote: Is that information on a webpage somewhere? I'd like to be able to point to it in any posts. https://mail-archives.apache.org/mod_mbox/jena-users/201302.mbox/%3C511A076A.2030907%40apache.org%3E :-D cu Adrian

Re: Problem with a federated query

On 08.02.13 09:29, Andy Seaborne wrote: Hi Andy, Signified says in a comment on that answers.semanticweb.com question that Samstagern has a non-integer value. he was right, just posted this in the answer: -- You are right, that's what I get from Samstagern:

Problem with a federated query

Hi group, I posted an issue I had with a federated query to DBPedia on answers.semanticweb.com. Beside a workaround we were debating why my query does not return properly and we suspect it is either a bug in Virtuoso or in Fuseki. The complete query + sample endpoint is described in the posing:

Re: Problem with a federated query

On 07.02.13 19:22, Andy Seaborne wrote: Hi Andy, Can't test but my guess is that the some of the ?munidstr coming back from DBpedia are not valid integer strings. ah didn't think of that. That makes: BIND(xsd:int(str(?munidstr)) AS ?munid) leave ?munid unbound so the rest of the