TDB2 and stats.opt

2018-10-10 Thread Markus Neumann
Hi I read https://jena.apache.org/documentation/tdb/optimizer.html and searched through the mailing list but did not find a satisfying answer: I generate an offline TDB2 database using tdb2.tdbloader. Once this is done, I run the

Re: Building a spatial index with jena/fuseki

2018-10-10 Thread Markus Neumann
PG.dat prefixes.bpt SPOG.idn> > > GPOS.dat nodes.bpt OSPG.idn prefixes.dat SPO.idn> > > GPOS.idn nodes.dat OSP.idn prefixes-data.bdf tdb.lock> > > GPU.bpt nodes-data.bdf POS.bpt prefixes-data.obj> > > GPU.dat nodes-data.obj POS.dat

Re: Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
-cp $JENA_HOME/lib/* jena.spatialindexer > --desc=fuseki-server/run/configuration/mm.ttl > > Your first example looks like it might be misusing the -cp flag [1]. You > probably don't want the *.jar, just *, like > > java -cp lib/* jena.spatialindexer > --desc=../fuseki-server/run/co

Re: Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
ena but java projects. try to simply inlcude all the jars. > > I presume you run this on a linux box with OpenJDK 8. correct? > > now once you have set up jena just add the following > {replace_with_your_path}/apache-jena-3.8.0/lib/* > > > > > On Mon, Sep 17, 2018

Re: Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
> https://jena.apache.org/documentation/tools/index.html > <https://jena.apache.org/documentation/tools/index.html> > > > > On Mon, Sep 17, 2018 at 10:28 AM Markus Neumann <mailto:mneum...@meteomatics.com>> > wrote: > >> 1.: what do you mean by indexer

Re: Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
nclude in the indexer in the classpath. It's part of the current >> jena distribution. >> >> 2. do you need jts? it's a package that allows you to index multi point >> geometries. here a sample query would be helpful. If single point >> geometries are indexed and used i

Re: Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
would be helpful. If single point > geometries are indexed and used in conjunction with MBR range queries. > there is no need for jts. > > > On Mon, Sep 17, 2018 at 9:14 AM Markus Neumann <mailto:mneum...@meteomatics.com>> > wrote: > >> Hi, >> (sorry

Building a spatial index with jena/fuseki

2018-09-17 Thread Markus Neumann
nclude the jts jar: FUSEKI_CLASSES=$FUSEKI_HOME/jts-1.13.jar I see no errors or warnings in the server log, when starting with that configuration, the Lucene folder is created and populated with something: $ ll run/configuration/Lucene/ total 4 -rw-rw-r-- 1 process process 71 Sep 14 09:28 segments_1 -rw-rw-r-- 1 process process 0 Sep 14 09:28 write.lock But any spatial query does not return any results. Any help on how to tackle this would be highly appreciated. Best Markus Neumann

Re: Updating large amounts of data

2018-09-14 Thread Markus Neumann
Hi Andy, thanks for pointing that out. what would you recommend as a heap size? > Am 14.09.2018 um 15:04 schrieb Andy Seaborne : > > > > On 12/09/18 16:08, Markus Neumann wrote: >> Hi, >> we are running a Fuseki server that will hold about 2.2 * 10^9 triples

Re: Updating large amounts of data

2018-09-14 Thread Markus Neumann
. > > > On Fri, Sep 14, 2018 at 6:36 AM Markus Neumann <mailto:mneum...@meteomatics.com>> > wrote: > >> I got the jar from >> https://mvnrepository.com/artifact/org.apache.jena/jena-spatial/3.8.0 >> <https://mvnrepository.com/artifact/org.apach

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
_store/prod_dp_2018-09-13-1 Error: Could not find or load main class jena.spatialindexer > Am 13.09.2018 um 21:47 schrieb Marco Neumann : > > Set the classpath to include the spatialIndexer > > On Thu 13 Sep 2018 at 20:30, Markus Neumann <mailto:mneum...@meteomatics

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
/spatial-query.html> > > hint: if you don't get results for a spatial filter query that matches your > data in the database your data isn't spatially indexed correctly. there > will be no error or the like in the result set though. > > > > On Thu, Sep 13, 201

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
your queries make use of the > spatial filter? > > On Thu, Sep 13, 2018 at 12:59 PM Markus Neumann <mailto:mneum...@meteomatics.com>> > wrote: > >> Marco, >> >> I just tried the tdbloader2 script with 1 Month of data: >> >> INFO Total: 167,385,120 tu

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
Hi Osma, > Am 13.09.2018 um 13:53 schrieb Osma Suominen : > > Hi Markus, > > A few comments inline. > > Markus Neumann kirjoitti 12.09.2018 klo 18:08: >> 1. Inserting data: >> It takes more than one hour to upload the measurements of a month >> (7

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
it) or it would risk >> causing data corruption >> >> Rob >> >> On 13/09/2018, 10:11, "Marco Neumann" wrote: >> >>Markus, the tdbloader2 script is part of the apache-jena distribution. >> >> let me know how you get on and how

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
s with a .sz extension. Although looking > at the Fuseki code not sure this is wired up into Fuseki currently. > > Rob > > On 13/09/2018, 10:49, "Markus Neumann" wrote: > >Hi Rob, > >> Am 13.09.2018 um 11:41 schrieb Rob Vesse : >> >>

Re: Updating large amounts of data

2018-09-13 Thread Markus Neumann
:00 schrieb Marco Neumann : > > do you make the data endpoint publicly available? > > 1. did you try the tdbloader, what version of tdb2 do you use? > > 2. many ways to improve your response time here. what does a typical query > look like? do you make use of the spatial indexe

Updating large amounts of data

2018-09-12 Thread Markus Neumann
eciate if someone could give me some advice on how to handle this tasks or point out things I could do to optimize the organization of the data. Many thanks and kind regards Markus Neumann

Re: Spatial distance in Fuseki

2018-08-24 Thread Markus Neumann
ena's extension mechanisms to do this kind of > calculation: > > https://jena.apache.org/documentation/query/writing_propfuncs.html > > although it's not trivial to do that. Perhaps a committer with more knowledge > about jena-spatial can help here. > > ajs6f > >>

Spatial distance in Fuseki

2018-08-24 Thread Markus Neumann
Hi, I'm quite new to both Fuseki and mailinglists, so please be patient with me. I've managed to set up a Fuseki 2 server together with a Lucene spatial index. E.g the following query works as expected: PREFIX geo: PREFIX geosparql: