Re: [GSoC 2013] jena-spatial
(for the current week) 1. wrap things up 2. prepare and submit final evaluation of GSoC project We're into the wrap-up period now and things seem fairly wrapped up. The release of Jena 2.11.0 included jena-spatial, and it's part of the Fuseki server jar as well. It's now down to the users to use it :-) Thank you very much for so smoothly getting this module into Jena, Andy
Re: [GSoC 2013] jena-spatial
Hi all, (for a weekly report) 1. documentation in jena website (solr support documenatation) 2. prepare release (for the current week) 1. wrap things up 2. prepare and submit final evaluation of GSoC project Best regards, Ying Jiang On Sun, Sep 8, 2013 at 1:18 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) 1. migration from google code to jena svn trunk 2. documentation in jena website (in progress) 3. resovle the JTS dependency problem (for the current week) 1. documentation in jena website 2. prepare release Best regards, Ying Jiang On Mon, Sep 2, 2013 at 6:04 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) 1. solr support for jena-spatial (for the current week) 1. migration from google code to jena svn trunk 2. documentation in jena website I've just compared the work so far with the original project plan. Here are the list of the project scopes in the plan and the evaluations: -- 1. Spatial Data Indexer: done with spatialindexer 2. Spatial Property Functions 2.1 within: done with spatial:withinBox and spatial:wininCircle 2.2 nearby: done with spatial:wininCircle. 2.3/2.4 intersects: only support shapes that can be represented with WKT literals 2.5 northing/southing/easting/westing: done 2.6 disjoints: not supported by the current version of Lucene, maybe available in future 3. Jena Assembler Configuration with Fuseki Integration: done with SpatialAssembler --- There're also some jobs done, which are not in the orginal plan: - solr support of jena-spatial - distance measurement units support of spatial:nearby For the project progress, the orders of some parts have been adjusted: * the implementations of the 2. Spatial Propery Functions are ahead of schedule * the job of 1. Spatial Data Indexer should be the first job according to the plan, But I completed it after 2 Spatial Propery Functions. * the unit tests before the mid-term evaluation are delayed. As a summary, the project has been going well. The code has been put into jena trunk. The remaining work should be the documentation on the website, fixing bugs, integrating into the Jena build and some promotion of the work. Cheers, Ying Jiang On Tue, Aug 27, 2013 at 5:09 AM, Andy Seaborne a...@apache.org wrote: On 26/08/13 06:45, Ying Jiang wrote: Hi Andy, Thanks for your help! I can make it now with Fuseki 0.2.8-SNAPSHOT. (for a weekly report) 1. test assembler with fuseki 0.2.8-snapshot 2. spatial indexing command line tools (for the current week) 1. solr support for jena-spatial I'm keeping an eye on the timescale. Getting the code into Apache and getting the document into the jena website (staging) are important. To make sure they get done, could you please aim to get them done sooner rather than later (I'm not a leave-until-the-minute person!). Also, could you please evaluate progress against the project plan and give an overall status report. We can then see how much time remains and plan that out. I'll take a look at the legal side of NOTICE and LICENSE files. Andy Best regards, Ying Jiang On Fri, Aug 23, 2013 at 12:00 AM, Andy Seaborne a...@apache.org wrote: On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-**distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/**content/repositories/** snapshots/org/apache/jena/**jena-fuseki/0.2.8-SNAPSHOT/** jena-fuseki-0.2.8-20130820.**080818-84.pomhttps://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/**groupId artifactIdjena-text/**artifactId version1.0.0-SNAPSHOT/**version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
Hi, (for a weekly report) 1. migration from google code to jena svn trunk 2. documentation in jena website (in progress) 3. resovle the JTS dependency problem (for the current week) 1. documentation in jena website 2. prepare release Best regards, Ying Jiang On Mon, Sep 2, 2013 at 6:04 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) 1. solr support for jena-spatial (for the current week) 1. migration from google code to jena svn trunk 2. documentation in jena website I've just compared the work so far with the original project plan. Here are the list of the project scopes in the plan and the evaluations: -- 1. Spatial Data Indexer: done with spatialindexer 2. Spatial Property Functions 2.1 within: done with spatial:withinBox and spatial:wininCircle 2.2 nearby: done with spatial:wininCircle. 2.3/2.4 intersects: only support shapes that can be represented with WKT literals 2.5 northing/southing/easting/westing: done 2.6 disjoints: not supported by the current version of Lucene, maybe available in future 3. Jena Assembler Configuration with Fuseki Integration: done with SpatialAssembler --- There're also some jobs done, which are not in the orginal plan: - solr support of jena-spatial - distance measurement units support of spatial:nearby For the project progress, the orders of some parts have been adjusted: * the implementations of the 2. Spatial Propery Functions are ahead of schedule * the job of 1. Spatial Data Indexer should be the first job according to the plan, But I completed it after 2 Spatial Propery Functions. * the unit tests before the mid-term evaluation are delayed. As a summary, the project has been going well. The code has been put into jena trunk. The remaining work should be the documentation on the website, fixing bugs, integrating into the Jena build and some promotion of the work. Cheers, Ying Jiang On Tue, Aug 27, 2013 at 5:09 AM, Andy Seaborne a...@apache.org wrote: On 26/08/13 06:45, Ying Jiang wrote: Hi Andy, Thanks for your help! I can make it now with Fuseki 0.2.8-SNAPSHOT. (for a weekly report) 1. test assembler with fuseki 0.2.8-snapshot 2. spatial indexing command line tools (for the current week) 1. solr support for jena-spatial I'm keeping an eye on the timescale. Getting the code into Apache and getting the document into the jena website (staging) are important. To make sure they get done, could you please aim to get them done sooner rather than later (I'm not a leave-until-the-minute person!). Also, could you please evaluate progress against the project plan and give an overall status report. We can then see how much time remains and plan that out. I'll take a look at the legal side of NOTICE and LICENSE files. Andy Best regards, Ying Jiang On Fri, Aug 23, 2013 at 12:00 AM, Andy Seaborne a...@apache.org wrote: On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-**distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/**content/repositories/** snapshots/org/apache/jena/**jena-fuseki/0.2.8-SNAPSHOT/** jena-fuseki-0.2.8-20130820.**080818-84.pomhttps://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/**groupId artifactIdjena-text/**artifactId version1.0.0-SNAPSHOT/**version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
Hi, (for a weekly report) 1. solr support for jena-spatial (for the current week) 1. migration from google code to jena svn trunk 2. documentation in jena website I've just compared the work so far with the original project plan. Here are the list of the project scopes in the plan and the evaluations: -- 1. Spatial Data Indexer: done with spatialindexer 2. Spatial Property Functions 2.1 within: done with spatial:withinBox and spatial:wininCircle 2.2 nearby: done with spatial:wininCircle. 2.3/2.4 intersects: only support shapes that can be represented with WKT literals 2.5 northing/southing/easting/westing: done 2.6 disjoints: not supported by the current version of Lucene, maybe available in future 3. Jena Assembler Configuration with Fuseki Integration: done with SpatialAssembler --- There're also some jobs done, which are not in the orginal plan: - solr support of jena-spatial - distance measurement units support of spatial:nearby For the project progress, the orders of some parts have been adjusted: * the implementations of the 2. Spatial Propery Functions are ahead of schedule * the job of 1. Spatial Data Indexer should be the first job according to the plan, But I completed it after 2 Spatial Propery Functions. * the unit tests before the mid-term evaluation are delayed. As a summary, the project has been going well. The code has been put into jena trunk. The remaining work should be the documentation on the website, fixing bugs, integrating into the Jena build and some promotion of the work. Cheers, Ying Jiang On Tue, Aug 27, 2013 at 5:09 AM, Andy Seaborne a...@apache.org wrote: On 26/08/13 06:45, Ying Jiang wrote: Hi Andy, Thanks for your help! I can make it now with Fuseki 0.2.8-SNAPSHOT. (for a weekly report) 1. test assembler with fuseki 0.2.8-snapshot 2. spatial indexing command line tools (for the current week) 1. solr support for jena-spatial I'm keeping an eye on the timescale. Getting the code into Apache and getting the document into the jena website (staging) are important. To make sure they get done, could you please aim to get them done sooner rather than later (I'm not a leave-until-the-minute person!). Also, could you please evaluate progress against the project plan and give an overall status report. We can then see how much time remains and plan that out. I'll take a look at the legal side of NOTICE and LICENSE files. Andy Best regards, Ying Jiang On Fri, Aug 23, 2013 at 12:00 AM, Andy Seaborne a...@apache.org wrote: On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-**distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/**content/repositories/** snapshots/org/apache/jena/**jena-fuseki/0.2.8-SNAPSHOT/** jena-fuseki-0.2.8-20130820.**080818-84.pomhttps://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/**groupId artifactIdjena-text/**artifactId version1.0.0-SNAPSHOT/**version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
On 26/08/13 06:45, Ying Jiang wrote: Hi Andy, Thanks for your help! I can make it now with Fuseki 0.2.8-SNAPSHOT. (for a weekly report) 1. test assembler with fuseki 0.2.8-snapshot 2. spatial indexing command line tools (for the current week) 1. solr support for jena-spatial I'm keeping an eye on the timescale. Getting the code into Apache and getting the document into the jena website (staging) are important. To make sure they get done, could you please aim to get them done sooner rather than later (I'm not a leave-until-the-minute person!). Also, could you please evaluate progress against the project plan and give an overall status report. We can then see how much time remains and plan that out. I'll take a look at the legal side of NOTICE and LICENSE files. Andy Best regards, Ying Jiang On Fri, Aug 23, 2013 at 12:00 AM, Andy Seaborne a...@apache.org wrote: On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-**distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/**content/repositories/** snapshots/org/apache/jena/**jena-fuseki/0.2.8-SNAPSHOT/** jena-fuseki-0.2.8-20130820.**080818-84.pomhttps://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/**groupId artifactIdjena-text/**artifactId version1.0.0-SNAPSHOT/**version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
Hi Andy, Thanks for your help! I can make it now with Fuseki 0.2.8-SNAPSHOT. (for a weekly report) 1. test assembler with fuseki 0.2.8-snapshot 2. spatial indexing command line tools (for the current week) 1. solr support for jena-spatial Best regards, Ying Jiang On Fri, Aug 23, 2013 at 12:00 AM, Andy Seaborne a...@apache.org wrote: On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-**distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/**content/repositories/** snapshots/org/apache/jena/**jena-fuseki/0.2.8-SNAPSHOT/** jena-fuseki-0.2.8-20130820.**080818-84.pomhttps://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/**groupId artifactIdjena-text/**artifactId version1.0.0-SNAPSHOT/**version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
On 22/08/13 05:36, Ying Jiang wrote: Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang Hi there - jene-text isn't in 0.2.7 (the last release, aligned to Jena 2.10.1) It is in Fuseki 0.2.8-SNAPSHOT (jena 2.10.2 aligned): https://repository.apache.org/content/repositories/snapshots/org/apache/jena/jena-fuseki/0.2.8-SNAPSHOT/jena-fuseki-0.2.8-20130820.080818-84.pom All it takes is: dependency groupIdorg.apache.jena/groupId artifactIdjena-text/artifactId version1.0.0-SNAPSHOT/version /dependency and then its dependencies of lucene and sol4j (the client) get pulled in by maven-shade-plugin. Andy
Re: [GSoC 2013] jena-spatial
Hi, I'm testing jena-spatial with fuseki. Could you please tell me how to integrate jena-spatial into fuseki? I mean to make jena-spatial a module included in fuseki-server.jar. I find jena-text documentation says it's already done. But I can't see it in jena-fuseki-0.2.7-distribution. Since jena-spatial depends in lucene and solr, how to package them into fuseki together with jena-spatial? Best regards, Ying Jiang On Mon, Aug 19, 2013 at 11:26 AM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) 1. spatial dataset assembler and the tests 2. update the examples and the test files, in accordance with the user document [1] (for the current week) 1. test assembler with fuseki 2. spatial indexing command line tools [1] http://code.google.com/p/jena-spatial/wiki/JenaSpatialUserDocument Best Regards, Ying Jiang On Tue, Aug 13, 2013 at 12:40 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) Last week, I completed the user document [1] of jena-spatial and fixed some bugs posted by Macro. The release of jena-spatial-1.0.0 has been announced in users and dev lists of jena. I hope more users can try it out and provide valuable feedback. (for the current week) I'm working on the spatial dataset assembler module. After that, jena-spatial will be tested with fuseki, maybe in next week. [1] http://code.google.com/p/jena-spatial/wiki/JenaSpatialUserDocument Best regards, Ying Jiang On Sat, Aug 10, 2013 at 4:07 AM, Andy Seaborne a...@apache.org wrote: On 07/08/13 16:08, Marco Neumann wrote: Very nice Ying Jiang, thank you for the quick changes, I have run a few quick tests and it look very good. more tests to come. This project comes along nicely and I consider to replace our geosparl.orgimplementation with the new GSoc code. We developed the spatial extension in 2008 with proprietary RTree and the new code is based on lucene. What are the exact licensing details for this project? Apache License v2. Andy what are the next steps to include this code in fuseki? I hope it will be included in the same way that the same way jena-text gets included. jena-text is simply added to the POM, then an example assembler. Andy -Marco
Re: [GSoC 2013] jena-spatial
Hi, (for a weekly report) 1. spatial dataset assembler and the tests 2. update the examples and the test files, in accordance with the user document [1] (for the current week) 1. test assembler with fuseki 2. spatial indexing command line tools [1] http://code.google.com/p/jena-spatial/wiki/JenaSpatialUserDocument Best Regards, Ying Jiang On Tue, Aug 13, 2013 at 12:40 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, (for a weekly report) Last week, I completed the user document [1] of jena-spatial and fixed some bugs posted by Macro. The release of jena-spatial-1.0.0 has been announced in users and dev lists of jena. I hope more users can try it out and provide valuable feedback. (for the current week) I'm working on the spatial dataset assembler module. After that, jena-spatial will be tested with fuseki, maybe in next week. [1] http://code.google.com/p/jena-spatial/wiki/JenaSpatialUserDocument Best regards, Ying Jiang On Sat, Aug 10, 2013 at 4:07 AM, Andy Seaborne a...@apache.org wrote: On 07/08/13 16:08, Marco Neumann wrote: Very nice Ying Jiang, thank you for the quick changes, I have run a few quick tests and it look very good. more tests to come. This project comes along nicely and I consider to replace our geosparl.orgimplementation with the new GSoc code. We developed the spatial extension in 2008 with proprietary RTree and the new code is based on lucene. What are the exact licensing details for this project? Apache License v2. Andy what are the next steps to include this code in fuseki? I hope it will be included in the same way that the same way jena-text gets included. jena-text is simply added to the POM, then an example assembler. Andy -Marco
Re: [GSoC 2013] jena-spatial
Hi, (for a weekly report) Last week, I completed the user document [1] of jena-spatial and fixed some bugs posted by Macro. The release of jena-spatial-1.0.0 has been announced in users and dev lists of jena. I hope more users can try it out and provide valuable feedback. (for the current week) I'm working on the spatial dataset assembler module. After that, jena-spatial will be tested with fuseki, maybe in next week. [1] http://code.google.com/p/jena-spatial/wiki/JenaSpatialUserDocument Best regards, Ying Jiang On Sat, Aug 10, 2013 at 4:07 AM, Andy Seaborne a...@apache.org wrote: On 07/08/13 16:08, Marco Neumann wrote: Very nice Ying Jiang, thank you for the quick changes, I have run a few quick tests and it look very good. more tests to come. This project comes along nicely and I consider to replace our geosparl.orgimplementation with the new GSoc code. We developed the spatial extension in 2008 with proprietary RTree and the new code is based on lucene. What are the exact licensing details for this project? Apache License v2. Andy what are the next steps to include this code in fuseki? I hope it will be included in the same way that the same way jena-text gets included. jena-text is simply added to the POM, then an example assembler. Andy -Marco
Re: [GSoC 2013] jena-spatial
I think Ying Jiang has already addressed this by using a tdb model instead
during index creation.
On Fri, Aug 9, 2013 at 4:03 PM, Andy Seaborne a...@apache.org wrote:
On 06/08/13 17:47, Marco Neumann wrote:
also is it correct that jena-spatial does create a full in-memory model
before applying the spatial indexing ?
I don't think there is reason to do so.
After all, to generate a list of points to index, it needs:
SELECT * {
?x geo:lat ?lat .
?x geo:long ?long .
}
Andy
--
---
Marco Neumann
KONA
Re: [GSoC 2013] jena-spatial
On 07/08/13 16:08, Marco Neumann wrote: Very nice Ying Jiang, thank you for the quick changes, I have run a few quick tests and it look very good. more tests to come. This project comes along nicely and I consider to replace our geosparl.orgimplementation with the new GSoc code. We developed the spatial extension in 2008 with proprietary RTree and the new code is based on lucene. What are the exact licensing details for this project? Apache License v2. Andy what are the next steps to include this code in fuseki? I hope it will be included in the same way that the same way jena-text gets included. jena-text is simply added to the POM, then an example assembler. Andy -Marco
Re: [GSoC 2013] jena-spatial
Dear Macro,
Thanks a lot! I've updated the code in the following ways:
1. Add the support for indexing literals without datatypes, i.e. the
support for b.) in the previous mails. You can find the demostrations in
the test [1], and in the example code [2].
2. Add a test [3] for a file based TDB Dataset with the spatial index.
Actually, jena-spatial is suitable for any types of Dataset, including
in-memory ones, file based ones (such as TDB), or something else. Please
check JenaSpatialExample1.joinDataset() in the example code [2], which
shows how to add the spatial indexing support for a base Dataset.
[1]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TestIndexingSpatialData.java
[2]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/main/java/examples/JenaSpatialExample1.java
[3]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TestTDBDatasetWithLuceneSpatialIndex.java
Please update the code and have a try. I'm very grateful to your valuable
feedbacks!
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:49 AM, Marco Neumann marco.neum...@gmail.comwrote:
I would lean towards b.) but that does not mean to omit a.)
On Tue, Aug 6, 2013 at 12:42 PM, Ying Jiang jpz6311...@gmail.com wrote:
Hi, Marco
The current indexing strategy requires both the followings:
1) the predicates to be geo:lat and geo:long;
2) the datatypes of objects are: XSDfloat, XSDdecimal, XSDdouble,
XSDinteger
For b) you mentioned. Jena will regard no datatypes of the objects.
Shall we remove the requirements of 2), or make it compatible with b)?
Are
the datatype restrictions on the objects necessary for indexing?
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:17 AM, Marco Neumann marco.neum...@gmail.com
wrote:
the current project requires the spatial data for points to come typed
as
xsd:float. otherwise data is ignored during indexing.
example:
a.) {will be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539^^xsd:float ;
geo:long -1.74803^^xsd:float ;
rdfs:label Birmingham International Airport
b.) {will not be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539;
geo:long -1.74803;
rdfs:label Birmingham International Airport
By default jena should accept geo:lat and geo:long as decimal degrees.
On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com
wrote:
Hi,
I'm with the dev list. Any problems with your tests?
Best regards,
Ying Jiang
On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann
marco.neum...@gmail.com
wrote:
Andy,
is Ying Jiang a member of the dev list?
Marco
On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann
marco.neum...@gmail.com
wrote:
ok so I have the project now in the correct setup and the code
compiles
fine but with 1677 warnings as mention by you
I am going to test the code with larger rdf data sets in the
coming
days.
On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:48, Marco Neumann wrote:
On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:25, Marco Neumann wrote:
Andy,
yes, but I am discussing some details with Ying Jiang
off-list
there
are
some configuration questions I still have. The code itself
looks
OK.
Great - thanks.
Could we have the discussions on-list please?
What would be the schedule for a release? Will this be part
of
the
main
jena release? if so there need to be some dependencies worked
out
for
apache-lucene and apache-lucene spatial on my end.
Such as? (I didn't have any issues with the versions in the
POM)
it's a configuration option in eclipse (Kepler)+m2eclipse with
apache+lucene + apache+lucene+spatial I need to replicate.
how do you compile the POM and missing dependencies? do you
just
create a
local copy of the specific jena snapshot + jars?
kepler+maven nature works for me. I haven't tried mvn
eclipse:eclipse
or you can build with:
mvn clean test
Dependencies work with mvn dependency:resolve and with
Eclipse: maven-Update Project
Andy
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
Re: [GSoC 2013] jena-spatial
Very nice Ying Jiang,
thank you for the quick changes, I have run a few quick tests and it look
very good. more tests to come.
This project comes along nicely and I consider to replace our
geosparl.orgimplementation with the new GSoc code. We developed the
spatial extension
in 2008 with proprietary RTree and the new code is based on lucene. What
are the exact licensing details for this project?
Andy what are the next steps to include this code in fuseki?
-Marco
On Wed, Aug 7, 2013 at 10:28 AM, Ying Jiang jpz6311...@gmail.com wrote:
Dear Macro,
Thanks a lot! I've updated the code in the following ways:
1. Add the support for indexing literals without datatypes, i.e. the
support for b.) in the previous mails. You can find the demostrations in
the test [1], and in the example code [2].
2. Add a test [3] for a file based TDB Dataset with the spatial index.
Actually, jena-spatial is suitable for any types of Dataset, including
in-memory ones, file based ones (such as TDB), or something else. Please
check JenaSpatialExample1.joinDataset() in the example code [2], which
shows how to add the spatial indexing support for a base Dataset.
[1]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TestIndexingSpatialData.java
[2]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/main/java/examples/JenaSpatialExample1.java
[3]
http://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TestTDBDatasetWithLuceneSpatialIndex.java
Please update the code and have a try. I'm very grateful to your valuable
feedbacks!
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:49 AM, Marco Neumann marco.neum...@gmail.com
wrote:
I would lean towards b.) but that does not mean to omit a.)
On Tue, Aug 6, 2013 at 12:42 PM, Ying Jiang jpz6311...@gmail.com
wrote:
Hi, Marco
The current indexing strategy requires both the followings:
1) the predicates to be geo:lat and geo:long;
2) the datatypes of objects are: XSDfloat, XSDdecimal, XSDdouble,
XSDinteger
For b) you mentioned. Jena will regard no datatypes of the objects.
Shall we remove the requirements of 2), or make it compatible with b)?
Are
the datatype restrictions on the objects necessary for indexing?
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:17 AM, Marco Neumann
marco.neum...@gmail.com
wrote:
the current project requires the spatial data for points to come
typed
as
xsd:float. otherwise data is ignored during indexing.
example:
a.) {will be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539^^xsd:float ;
geo:long -1.74803^^xsd:float ;
rdfs:label Birmingham International Airport
b.) {will not be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539;
geo:long -1.74803;
rdfs:label Birmingham International Airport
By default jena should accept geo:lat and geo:long as decimal
degrees.
On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com
wrote:
Hi,
I'm with the dev list. Any problems with your tests?
Best regards,
Ying Jiang
On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann
marco.neum...@gmail.com
wrote:
Andy,
is Ying Jiang a member of the dev list?
Marco
On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann
marco.neum...@gmail.com
wrote:
ok so I have the project now in the correct setup and the code
compiles
fine but with 1677 warnings as mention by you
I am going to test the code with larger rdf data sets in the
coming
days.
On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne
a...@apache.org
wrote:
On 05/08/13 14:48, Marco Neumann wrote:
On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne
a...@apache.org
wrote:
On 05/08/13 14:25, Marco Neumann wrote:
Andy,
yes, but I am discussing some details with Ying Jiang
off-list
there
are
some configuration questions I still have. The code itself
looks
OK.
Great - thanks.
Could we have the discussions on-list please?
What would be the schedule for a release? Will this be
part
of
the
main
jena release? if so there need to be some dependencies
worked
out
for
apache-lucene and apache-lucene spatial on my end.
Such as? (I didn't have any issues with the versions in the
POM)
it's a configuration option in eclipse (Kepler)+m2eclipse
with
apache+lucene + apache+lucene+spatial I need to replicate.
how do you compile the
Re: [GSoC 2013] jena-spatial
Andy, is Ying Jiang a member of the dev list? Marco On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann marco.neum...@gmail.comwrote: ok so I have the project now in the correct setup and the code compiles fine but with 1677 warnings as mention by you I am going to test the code with larger rdf data sets in the coming days. On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:48, Marco Neumann wrote: On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:25, Marco Neumann wrote: Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. Great - thanks. Could we have the discussions on-list please? What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Such as? (I didn't have any issues with the versions in the POM) it's a configuration option in eclipse (Kepler)+m2eclipse with apache+lucene + apache+lucene+spatial I need to replicate. how do you compile the POM and missing dependencies? do you just create a local copy of the specific jena snapshot + jars? kepler+maven nature works for me. I haven't tried mvn eclipse:eclipse or you can build with: mvn clean test Dependencies work with mvn dependency:resolve and with Eclipse: maven-Update Project Andy -- --- Marco Neumann KONA -- --- Marco Neumann KONA
Re: [GSoC 2013] jena-spatial
Hi, The warnings of the tests are presented when the geo pfunctions in the sparql query strings are used in the incorrect way. So there's no need to worry about the warnings. If no warnings are presented when it's incorrectly used, the codes should have problems, and the tests would not pass. Best regards, Ying Jiang On Mon, Aug 5, 2013 at 9:04 PM, Andy Seaborne a...@apache.org wrote: Macro - have you had a chance to try this out yet? On 03/08/13 11:11, Ying Jiang wrote: Hi Andy, Thanks for the comments! Please check my replies below. 1) Release: Firstly, I'd like to make a release in the Google code [1] and announce in the jena user mailing list for the feedbacks, marking it as jena-spatial-1.0.0. It should include the current source code and a compiled jar. I'll also make a tag of jena-spatial-1.0.0 in Google code svn. However, during coding, the version of the jena-parent is 7-SNAPSHOT, with ver.jena as 2.10.2-SNAPSHOT. Shall I change them into 6 and 2.10.1 respectively in the jena-spatial-1.0.0 release tag? Secondly, I'm looking forward to migrating the code to Jena SVN. What shall I do exactly? Do I need an apache svn account as a committer? We (the Jena project) need to get sorted out and I won't want that to delay a release and getting feedback. (I'd missed the fact that Google code no longer supports downloads as of May this year.) The quickest thing to do is to send email to the users list as soon as some documentation is ready. 2) Testing: Last week, I made some unit tests for the property functions. I did find some bugs during testing. The tests are very useful. More testing will be delivered later. Thanks for your reminder. The tests pass for me but they generate some warnings - should I worry about this? 3) User documentation: It's not done yet. I'll create a user guide similar to jena-text [3]. The documentation will be provided to the users accompanying with the release of 1). Andy [1] https://code.google.com/p/**jena-spatial/https://code.google.com/p/jena-spatial/ [2] https://code.google.com/p/**jena-spatial/source/browse/** trunk/src/test/java/org/**apache/jena/query/spatial/TS_** Spatial_Lucene.javahttps://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TS_Spatial_Lucene.java [3] http://jena.apache.org/**documentation/query/text-**query.htmlhttp://jena.apache.org/documentation/query/text-query.html On Mon, Jul 29, 2013 at 10:44 PM, Andy Seaborne a...@apache.org wrote: On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.**googlec**ode.com/svn/trunk/src/**main/** java/examples/http://googlecode.com/svn/trunk/src/**main/java/examples/ **JenaSpatialExample1.javahtt**ps://jena-spatial.googlecode.** com/svn/trunk/src/main/java/**examples/JenaSpatialExample1.**javahttps://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation Enough that someone can setup and use the project - short, to the point and now is better than long and detailed and later. (The final phase of GSoC is
Re: [GSoC 2013] jena-spatial
the current project requires the spatial data for points to come typed as
xsd:float. otherwise data is ignored during indexing.
example:
a.) {will be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539^^xsd:float ;
geo:long -1.74803^^xsd:float ;
rdfs:label Birmingham International Airport
b.) {will not be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539;
geo:long -1.74803;
rdfs:label Birmingham International Airport
By default jena should accept geo:lat and geo:long as decimal degrees.
On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com wrote:
Hi,
I'm with the dev list. Any problems with your tests?
Best regards,
Ying Jiang
On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann marco.neum...@gmail.com
wrote:
Andy,
is Ying Jiang a member of the dev list?
Marco
On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann marco.neum...@gmail.com
wrote:
ok so I have the project now in the correct setup and the code compiles
fine but with 1677 warnings as mention by you
I am going to test the code with larger rdf data sets in the coming
days.
On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:48, Marco Neumann wrote:
On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:25, Marco Neumann wrote:
Andy,
yes, but I am discussing some details with Ying Jiang off-list
there
are
some configuration questions I still have. The code itself looks
OK.
Great - thanks.
Could we have the discussions on-list please?
What would be the schedule for a release? Will this be part of the
main
jena release? if so there need to be some dependencies worked out
for
apache-lucene and apache-lucene spatial on my end.
Such as? (I didn't have any issues with the versions in the POM)
it's a configuration option in eclipse (Kepler)+m2eclipse with
apache+lucene + apache+lucene+spatial I need to replicate.
how do you compile the POM and missing dependencies? do you just
create a
local copy of the specific jena snapshot + jars?
kepler+maven nature works for me. I haven't tried mvn
eclipse:eclipse
or you can build with:
mvn clean test
Dependencies work with mvn dependency:resolve and with
Eclipse: maven-Update Project
Andy
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
Re: [GSoC 2013] jena-spatial
Hi, Marco
The current indexing strategy requires both the followings:
1) the predicates to be geo:lat and geo:long;
2) the datatypes of objects are: XSDfloat, XSDdecimal, XSDdouble, XSDinteger
For b) you mentioned. Jena will regard no datatypes of the objects.
Shall we remove the requirements of 2), or make it compatible with b)? Are
the datatype restrictions on the objects necessary for indexing?
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:17 AM, Marco Neumann marco.neum...@gmail.comwrote:
the current project requires the spatial data for points to come typed as
xsd:float. otherwise data is ignored during indexing.
example:
a.) {will be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539^^xsd:float ;
geo:long -1.74803^^xsd:float ;
rdfs:label Birmingham International Airport
b.) {will not be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539;
geo:long -1.74803;
rdfs:label Birmingham International Airport
By default jena should accept geo:lat and geo:long as decimal degrees.
On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com wrote:
Hi,
I'm with the dev list. Any problems with your tests?
Best regards,
Ying Jiang
On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann marco.neum...@gmail.com
wrote:
Andy,
is Ying Jiang a member of the dev list?
Marco
On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann marco.neum...@gmail.com
wrote:
ok so I have the project now in the correct setup and the code
compiles
fine but with 1677 warnings as mention by you
I am going to test the code with larger rdf data sets in the coming
days.
On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:48, Marco Neumann wrote:
On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:25, Marco Neumann wrote:
Andy,
yes, but I am discussing some details with Ying Jiang off-list
there
are
some configuration questions I still have. The code itself looks
OK.
Great - thanks.
Could we have the discussions on-list please?
What would be the schedule for a release? Will this be part of
the
main
jena release? if so there need to be some dependencies worked out
for
apache-lucene and apache-lucene spatial on my end.
Such as? (I didn't have any issues with the versions in the POM)
it's a configuration option in eclipse (Kepler)+m2eclipse with
apache+lucene + apache+lucene+spatial I need to replicate.
how do you compile the POM and missing dependencies? do you just
create a
local copy of the specific jena snapshot + jars?
kepler+maven nature works for me. I haven't tried mvn
eclipse:eclipse
or you can build with:
mvn clean test
Dependencies work with mvn dependency:resolve and with
Eclipse: maven-Update Project
Andy
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
Re: [GSoC 2013] jena-spatial
also is it correct that jena-spatial does create a full in-memory model before applying the spatial indexing ? On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi, I'm with the dev list. Any problems with your tests? Best regards, Ying Jiang On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann marco.neum...@gmail.com wrote: Andy, is Ying Jiang a member of the dev list? Marco On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann marco.neum...@gmail.com wrote: ok so I have the project now in the correct setup and the code compiles fine but with 1677 warnings as mention by you I am going to test the code with larger rdf data sets in the coming days. On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:48, Marco Neumann wrote: On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:25, Marco Neumann wrote: Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. Great - thanks. Could we have the discussions on-list please? What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Such as? (I didn't have any issues with the versions in the POM) it's a configuration option in eclipse (Kepler)+m2eclipse with apache+lucene + apache+lucene+spatial I need to replicate. how do you compile the POM and missing dependencies? do you just create a local copy of the specific jena snapshot + jars? kepler+maven nature works for me. I haven't tried mvn eclipse:eclipse or you can build with: mvn clean test Dependencies work with mvn dependency:resolve and with Eclipse: maven-Update Project Andy -- --- Marco Neumann KONA -- --- Marco Neumann KONA -- --- Marco Neumann KONA
Re: [GSoC 2013] jena-spatial
I would lean towards b.) but that does not mean to omit a.)
On Tue, Aug 6, 2013 at 12:42 PM, Ying Jiang jpz6311...@gmail.com wrote:
Hi, Marco
The current indexing strategy requires both the followings:
1) the predicates to be geo:lat and geo:long;
2) the datatypes of objects are: XSDfloat, XSDdecimal, XSDdouble,
XSDinteger
For b) you mentioned. Jena will regard no datatypes of the objects.
Shall we remove the requirements of 2), or make it compatible with b)? Are
the datatype restrictions on the objects necessary for indexing?
Best regards,
Ying Jiang
On Wed, Aug 7, 2013 at 12:17 AM, Marco Neumann marco.neum...@gmail.com
wrote:
the current project requires the spatial data for points to come typed as
xsd:float. otherwise data is ignored during indexing.
example:
a.) {will be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539^^xsd:float ;
geo:long -1.74803^^xsd:float ;
rdfs:label Birmingham International Airport
b.) {will not be indexed}
airports:EGBB rdf:type airports_sc:LargeAirport ;
geo:lat 52.4539;
geo:long -1.74803;
rdfs:label Birmingham International Airport
By default jena should accept geo:lat and geo:long as decimal degrees.
On Tue, Aug 6, 2013 at 12:04 PM, Ying Jiang jpz6311...@gmail.com
wrote:
Hi,
I'm with the dev list. Any problems with your tests?
Best regards,
Ying Jiang
On Tue, Aug 6, 2013 at 9:58 PM, Marco Neumann marco.neum...@gmail.com
wrote:
Andy,
is Ying Jiang a member of the dev list?
Marco
On Mon, Aug 5, 2013 at 5:16 PM, Marco Neumann
marco.neum...@gmail.com
wrote:
ok so I have the project now in the correct setup and the code
compiles
fine but with 1677 warnings as mention by you
I am going to test the code with larger rdf data sets in the coming
days.
On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:48, Marco Neumann wrote:
On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org
wrote:
On 05/08/13 14:25, Marco Neumann wrote:
Andy,
yes, but I am discussing some details with Ying Jiang off-list
there
are
some configuration questions I still have. The code itself
looks
OK.
Great - thanks.
Could we have the discussions on-list please?
What would be the schedule for a release? Will this be part of
the
main
jena release? if so there need to be some dependencies worked
out
for
apache-lucene and apache-lucene spatial on my end.
Such as? (I didn't have any issues with the versions in the
POM)
it's a configuration option in eclipse (Kepler)+m2eclipse with
apache+lucene + apache+lucene+spatial I need to replicate.
how do you compile the POM and missing dependencies? do you just
create a
local copy of the specific jena snapshot + jars?
kepler+maven nature works for me. I haven't tried mvn
eclipse:eclipse
or you can build with:
mvn clean test
Dependencies work with mvn dependency:resolve and with
Eclipse: maven-Update Project
Andy
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
--
---
Marco Neumann
KONA
Re: [GSoC 2013] jena-spatial
Macro - have you had a chance to try this out yet? On 03/08/13 11:11, Ying Jiang wrote: Hi Andy, Thanks for the comments! Please check my replies below. 1) Release: Firstly, I'd like to make a release in the Google code [1] and announce in the jena user mailing list for the feedbacks, marking it as jena-spatial-1.0.0. It should include the current source code and a compiled jar. I'll also make a tag of jena-spatial-1.0.0 in Google code svn. However, during coding, the version of the jena-parent is 7-SNAPSHOT, with ver.jena as 2.10.2-SNAPSHOT. Shall I change them into 6 and 2.10.1 respectively in the jena-spatial-1.0.0 release tag? Secondly, I'm looking forward to migrating the code to Jena SVN. What shall I do exactly? Do I need an apache svn account as a committer? We (the Jena project) need to get sorted out and I won't want that to delay a release and getting feedback. (I'd missed the fact that Google code no longer supports downloads as of May this year.) The quickest thing to do is to send email to the users list as soon as some documentation is ready. 2) Testing: Last week, I made some unit tests for the property functions. I did find some bugs during testing. The tests are very useful. More testing will be delivered later. Thanks for your reminder. The tests pass for me but they generate some warnings - should I worry about this? 3) User documentation: It's not done yet. I'll create a user guide similar to jena-text [3]. The documentation will be provided to the users accompanying with the release of 1). Andy [1] https://code.google.com/p/jena-spatial/ [2] https://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TS_Spatial_Lucene.java [3] http://jena.apache.org/documentation/query/text-query.html On Mon, Jul 29, 2013 at 10:44 PM, Andy Seaborne a...@apache.org wrote: On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.**googlecode.com/svn/trunk/src/**main/java/examples/ **JenaSpatialExample1.javahttps://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation Enough that someone can setup and use the project - short, to the point and now is better than long and detailed and later. (The final phase of GSoC is write-up - that's needs to cover the next developers to come along.) What do you think about this? Andy
Re: [GSoC 2013] jena-spatial
Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Marco On Mon, Aug 5, 2013 at 9:04 AM, Andy Seaborne a...@apache.org wrote: Macro - have you had a chance to try this out yet? On 03/08/13 11:11, Ying Jiang wrote: Hi Andy, Thanks for the comments! Please check my replies below. 1) Release: Firstly, I'd like to make a release in the Google code [1] and announce in the jena user mailing list for the feedbacks, marking it as jena-spatial-1.0.0. It should include the current source code and a compiled jar. I'll also make a tag of jena-spatial-1.0.0 in Google code svn. However, during coding, the version of the jena-parent is 7-SNAPSHOT, with ver.jena as 2.10.2-SNAPSHOT. Shall I change them into 6 and 2.10.1 respectively in the jena-spatial-1.0.0 release tag? Secondly, I'm looking forward to migrating the code to Jena SVN. What shall I do exactly? Do I need an apache svn account as a committer? We (the Jena project) need to get sorted out and I won't want that to delay a release and getting feedback. (I'd missed the fact that Google code no longer supports downloads as of May this year.) The quickest thing to do is to send email to the users list as soon as some documentation is ready. 2) Testing: Last week, I made some unit tests for the property functions. I did find some bugs during testing. The tests are very useful. More testing will be delivered later. Thanks for your reminder. The tests pass for me but they generate some warnings - should I worry about this? 3) User documentation: It's not done yet. I'll create a user guide similar to jena-text [3]. The documentation will be provided to the users accompanying with the release of 1). Andy [1] https://code.google.com/p/**jena-spatial/https://code.google.com/p/jena-spatial/ [2] https://code.google.com/p/**jena-spatial/source/browse/** trunk/src/test/java/org/**apache/jena/query/spatial/TS_** Spatial_Lucene.javahttps://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TS_Spatial_Lucene.java [3] http://jena.apache.org/**documentation/query/text-**query.htmlhttp://jena.apache.org/documentation/query/text-query.html On Mon, Jul 29, 2013 at 10:44 PM, Andy Seaborne a...@apache.org wrote: On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.**googlec**ode.com/svn/trunk/src/**main/** java/examples/http://googlecode.com/svn/trunk/src/**main/java/examples/ **JenaSpatialExample1.javahtt**ps://jena-spatial.googlecode.** com/svn/trunk/src/main/java/**examples/JenaSpatialExample1.**javahttps://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation Enough that someone can setup and use the project - short, to the point and now is better than long and detailed and later.
Re: [GSoC 2013] jena-spatial
On 05/08/13 14:25, Marco Neumann wrote: Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. Great - thanks. Could we have the discussions on-list please? What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Such as? (I didn't have any issues with the versions in the POM) Andy Marco On Mon, Aug 5, 2013 at 9:04 AM, Andy Seaborne a...@apache.org wrote: Macro - have you had a chance to try this out yet? On 03/08/13 11:11, Ying Jiang wrote: Hi Andy, Thanks for the comments! Please check my replies below. 1) Release: Firstly, I'd like to make a release in the Google code [1] and announce in the jena user mailing list for the feedbacks, marking it as jena-spatial-1.0.0. It should include the current source code and a compiled jar. I'll also make a tag of jena-spatial-1.0.0 in Google code svn. However, during coding, the version of the jena-parent is 7-SNAPSHOT, with ver.jena as 2.10.2-SNAPSHOT. Shall I change them into 6 and 2.10.1 respectively in the jena-spatial-1.0.0 release tag? Secondly, I'm looking forward to migrating the code to Jena SVN. What shall I do exactly? Do I need an apache svn account as a committer? We (the Jena project) need to get sorted out and I won't want that to delay a release and getting feedback. (I'd missed the fact that Google code no longer supports downloads as of May this year.) The quickest thing to do is to send email to the users list as soon as some documentation is ready. 2) Testing: Last week, I made some unit tests for the property functions. I did find some bugs during testing. The tests are very useful. More testing will be delivered later. Thanks for your reminder. The tests pass for me but they generate some warnings - should I worry about this? 3) User documentation: It's not done yet. I'll create a user guide similar to jena-text [3]. The documentation will be provided to the users accompanying with the release of 1). Andy [1] https://code.google.com/p/**jena-spatial/https://code.google.com/p/jena-spatial/ [2] https://code.google.com/p/**jena-spatial/source/browse/** trunk/src/test/java/org/**apache/jena/query/spatial/TS_** Spatial_Lucene.javahttps://code.google.com/p/jena-spatial/source/browse/trunk/src/test/java/org/apache/jena/query/spatial/TS_Spatial_Lucene.java [3] http://jena.apache.org/**documentation/query/text-**query.htmlhttp://jena.apache.org/documentation/query/text-query.html On Mon, Jul 29, 2013 at 10:44 PM, Andy Seaborne a...@apache.org wrote: On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.**googlec**ode.com/svn/trunk/src/**main/** java/examples/http://googlecode.com/svn/trunk/src/**main/java/examples/ **JenaSpatialExample1.javahtt**ps://jena-spatial.googlecode.** com/svn/trunk/src/main/java/**examples/JenaSpatialExample1.**javahttps://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation
Re: [GSoC 2013] jena-spatial
On 05/08/13 14:48, Marco Neumann wrote: On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:25, Marco Neumann wrote: Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. Great - thanks. Could we have the discussions on-list please? What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Such as? (I didn't have any issues with the versions in the POM) it's a configuration option in eclipse (Kepler)+m2eclipse with apache+lucene + apache+lucene+spatial I need to replicate. how do you compile the POM and missing dependencies? do you just create a local copy of the specific jena snapshot + jars? kepler+maven nature works for me. I haven't tried mvn eclipse:eclipse or you can build with: mvn clean test Dependencies work with mvn dependency:resolve and with Eclipse: maven-Update Project Andy
Re: [GSoC 2013] jena-spatial
ok so I have the project now in the correct setup and the code compiles fine but with 1677 warnings as mention by you I am going to test the code with larger rdf data sets in the coming days. On Mon, Aug 5, 2013 at 10:16 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:48, Marco Neumann wrote: On Mon, Aug 5, 2013 at 9:41 AM, Andy Seaborne a...@apache.org wrote: On 05/08/13 14:25, Marco Neumann wrote: Andy, yes, but I am discussing some details with Ying Jiang off-list there are some configuration questions I still have. The code itself looks OK. Great - thanks. Could we have the discussions on-list please? What would be the schedule for a release? Will this be part of the main jena release? if so there need to be some dependencies worked out for apache-lucene and apache-lucene spatial on my end. Such as? (I didn't have any issues with the versions in the POM) it's a configuration option in eclipse (Kepler)+m2eclipse with apache+lucene + apache+lucene+spatial I need to replicate. how do you compile the POM and missing dependencies? do you just create a local copy of the specific jena snapshot + jars? kepler+maven nature works for me. I haven't tried mvn eclipse:eclipse or you can build with: mvn clean test Dependencies work with mvn dependency:resolve and with Eclipse: maven-Update Project Andy -- --- Marco Neumann KONA
Re: [GSoC 2013] jena-spatial
On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation Enough that someone can setup and use the project - short, to the point and now is better than long and detailed and later. (The final phase of GSoC is write-up - that's needs to cover the next developers to come along.) What do you think about this? Andy
Re: [GSoC 2013] jena-spatial
I also would like to see a file based index while you are at it and not just the in memory spatial lucene engine example. On Mon, Jul 29, 2013 at 10:44 AM, Andy Seaborne a...@apache.org wrote: On 27/07/13 14:40, Ying Jiang wrote: Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.**googlecode.com/svn/trunk/src/**main/java/examples/ **JenaSpatialExample1.javahttps://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy Things are looking very good. How does this fit with the original plan in terms of functionality available? As we enter the second part of the GSoC, we need to be thinking about * A release That does not mean it's complete and a release needn't be a major cost in time. Having even one or two people try it out really helps in understanding what people might do with spatial indexing. It can be a message to the users Jena mailing list announcing status of the project and assuming interested people will grab the source and compile a jar for themselves. But, if you want to, we can do something more packaged - anything up to and including migrating the code to Jena SVN and putting in a Jenkins job to build it into Jena's snapshot maven repository that's doable. A couple of things go with that: * Testing src/java/test is a bit empty :-) * User documentation Enough that someone can setup and use the project - short, to the point and now is better than long and detailed and later. (The final phase of GSoC is write-up - that's needs to cover the next developers to come along.) What do you think about this? Andy -- --- Marco Neumann KONA
Re: [GSoC 2013] jena-spatial
Hi, The default distance units measurement is miles. I've just committed a major change of the codes, including the following updates: 1) Support spatial indexing of WKT literal, including Point, Polygon or any other kinds of shapes. 2) New property functions of withinCirle, withinBox, intersectsBox, north, south, east, west 3) Support different distance units for nearby, such as miles, kilometers, degrees, meters and so on. 4) Examples are updated [1]. You can play with the new features of jena-spatial. It's almost half-way of the GSoC project. In the upcoming second half, I'll bring more visibility of code progress to the community, at least one report per week. Thanks to Andy for pointing it out! [1] https://jena-spatial.googlecode.com/svn/trunk/src/main/java/examples/JenaSpatialExample1.java On Tue, Jul 23, 2013 at 9:37 PM, Andy Seaborne a...@apache.org wrote: In the example query there is: ?s spatial:nearby (51.3000 -2.71000 100) What units are the 100? Can the application provide different units? Andy
Re: [GSoC 2013] jena-spatial
Hi Andy and Sören, Thanks for pointing out the data sources. I've studied the geodata formats in geonames, LinkedGeoData, DBPedia. There're mainly 2 types of RDF representation of geo locations (latitude, longitude): 1) wgs84_pos (in gonames, DBPedia and LinkedGeoData) airports:EGBB rdf:type airports_sc:LargeAirport ; *geo:lat* 52.4539^^xsd:float ; *geo:long* -1.74803^^xsd:float 2) Well Known Text Literal (in DBPedia and LinkedGeoData) lgd-geom:node132677 a geom:Geometry ; *ogc:asWKT* POINT(7.3388181 51.4433324)^^ogc:wktLiteral . They are widely used in semantic geodata. I think I'm supposed to support both format in jena-spatial. If you know more formats in other data sources, please tell me. Thanks! Following the way of jena-text, I'm working on the project of jena-spatial in Google Code [1]. Now the indexing part for 1) has reached a milestone. I've also made the Nearby querying support for 1). The code have been committed. You can play with the example [2] of querying nearby airports, borrowed from geoarq [3]. In the next steps, I'll go for 2) and try to implement more query property functions, such as Within, Intersect, and so on. After the mid-term evaluation in late July, I'm going to work on the assembler implementation of jena-spatial. There're also some other issues to be considered carefully. 1 unit of measurement. The example mentioned above is just using miles instead of kilometers. Shall we support both, or make things more complicated to introduce arbitrary unit of measurements? 2 data source compatibility. For 2), I find that DBPedia uses * geo:geometry*, while LinkedGeoData adopts *ogc:asWKT *and *geo:geometry. *There may be more predicates for other data sources. I've made an interface for jena-spatial to consume all kinds of predicates for 1). Any comments are welcome! Best regards, Ying Jiang [1] http://code.google.com/p/jena-spatial/ [2] http://code.google.com/p/jena-spatial/source/browse/trunk/src/main/java/examples/JenaSpatialExample1.java [3] https://github.com/castagna/GeoARQ On Mon, Jul 8, 2013 at 9:04 PM, Andy Seaborne a...@apache.org wrote: On 02/07/13 04:46, Ying Jiang wrote: Hi, My name is Ying Jiang. I'm the GSoC student for Apache Jena on the project of jena-sptial. In brief, the project will end up with an ARQ extension to perform simple spatial searches within SPARQL queries. The approach is similar to jena-text. Many technical details have been discussed during the project application period. I just completed my exams in late June. Now I've set up a svn repository on Google Code [1] and got ready to code. I'd very glad to have Andy, Damian and Stephen as the mentors. You will see the code to be committed there in the coming months. I'd be grateful to your help when I ask questions in the dev mailing list. [1] http://code.google.com/p/jena-spatial/ Best regards, Ying Jiang How's it going? What are the immediately goals for the work? Andy
Re: [GSoC 2013] jena-spatial
On 02/07/13 04:46, Ying Jiang wrote: Hi, My name is Ying Jiang. I'm the GSoC student for Apache Jena on the project of jena-sptial. In brief, the project will end up with an ARQ extension to perform simple spatial searches within SPARQL queries. The approach is similar to jena-text. Many technical details have been discussed during the project application period. I just completed my exams in late June. Now I've set up a svn repository on Google Code [1] and got ready to code. I'd very glad to have Andy, Damian and Stephen as the mentors. You will see the code to be committed there in the coming months. I'd be grateful to your help when I ask questions in the dev mailing list. [1] http://code.google.com/p/jena-spatial/ Best regards, Ying Jiang Hi Ying, Do you want to put the full project description up on that site? The GoSC seems to secure project descriptions. The project plan talks about preparing demo data. What had you in mind? It would be really great to combine data from different sources. One source is geonames and I managed to get RDF out of the website with: http://www.geonames.org/2654675/about.rdf (which is Bristol, UK). Anyone get suggestions for other sources? Andy
Re: [GSoC 2013] jena-spatial
On 02/07/13 04:46, Ying Jiang wrote: Hi, My name is Ying Jiang. I'm the GSoC student for Apache Jena on the project of jena-sptial. In brief, the project will end up with an ARQ extension to perform simple spatial searches within SPARQL queries. The approach is similar to jena-text. Many technical details have been discussed during the project application period. I just completed my exams in late June. Now I've set up a svn repository on Google Code [1] and got ready to code. I'd very glad to have Andy, Damian and Stephen as the mentors. You will see the code to be committed there in the coming months. I'd be grateful to your help when I ask questions in the dev mailing list. [1] http://code.google.com/p/jena-spatial/ Best regards, Ying Jiang Hi Ying, Do you want to put the full project description up on that site? The GoSC seems to secure project descriptions. The project plan talks about preparing demo data. What had you in mind? It would be really great to combine data from different sources. One source is geonames and I managed to get RDF out of the website with: http://www.geonames.org/2654675/about.rdf (which is Bristol, UK). Anyone get suggestions for other sources? Andy DBPedia has geodata for many real world entities using the W3C geo vocabulary (e.g. http://dbpedia.org/resource/Bristol). The LinkedGeoData Project (http://linkedgeodata.org) also has a lot of spatial data by creating RDF from OpenStreetMaps. It is modeled with GeoSPARQL but supporting simple coordinates shouldn't be too difficult, since they are represented as Well Known Text Literals. Example: http://linkedgeodata.org/geometry/node132677 http://www.opengis.net/ont/geosparql#asWKT POINT(7.3388181 51.4433324)^^http://www.opengis.net/ont/geosparql#wktLiteral . Cheers, Sören
