Hello, now that I have the WKT in a sting field, I get this during the
dataimport process
org.apache.solr.common.SolrException: Couldn't parse shape '[[POLYGON
((-8134690.8140452942 4866553.78506005, -7836280.655620046 4884898.671848488,
-8009945.58388392 4732024.615278176, -8134690.8140452942 4866553.78506005))]]]'
because: For input string: "[[POLYGON ((-8134690.8140452942 4866553.78506005"
at
org.apache.solr.schema.AbstractSpatialFieldType.parseShape(AbstractSpatialFieldType.java:175)
at
org.apache.solr.schema.AbstractSpatialFieldType.createFields(AbstractSpatialFieldType.java:139)
at
org.apache.solr.update.DocumentBuilder.addField(DocumentBuilder.java:47)
at
org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:118)
at
org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:77)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164)
at
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:870)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1024)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:693)
at
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100)
at
org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:71)
at
org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:261)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:496)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:400)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:315)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:223)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:411)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:464)
Caused by: java.lang.NumberFormatException: For input string: "[[POLYGON
((-8134690.8140452942 4866553.78506005"
at sun.misc.FloatingDecimal.readJavaFormatString(Unknown Source)
at java.lang.Double.parseDouble(Unknown Source)
at
com.spatial4j.core.io.ParseUtils.parsePointDouble(ParseUtils.java:108)
at
com.spatial4j.core.io.ParseUtils.parseLatitudeLongitude(ParseUtils.java:145)
at
com.spatial4j.core.io.ParseUtils.parseLatitudeLongitude(ParseUtils.java:137)
at
com.spatial4j.core.io.LegacyShapeReadWriterFormat.readLatCommaLonPoint(LegacyShapeReadWriterFormat.java:169)
at
com.spatial4j.core.io.LegacyShapeReadWriterFormat.readShapeOrNull(LegacyShapeReadWriterFormat.java:153)
at
org.apache.solr.schema.AbstractSpatialFieldType.parseShape(AbstractSpatialFieldType.java:167)
my field type is defined as follows
<fieldType name="location_rpt" class="solr.SpatialRecursivePrefixTreeFieldType"
spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory"
geo="false" distErrPct="0.025" maxDistErr="0.000009" units="degrees" />
Alex Bostic
GIS Developer
URS Corporation
12420 Milestone Center Drive, Suite 150
Germantown, MD 20876
direct line: 301-820-3287
cell line: 301-213-2639
-----Original Message-----
From: Bostic, Alex [mailto:alex.bos...@urs.com]
Sent: Saturday, August 23, 2014 2:27 PM
To: solr-user@lucene.apache.org
Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial
Thanks I will try for a correct install. I have many other fields that are
indexing fine, I will inspect for further errors and use DIH debug mode. I
will also create a string field for geometries.
One item to note is that the spatial data is stored in sql servers geometry
type field. Only through the DIH query do I return WKT, maybe that's the issue.
________________________________________
From: david.w.smi...@gmail.com [david.w.smi...@gmail.com]
Sent: Saturday, August 23, 2014 2:03 PM
To: solr-user@lucene.apache.org
Subject: Re: Indexing and Querying MS SQL Server 2012 Spatial
Putting JTS where you put it is fine temporarily but I strongly recommend
against any jar being placed there at all; ideally it should be associated with
the Solr installation; not with java itself.
Some kinda of errors must be happening but you're not seeing them. I presume
you've configured the DIH since you're telling me your hitting its button in
the UI. The DIH has a debug mode; it's been a while since I used the DIH last
but I remember that feature being really useful.
For the sake of troubleshooting, try putting the geometries (WKT) into a
"string" field, then you should see them. If not then you're current problem
is squarely with the import process/config, not with Solr spatial.
~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley
On Sat, Aug 23, 2014 at 10:53 AM, Bostic, Alex <alex.bos...@urs.com> wrote:
> Ok thanks, I am even closer
>
> I put jts-1.13.jar here C:\Program Files (x86)\Java\jre7\lib\ext
>
> And removed it from the cmd line when starting solr
>
> I no longer get the class not found issues. I removed the jar from the above
> location and got the error again, so I put it back to confirm I'm past the
> Not Found issue.
>
> My core appears to startup fine,
>
> I select my core in the browser manager and Execute a full-import with
> Clean and Commit checked. That appears to go well. However, I still
> don't see my geom field as part of my index
>
> I do ALSO have the jar in
> C:\AddSoftware\solr-4.9.0\ocsirasspatial\solr-webapp\webapp\WEB-INF\li
> b
>
> Any other hints are certainly welcome. I think I'm close
>
> Alex Bostic
> GIS Developer
> URS Corporation
> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct
> line: 301-820-3287 cell line: 301-213-2639
>
>
> -----Original Message-----
> From: david.w.smi...@gmail.com [mailto:david.w.smi...@gmail.com]
> Sent: Saturday, August 23, 2014 9:15 AM
> To: solr-user@lucene.apache.org
> Subject: Re: Indexing and Querying MS SQL Server 2012 Spatial
>
> The jts-1.13.jar file (other JTS jars that come with it aren't used) needs to
> go on the java classpath. I haven't tried to do it using the way you're
> doing it. Note that the "lib" directories Solr manages won't work for some
> jar's like this one. I forget but I think putting it in examples/lib works.
> Unpacking the WAR and putting it in WEB-INF/lib definitely works.
> ~ David Smiley
> Freelance Apache Lucene/Solr Search Consultant/Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
> On Sat, Aug 23, 2014 at 4:36 AM, Bostic, Alex <alex.bos...@urs.com> wrote:
>> Ok, I was missing
>> spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory"
>>
>>
>> Now I am getting
>>
>> Error loading core:java.util.concurrent.ExecutionException:
>> java.lang.NoClassDefFoundError:
>> com/vividsolutions/jts/geom/CoordinateSequenceFactory
>>
>> Any help resolving my path issues would be great
>>
>> Alex Bostic
>> GIS Developer
>> URS Corporation
>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct
>> line: 301-820-3287 cell line: 301-213-2639
>>
>>
>> -----Original Message-----
>> From: Bostic, Alex [mailto:alex.bos...@urs.com]
>> Sent: Saturday, August 23, 2014 3:53 AM
>> To: solr-user@lucene.apache.org
>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial
>>
>> Hello, I guess I'm closer. But my geom field does not show up in the index.
>>
>> I have a table full of polys, stored as SQL Server Geometry Type.
>>
>> Taken from the example schema I have:
>> ..
>> <field name="geom" type="location_rpt" indexed="true" stored="true"/> ..
>>
>> In my data-config.xml I have:
>> <entity name="data" dataSource="ds1" pk="key"
>> query="SELECT wt.Id, wt.Name,
>> wt.WorkTypeTypeId,wt.ChildId,wt.CreatedDate,wt.ModifiedDate,wt.Year,
>> wta.GEOM.STAsText(), wta.OBJECTID
>> FROM dbo.WorkTypes wt Inner Join dbo.WorkTypeAreas wta ON wt.Id =
>> wta.WorkTypeId">
>> <field column="Id" name="id" />
>> <field column="ChildId" name="childid" />
>> <field column="WorkTypeTypeId" name="worktypetypeid" />
>> <field column="Name" name="name" />
>> <field column="CreatedDate" name="createddate" />
>> <field column="ModifiedDate" name="modifieddate" />
>> <field column="UserId" name="userid" />
>> <field column="Year" name="year" />
>> <field column="GEOM" name="geom" />
>> <field column="OBJECTID" name="objectid" />
>> </entity>
>>
>> OBJECTID shows up fine in my updated index, gut GEOM does not. The
>> index was successful and I don't see any errors in the console or the
>> log (from the web)
>>
>> I am starting solr like so:
>> java -Dsolr.solr.home=c:\AddedSoftware\solr-4.90\ocsirasspatial\solr
>> -Djetty.class.path=c:\AddedSoftware\solr-4.9.0\jts-1.13\lib -jar
>> start.jar
>>
>> Based on the above, what am I missing to get this to work. Maybe I am
>> overlooking an issue in the console?
>>
>> Thanks
>>
>>
>> Alex Bostic
>> GIS Developer
>> URS Corporation
>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct
>> line: 301-820-3287 cell line: 301-213-2639
>>
>>
>> -----Original Message-----
>> From: Bostic, Alex [mailto:alex.bos...@urs.com]
>> Sent: Wednesday, August 20, 2014 4:41 PM
>> To: solr-user@lucene.apache.org
>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial
>>
>> Ok Great, I'm just going to dive in and see if I can index my data. Does
>> spatial reference matter?
>>
>> Alex Bostic
>> GIS Developer
>> URS Corporation
>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct
>> line: 301-820-3287 cell line: 301-213-2639
>>
>>
>> -----Original Message-----
>> From: Pires, Guilherme [mailto:guilherme.pi...@cgi.com]
>> Sent: Wednesday, August 20, 2014 4:30 PM
>> To: solr-user@lucene.apache.org
>> Subject: RE: Indexing and Querying MS SQL Server 2012 Spatial
>>
>> Hello,
>>
>> I've been working with Solr together with JTS and use location_rpt
>> class for the geometry field for a while now. (However, I must say
>> that the index grew a lot when used this class instead of the geohash
>> for simple points ..so use it only if you really need to index
>> polylines and/or polygons)
>>
>> I actually already successfully connected solr to postGis and oracle spatial
>> via DIH but in this live website ( http://cascaismap.com ) we had a GE
>> Smallworld as the GIS system so it was easier just to build a sync engine
>> that periodically queries differences from the GIS and push them into solr
>> via xml document. This project has already couple of years now so a lot
>> would be different now.
>>
>> In that website, solr provides, obviously, all the text search on the top
>> and also 70% of the themes available on the treeview on the left (expand in
>> the red button) that are result of a bounding box query to geometry index in
>> solr.
>> Something like this : (...)q=bounds:Intersects(-9.463118366688718
>> 38.67913579372146 -9.370549969166746 38.7109390712568)(...)
>>
>> After this, we actually provided for a different project, a similar sync
>> mechanism but between in-house solr instances and google maps engine
>> datastore in the cloud and it works like a charm.
>>
>> Guilherme Pires
>> Geospatial Intelligence @ CGI
>> guilherme.pi...@cgi.com
>>
>> ________________________________________
>> De: david.w.smi...@gmail.com [david.w.smi...@gmail.com]
>> Enviado: quarta-feira, 20 de Agosto de 2014 18:49
>> Para: solr-user@lucene.apache.org
>> Assunto: Re: Indexing and Querying MS SQL Server 2012 Spatial
>>
>> Hi Alex,
>>
>> I guess a spatial tutorial might be helpful, but there isn't one. There is
>> a sample at the Lucene-spatial layer but not up at Solr. You need to use
>> WKT syntax for line's and polys, and you may do so as well for other shapes.
>> And in the schema use location_rpt copied from Solr's example schema for
>> starters, but modified as the ref guide & wiki show to use JTS.
>> The ref guide, wiki, and I would guess that book should show how to to a
>> bounding box query using {!bbox} - it's pretty simple.
>>
>> ~ David Smiley
>> Freelance Apache Lucene/Solr Search Consultant/Developer
>> http://www.linkedin.com/in/davidwsmiley
>>
>>
>> On Tue, Aug 19, 2014 at 11:25 AM, Bostic, Alex <alex.bos...@urs.com> wrote:
>>
>>> Hello I'm new to Solr:
>>> I have a SQL Server 2012 database with spatial columns
>>> (points/lines/polys) Do you have any resources to point to for the
>>> following Creating a Solr index of a sql server spatial table
>>> Bounding Box query (intersect) example, possibly with front-end from
>>> GMaps or OpenLayers I'm currently reading Apache Solr Beginner's
>>> Guide and have reviewed
>>> https://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4
>>> I am able to index and query my non spatial data, I am just looking
>>> for some resource that may have some more detail about how to set
>>> everything up.
>>> I can provide more detail if needed.
>>> Thanks
>>>
>>> Alex Bostic
>>> GIS Developer
>>> URS Corporation
>>> 12420 Milestone Center Drive, Suite 150 Germantown, MD 20876 direct
>>> line: 301-820-3287 cell line: 301-213-2639
>>>
>>>
>>>
>>> This e-mail and any attachments contain URS Corporation confidential
>>> information that may be proprietary or privileged. If you receive
>>> this message in error or are not the intended recipient, you should
>>> not retain, distribute, disclose or use any of this information and
>>> you should destroy the e-mail and any attachments or copies.
>>>
>>
>>
>> This e-mail and any attachments contain URS Corporation confidential
>> information that may be proprietary or privileged. If you receive this
>> message in error or are not the intended recipient, you should not retain,
>> distribute, disclose or use any of this information and you should destroy
>> the e-mail and any attachments or copies.
