Re: Do all SolrCloud nodes communicate with the database when indexing a collection?

2016-02-18 Thread Colin Freas
s designed for multi-threaded indexing and I'd highly recommend >you to use SolrJ to speed up your indexing. Yes, that would involve >writing >some code but it would speed things up considerably. > > >On Wed, Feb 17, 2016 at 10:51 PM, Colin Freas <cfr...@stsci.edu> wrote:

Do all SolrCloud nodes communicate with the database when indexing a collection?

2016-02-17 Thread Colin Freas
I just set up a SolrCloud instance with 2 Solr nodes & another machine running zookeeper. I’ve imported 200M records from a SQL Server database, and those records are split nicely between the 2 nodes. Everything seems ok. I did the data import via the admin ui. It took not quite 8 hours,

Re: Using Solr's spatial functionality for astronomical catalog

2016-02-16 Thread Colin Freas
ceRpt}=0,0=5 ... return appropriate subsets. Doh, Colin On 2/16/16, 3:31 AM, "Colin Freas" <cfr...@stsci.edu> wrote: > >David, thanks for getting back to me. SpatialRecursivePrefixTreeFieldType >seems to be what I need, and the default search seems appropria

Re: Using Solr's spatial functionality for astronomical catalog

2016-02-16 Thread Colin Freas
I am >currently >working on adapting the Spatial4j library to work with Lucene's Geo3D (aka >spatial 3d) which has both a spherical model and an ellipsoidal model, >which can be configured with the characteristics specified by WGS84. If >you are super-eager to get this yourse

Using Solr's spatial functionality for astronomical catalog

2016-01-19 Thread Colin Freas
Greetings! I have recently stood up an instance of Solr, indexing a catalog of about 100M records representing points on the celestial sphere. All of the fields are strings, floats, and non-spatial types. I’d like to convert the positional data to an appropriate spatial point data type