dataimport handler

2013-05-07 Thread Eric Myers
In the  data import handler  I have multiple entities.  Each one
generates a date in the
dataimport.properties i.e. entityname.last_index_time.

How do I reference the specific entity time in my delta queries?

Thanks

Eric


Strange Error

2013-03-05 Thread Eric Myers
|

I am getting the following error when I try to use a stats.facet for a date 
field. Anyone know how to fix this?

str name=msgInvalid Date String:' #1;#0;#0;#0;#5;oT$#0;'/str

||I have checked the values of the date and they are all fine.  
I am not sure where this is coming from. 

The really odd thing is that this worked fine, and then all of a sudden went 
crazy. I tried both date and tdate (it worked with date for a while).

|the query string
http://hidden/solr/activity/select?q=*%3A*wt=xmlindent=truestats=truestats.field=amountstats.facet=date_facet

field data
date name=date_facet2013-03-05T05:00:00Z/date

schema 
   field name=date_facet type=date indexed=true stored=true /

fieldType name=date class=solr.TrieDateField precisionStep=0 
positionIncrementGap=0/
fieldType name=tdate class=solr.TrieDateField precisionStep=6 
positionIncrementGap=0/



dataimporthandler large dataset

2011-08-12 Thread Eric Myers
Recently started looking into solr to solve a problem created before my
time.  We have a dataset consisting of 390,000,000+ records that had a
search written for it using a simple query.  The problem is that the
dataset needs additional indices to keep operating.  The DBA says no go,
too large a dataset. 

I came to the very quick conclusion that they needed a search engine,
preferably one that can return some data. 

My problem lies in the initial index creation.  Using the
DataImportHandler with JDBC to import 390m records will, I am guessing
take far longer than I would like, and use up quite a few resources. 

Is there any way to chunk this data, with the DataImportHandler?  If not
I will just write some code to handle the initial import.

Thanks

-- 
Eric Myers