When I first read this, I thought you meant that you'd lost all Solr 
indexes for _all_ Authorizables or _all_ Content. But you just mean that 
_individual_ records are missing from the index, right?

If so, yes, I've seen the behavior plenty of times, and the cause is 
over-panicky error handling in our Solr integration code. Virtually all 
Solr indexing is done via a SparseMapContent event listener which places 
the event on an indexing queue manager, which in turn delivers the event 
to an index handler. The handlers tend to send any exceptions on up the 
stack, and the queue managers have tended to drop the event like a hot 
potato, never picking it back up again. When that happens, the new or 
replaced data isn't indexed. (Or, on events which should have led to 
deletion, the obsolete index continues to hang around.) See:

https://jira.sakaiproject.org/browse/SOLR-36
http://collab.sakaiproject.org/pipermail/oae-dev/2012-January/001061.html

As I and others add bug reports and fixes, indexing should get more 
stable over time. That said, periodic full re-indexing is likely to 
remain part of dev-ops life for the foreseeable future.

Best,
Ray

On 4/20/12 3:30 PM, Lance Speelmon wrote:
> For one of our production OAE implementations we have seen solr data go 
> missing for both authorizables and content.  This is on a 1.1-ish code base.
>
> 1) Is anyone else seeing this kind of behavior?
>
> 2) Any suggestions on tracking down root cause?
>
> FYI: Nothing too weird is showing up in app server logs and solr logs are 
> quiet. (i.e. no evidence of a solr rollback).
>
> We have worked around the issue by either:
>
> A) solr reindex.
>
> B) curl update the individual item to trigger an index.
>
> This is happening with enough regularity that we need to get to the bottom of 
> it ASAP.  Thanks!  L
>
> _______________________________________________
> oae-production mailing list
> [email protected]
> http://collab.sakaiproject.org/mailman/listinfo/oae-production
>

_______________________________________________
oae-dev mailing list
[email protected]
http://collab.sakaiproject.org/mailman/listinfo/oae-dev

Reply via email to