Re: Confirm Solr index corruption

2015-02-18 Thread Otis Gospodnetic
Hi,

It sounds like Solr simply could not index some docs.  The index is not
corrupt, it's just that indexing was failing while disk was full.  You'll
need to re-send/re-add/re-index the missing docs (or simply all of them if
you don't know which ones are missing).

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/


On Wed, Feb 18, 2015 at 1:52 AM, Thomas Mathew 
wrote:

> Hi All,
>
> I use Solr 4.4.0 in a master-slave configuration. Last week, the master
> server ran out of disk (logs got too big too quick due to a bug in our
> system). Because of this, we weren't able to add new docs to an index. The
> first thing I did was to delete a few old log files to free up disk space
> (later I moved the other logs to free up disk). The index is working fine
> even after this fiasco.
>
> The next day, a colleague of mine pointed out that we may be missing a few
> documents in the index. I suspect the above scenario may have broken the
> index. I ran the checkIndex against this index. It didn't mention of any
> corruption though.
>
> Right now, the index has about 25k docs. I haven't optimized this index in
> a while, and there are about 4000 deleted-docs. How can I confirm if we
> lost anything? If we've lost docs, is there a way to recover it?
>
> Thanks in advance!!
>
> Regards
> Thomas
>


Confirm Solr index corruption

2015-02-17 Thread Thomas Mathew
Hi All,

I use Solr 4.4.0 in a master-slave configuration. Last week, the master
server ran out of disk (logs got too big too quick due to a bug in our
system). Because of this, we weren't able to add new docs to an index. The
first thing I did was to delete a few old log files to free up disk space
(later I moved the other logs to free up disk). The index is working fine
even after this fiasco.

The next day, a colleague of mine pointed out that we may be missing a few
documents in the index. I suspect the above scenario may have broken the
index. I ran the checkIndex against this index. It didn't mention of any
corruption though.

Right now, the index has about 25k docs. I haven't optimized this index in
a while, and there are about 4000 deleted-docs. How can I confirm if we
lost anything? If we've lost docs, is there a way to recover it?

Thanks in advance!!

Regards
Thomas