Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?

2012-04-04 Thread Mark Miller

On Apr 3, 2012, at 10:35 PM, Jamie Johnson wrote:

 I haven't personally seen this issue but I have been told by another
 developer that he ran a deleteByQuery(*:*).  This deleted the index,
 but on restart there was information still in the index.  Should this
 be possible?  I had planned to setup something to test this locally
 but wanted to know if anyone is aware of anything like this.


It *shouldn't* be possible, but it depends on many things. At this point, I 
suspect either a bug or its an old build. Towards the end of the recent 
SolrCloud spurt, Yonik did some work on DBQ and recovery. A build before that 
could have had issues like this. If you see it on a recent build, I'd def file 
a JIRA.

- Mark Miller
lucidimagination.com













Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?

2012-04-04 Thread Jamie Johnson
Thanks Mark.  The delete by query is a very rare operation for us and
I really don't have the liberty to update to current trunk right now.
Do you happen to know about when the fix was made so I can see if we
are before or after that time?

On Wed, Apr 4, 2012 at 10:25 AM, Mark Miller markrmil...@gmail.com wrote:

 On Apr 3, 2012, at 10:35 PM, Jamie Johnson wrote:

 I haven't personally seen this issue but I have been told by another
 developer that he ran a deleteByQuery(*:*).  This deleted the index,
 but on restart there was information still in the index.  Should this
 be possible?  I had planned to setup something to test this locally
 but wanted to know if anyone is aware of anything like this.


 It *shouldn't* be possible, but it depends on many things. At this point, I 
 suspect either a bug or its an old build. Towards the end of the recent 
 SolrCloud spurt, Yonik did some work on DBQ and recovery. A build before that 
 could have had issues like this. If you see it on a recent build, I'd def 
 file a JIRA.

 - Mark Miller
 lucidimagination.com













Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?

2012-04-04 Thread Yonik Seeley
On Wed, Apr 4, 2012 at 3:04 PM, Jamie Johnson jej2...@gmail.com wrote:
 Thanks Mark.  The delete by query is a very rare operation for us and
 I really don't have the liberty to update to current trunk right now.
 Do you happen to know about when the fix was made so I can see if we
 are before or after that time?

Not difinitive, but a grep of svn log in solr/core shows:

r1295665 | yonik | 2012-03-01 11:41:54 -0500 (Thu, 01 Mar 2012) | 1 line
cloud: fix distributed deadlock w/ deleteByQuery

r1243773 | yonik | 2012-02-13 22:00:22 -0500 (Mon, 13 Feb 2012) | 1 line
dbq: fix param rename

r1243768 | yonik | 2012-02-13 21:45:41 -0500 (Mon, 13 Feb 2012) | 1 line
solrcloud: send deleteByQuery to all shard leaders to version and
forward to replicas


-Yonik
lucenerevolution.com - Lucene/Solr Open Source Search Conference.
Boston May 7-10


Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?

2012-04-04 Thread Jamie Johnson
My snapshot was taken 2/27.  That would seem to indicate that the
deleteByQuery should be getting versioned, I am not sure if the other
issues that were resolved would change the operation.  I'll keep an
eye on it and if it pops up I'll try to push the update.  Thanks.

On Wed, Apr 4, 2012 at 3:12 PM, Yonik Seeley yo...@lucidimagination.com wrote:
 On Wed, Apr 4, 2012 at 3:04 PM, Jamie Johnson jej2...@gmail.com wrote:
 Thanks Mark.  The delete by query is a very rare operation for us and
 I really don't have the liberty to update to current trunk right now.
 Do you happen to know about when the fix was made so I can see if we
 are before or after that time?

 Not difinitive, but a grep of svn log in solr/core shows:

 r1295665 | yonik | 2012-03-01 11:41:54 -0500 (Thu, 01 Mar 2012) | 1 line
 cloud: fix distributed deadlock w/ deleteByQuery

 r1243773 | yonik | 2012-02-13 22:00:22 -0500 (Mon, 13 Feb 2012) | 1 line
 dbq: fix param rename

 r1243768 | yonik | 2012-02-13 21:45:41 -0500 (Mon, 13 Feb 2012) | 1 line
 solrcloud: send deleteByQuery to all shard leaders to version and
 forward to replicas


 -Yonik
 lucenerevolution.com - Lucene/Solr Open Source Search Conference.
 Boston May 7-10


solrcloud is deleteByQuery stored in transactions and forwarded like other operations?

2012-04-03 Thread Jamie Johnson
I haven't personally seen this issue but I have been told by another
developer that he ran a deleteByQuery(*:*).  This deleted the index,
but on restart there was information still in the index.  Should this
be possible?  I had planned to setup something to test this locally
but wanted to know if anyone is aware of anything like this.