Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?
On Apr 3, 2012, at 10:35 PM, Jamie Johnson wrote: I haven't personally seen this issue but I have been told by another developer that he ran a deleteByQuery(*:*). This deleted the index, but on restart there was information still in the index. Should this be possible? I had planned to setup something to test this locally but wanted to know if anyone is aware of anything like this. It *shouldn't* be possible, but it depends on many things. At this point, I suspect either a bug or its an old build. Towards the end of the recent SolrCloud spurt, Yonik did some work on DBQ and recovery. A build before that could have had issues like this. If you see it on a recent build, I'd def file a JIRA. - Mark Miller lucidimagination.com
Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?
Thanks Mark. The delete by query is a very rare operation for us and I really don't have the liberty to update to current trunk right now. Do you happen to know about when the fix was made so I can see if we are before or after that time? On Wed, Apr 4, 2012 at 10:25 AM, Mark Miller markrmil...@gmail.com wrote: On Apr 3, 2012, at 10:35 PM, Jamie Johnson wrote: I haven't personally seen this issue but I have been told by another developer that he ran a deleteByQuery(*:*). This deleted the index, but on restart there was information still in the index. Should this be possible? I had planned to setup something to test this locally but wanted to know if anyone is aware of anything like this. It *shouldn't* be possible, but it depends on many things. At this point, I suspect either a bug or its an old build. Towards the end of the recent SolrCloud spurt, Yonik did some work on DBQ and recovery. A build before that could have had issues like this. If you see it on a recent build, I'd def file a JIRA. - Mark Miller lucidimagination.com
Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?
On Wed, Apr 4, 2012 at 3:04 PM, Jamie Johnson jej2...@gmail.com wrote: Thanks Mark. The delete by query is a very rare operation for us and I really don't have the liberty to update to current trunk right now. Do you happen to know about when the fix was made so I can see if we are before or after that time? Not difinitive, but a grep of svn log in solr/core shows: r1295665 | yonik | 2012-03-01 11:41:54 -0500 (Thu, 01 Mar 2012) | 1 line cloud: fix distributed deadlock w/ deleteByQuery r1243773 | yonik | 2012-02-13 22:00:22 -0500 (Mon, 13 Feb 2012) | 1 line dbq: fix param rename r1243768 | yonik | 2012-02-13 21:45:41 -0500 (Mon, 13 Feb 2012) | 1 line solrcloud: send deleteByQuery to all shard leaders to version and forward to replicas -Yonik lucenerevolution.com - Lucene/Solr Open Source Search Conference. Boston May 7-10
Re: solrcloud is deleteByQuery stored in transactions and forwarded like other operations?
My snapshot was taken 2/27. That would seem to indicate that the deleteByQuery should be getting versioned, I am not sure if the other issues that were resolved would change the operation. I'll keep an eye on it and if it pops up I'll try to push the update. Thanks. On Wed, Apr 4, 2012 at 3:12 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Wed, Apr 4, 2012 at 3:04 PM, Jamie Johnson jej2...@gmail.com wrote: Thanks Mark. The delete by query is a very rare operation for us and I really don't have the liberty to update to current trunk right now. Do you happen to know about when the fix was made so I can see if we are before or after that time? Not difinitive, but a grep of svn log in solr/core shows: r1295665 | yonik | 2012-03-01 11:41:54 -0500 (Thu, 01 Mar 2012) | 1 line cloud: fix distributed deadlock w/ deleteByQuery r1243773 | yonik | 2012-02-13 22:00:22 -0500 (Mon, 13 Feb 2012) | 1 line dbq: fix param rename r1243768 | yonik | 2012-02-13 21:45:41 -0500 (Mon, 13 Feb 2012) | 1 line solrcloud: send deleteByQuery to all shard leaders to version and forward to replicas -Yonik lucenerevolution.com - Lucene/Solr Open Source Search Conference. Boston May 7-10
solrcloud is deleteByQuery stored in transactions and forwarded like other operations?
I haven't personally seen this issue but I have been told by another developer that he ran a deleteByQuery(*:*). This deleted the index, but on restart there was information still in the index. Should this be possible? I had planned to setup something to test this locally but wanted to know if anyone is aware of anything like this.