Nicholas Stuart created SOLR-6898:
-------------------------------------
Summary: Delete by ID not working in solrcloud setup
Key: SOLR-6898
URL: https://issues.apache.org/jira/browse/SOLR-6898
Project: Solr
Issue Type: Bug
Affects Versions: 4.10.2
Reporter: Nicholas Stuart
Issuing delete by id commands doesn't seem to do anything. I see the messages
go through, and everything is logged like it should work, but nothing is
deleted. Here are the solr logs for the delete by id commands:
272618272 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[584
(-1488860136778760192)]} 0 0
272618275 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[591
(-1488860136781905920)]} 0 0
272618283 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[593 (-1488860136789245952)]} 0 1
272618291 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[778 (-1488860136798683136)]} 0 0
272618298 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[791 (-1488860136806023168)]} 0 0
272618306 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[1006 (-1488860136814411776)]} 0 0
272618313 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[1246 (-1488860136821751808)]} 0 1
272618315 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[1334
(-1488860136823848960)]} 0 0
272618319 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[1449 (-1488860136828043264)]} 0 0
272618325 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[1491 (-1488860136834334720)]} 0 0
272618330 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[1895 (-1488860136839577600)]} 0 0
272618336 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[2016 (-1488860136845869056)]} 0 0
272618340 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2178
(-1488860136850063360)]} 0 0
272618342 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2179
(-1488860136852160512)]} 0 0
272618347 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[2220 (-1488860136857403392)]} 0 0
272618351 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2494
(-1488860136861597696)]} 0 0
272618354 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2638
(-1488860136864743424)]} 0 0
272618357 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[2647 (-1488860136867889152)]} 0 0
272618361 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[2831 (-1488860136872083456)]} 0 0
272618364 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2934
(-1488860136875229184)]} 0 0
272618366 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[2942
(-1488860136877326336)]} 0 0
272618368 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3021
(-1488860136879423488)]} 0 0
272618370 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3063
(-1488860136881520640)]} 0 0
272618376 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[3099 (-1488860136887812096)]} 0 0
272618382 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[3114 (-1488860136894103552)]} 0 0
272618389 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[3116 (-1488860136901443584)]} 0 1
272618395 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[3131 (-1488860136907735040)]} 0 0
272618402 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[3171 (-1488860136915075072)]} 0 0
272618406 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3244
(-1488860136919269376)]} 0 0
272618410 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[3589 (-1488860136923463680)]} 0 0
272618413 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3636
(-1488860136926609408)]} 0 0
272618415 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3679
(-1488860136928706560)]} 0 0
272618417 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3937
(-1488860136930803712)]} 0 0
272618419 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[3949
(-1488860136932900864)]} 0 0
272618424 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4117 (-1488860136938143744)]} 0 0
272618430 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4337 (-1488860136944435200)]} 0 0
272618436 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4340 (-1488860136949678080)]} 0 1
272618441 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4363 (-1488860136955969536)]} 0 0
272618446 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4369 (-1488860136961212416)]} 0 0
272618452 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4375 (-1488860136967503872)]} 0 0
272618458 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4522 (-1488860136973795328)]} 0 0
272618465 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4556 (-1488860136981135360)]} 0 0
272618469 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[4562
(-1488860136984281088)]} 0 1
272618472 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4569 (-1488860136988475392)]} 0 0
272618478 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4587 (-1488860136994766848)]} 0 0
272618482 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[4677
(-1488860136998961152)]} 0 0
272618485 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4688 (-1488860137002106880)]} 0 0
272618491 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[4862 (-1488860137008398336)]} 0 0
272618496 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[4866 (-1488860137013641216)]} 0 0
272618499 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[4944
(-1488860137016786944)]} 0 0
272618501 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5038
(-1488860137018884096)]} 0 0
272618503 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5066
(-1488860137020981248)]} 0 0
272618507 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[5118 (-1488860137025175552)]} 0 0
272618509 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5136
(-1488860137027272704)]} 0 0
272618513 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[5137 (-1488860137031467008)]} 0 0
272618516 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5366
(-1488860137034612736)]} 0 0
272618518 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5486
(-1488860137036709888)]} 0 0
272618523 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[5513 (-1488860137041952768)]} 0 0
272618527 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[5946
(-1488860137046147072)]} 0 0
272618531 [qtp2032251042-321] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.6.228:8983/solr/products/&wt=javabin&version=2}
{delete=[6347 (-1488860137050341376)]} 0 0
272618534 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=javabin&version=2} {delete=[6389
(-1488860137053487104)]} 0 0
272618539 [qtp2032251042-14] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update
params={update.distrib=TOLEADER&distrib.from=http://10.0.4.205:8983/solr/products/&wt=javabin&version=2}
{delete=[6392 (-1488860137058729984)]} 0 0
272619272 [commitScheduler-13-thread-1] INFO
org.apache.solr.update.UpdateHandler ? start
commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
272619273 [commitScheduler-13-thread-1] INFO org.apache.solr.core.SolrCore ?
SolrIndexSearcher has not changed - not re-opening:
org.apache.solr.search.SolrIndexSearcher
272619273 [commitScheduler-13-thread-1] INFO
org.apache.solr.update.UpdateHandler ? end_commit_flush
272633272 [commitScheduler-12-thread-1] INFO
org.apache.solr.update.UpdateHandler ? start
commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
272633273 [commitScheduler-12-thread-1] INFO
org.apache.solr.update.UpdateHandler ? No uncommitted changes. Skipping
IW.commit.
272633273 [commitScheduler-12-thread-1] INFO
org.apache.solr.update.UpdateHandler ? end_commit_flush
Now, if I delete by query, everything is fine and documents are removed. Here
are the logs that came out of that:
272993646 [qtp2032251042-12] INFO
org.apache.solr.update.processor.LogUpdateProcessor ? [products] webapp=/solr
path=/update params={wt=json} {deleteByQuery=id:584
(-1488860530367004672),deleteByQuery=id:584
(-1488860530369101824),deleteByQuery=id:593 (-148886053036
9101825),deleteByQuery=id:778 (-1488860530370150400),deleteByQuery=id:791
(-1488860530370150401),deleteByQuery=id:1006
(-1488860530371198976),deleteByQuery=id:1246
(-1488860530371198977),deleteByQuery=id:1334
(-1488860530372247552),deleteByQuery=id:1449 (-148886053037
2247553),deleteByQuery=id:1491 (-1488860530375393280)} 0 19
The delete by id commands were generated by the following camel route:
from("direct:search:removeDeleted")
.routeId("search:removeDeleted")
.beanRef("deletedProductsFinder", "findDeleted")
.setHeader(SolrConstants.OPERATION,
constant(SolrConstants.OPERATION_DELETE_BY_ID))
.split().body()
.recipientList(method("solrServerFinder",
"getServerEndpoint"));
The solr server list is dynamically looked up, and the findDeleted method just
returns a list of Integer ids that should be deleted.
The delete by query was manually generated and run through the solr admin.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
