Re: Solr cloud replica nodes missing some documents
Any pointer guys. From: Sanjay Lokhande/India/IBM To: solr-user@lucene.apache.org Date: 08/18/2017 02:12 PM Subject:Solr cloud replica nodes missing some documents Hello guys, I am having 5 nodes solr cloud setup with single shard. The solr version is 5.2.1. server1 (http://146.XXX.com:4001/solr/contracts_shard1_replica4)is the leader. A document with id '43e14a86cbdd422880cac22d9a15d3c0' was not replicated 3 nodes. Log shows that the "{add=[43e14a86cbdd422880cac22d9a15d3c0 (1573510697298427904)]}" request is received only by leader and server5 node. The server2, server3 & server4 node did not receive the request and hence the document is missing in these nodes. Search "43e14a86cbdd422880cac22d9a15d3c0 " C:\solrIssue\solr_server1.log INFO - 2017-07-21 05:54:59.853; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.853; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:59:23.845; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {add=[43e14a86cbdd422880cac22d9a15d3c0 (1573510697298427904)]} 0 26582 C:\solrIssue\solr_server2\solr.log.1 INFO - 2017-07-21 05:54:59.595; [contracts shard1 core_node4 contracts_shard1_replica5] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica5] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.595; [contracts shard1 core_node4 contracts_shard1_replica5] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica5] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... C:\solrIssue\solr_server3.log INFO - 2017-07-21 05:54:59.844; [contracts shard1 core_node1 contracts_shard1_replica3] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica3] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.844; [contracts shard1 core_node1 contracts_shard1_replica3] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica3] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... C:\solrIssue\solr_server4\solr.log.1 INFO - 2017-07-21 05:54:59.734; [contracts shard1 core_node3 contracts_shard1_replica1] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica1] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.734; [contracts shard1 core_node3 contracts_shard1_replica1] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica1] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http:/
Solr cloud replica nodes missing some documents
Hello guys, I am having 5 nodes solr cloud setup with single shard. The solr version is 5.2.1. server1 (http://146.XXX.com:4001/solr/contracts_shard1_replica4)is the leader. A document with id '43e14a86cbdd422880cac22d9a15d3c0' was not replicated 3 nodes. Log shows that the "{add=[43e14a86cbdd422880cac22d9a15d3c0 (1573510697298427904)]}" request is received only by leader and server5 node. The server2, server3 & server4 node did not receive the request and hence the document is missing in these nodes. Search "43e14a86cbdd422880cac22d9a15d3c0 " C:\solrIssue\solr_server1.log INFO - 2017-07-21 05:54:59.853; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.853; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:59:23.845; [contracts shard1 core_node2 contracts_shard1_replica4] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica4] webapp=/solr path=/update params= {wt=javabin=2} {add=[43e14a86cbdd422880cac22d9a15d3c0 (1573510697298427904)]} 0 26582 C:\solrIssue\solr_server2\solr.log.1 INFO - 2017-07-21 05:54:59.595; [contracts shard1 core_node4 contracts_shard1_replica5] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica5] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.595; [contracts shard1 core_node4 contracts_shard1_replica5] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica5] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... C:\solrIssue\solr_server3.log INFO - 2017-07-21 05:54:59.844; [contracts shard1 core_node1 contracts_shard1_replica3] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica3] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.844; [contracts shard1 core_node1 contracts_shard1_replica3] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica3] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... C:\solrIssue\solr_server4\solr.log.1 INFO - 2017-07-21 05:54:59.734; [contracts shard1 core_node3 contracts_shard1_replica1] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica1] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0 a0af8cb24ef94d25b9691eee1f7024ca 8ad... INFO - 2017-07-21 05:54:59.734; [contracts shard1 core_node3 contracts_shard1_replica1] org.apache.solr.update.processor.LogUpdateProcessor; [contracts_shard1_replica1] webapp=/solr path=/update params= {update.distrib=FROMLEADER&_version_=-1573510446380482560=http://146.XXX.com:4001/solr/contracts_shard1_replica4/=javabin=2} {deleteByQuery=id:(9467353f398448788c261aa347d75b8b 93332ab7f7ff4141a371713871ab65ad 8568e0eab8364bfc89c876aadfa01022 43e14a86cbdd422880cac22d9a15d3c0