Please see: http://lucene.472066.n3.nabble.com/Attention-Solr-4-0-SolrCloud-users-td4024998.html
- Mark On Jan 7, 2013, at 9:16 PM, davers <dboych...@improvementdirect.com> wrote: > I have a SolrCloud as seen here: http://d.pr/i/ya86 > > When I stop solr-shard-1 solr-shard-4 should become the new leader. Instead > it does not. Here is the output from the logs. > > INFO: A cluster state change has occurred - updating... > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > runLeaderProcess > INFO: Running the leader process. > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > shouldIBeLeader > INFO: Checking if I should try and be the leader. > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > shouldIBeLeader > INFO: My last published State was Active, it's okay to be the leader. > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > runLeaderProcess > INFO: I may be the new leader - try and sync > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy close > WARNING: Stopping recovery for > zkNodeName=solr-shard-4.sys.id.build.com:8080_solr_productindexcore=productindex > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.SyncStrategy sync > INFO: Sync replicas to > http://solr-shard-4.sys.id.build.com:8080/solr/productindex/ > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync sync > INFO: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr START > replicas=[http://solr-shard-1.sys.id.build.com:8080/solr/productindex/] > nUpdates=100 > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync handleResponse > WARNING: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr exception talking to > http://solr-shard-1.sys.id.build.com:8080/solr/productindex/, failed > org.apache.solr.client.solrj.SolrServerException: IOException occured when > talking to server at: > http://solr-shard-1.sys.id.build.com:8080/solr/productindex > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:413) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:166) > at > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:133) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:722) > Caused by: java.net.SocketException: Connection reset > at java.net.SocketInputStream.read(SocketInputStream.java:189) > at java.net.SocketInputStream.read(SocketInputStream.java:121) > at > org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149) > at > org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111) > at > org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264) > at > org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98) > at > org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) > at > org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) > at > org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) > at > org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) > at > org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) > at > org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) > at > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 11 more > > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync sync > INFO: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr DONE. sync failed > Jan 07, 2013 6:11:54 PM org.apache.solr.common.SolrException log > SEVERE: Sync Failed > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > rejoinLeaderElection > INFO: There is a better leader candidate than us - going back into recovery > Jan 07, 2013 6:11:54 PM org.apache.solr.update.DefaultSolrCoreState > doRecovery > INFO: Running recovery - first canceling any ongoing recovery > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy run > INFO: Starting recovery process. core=productindex > recoveringAfterStartup=false > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: Attempting to PeerSync from > http://solr-shard-1.sys.id.build.com:8080/solr/productindex/ > core=productindex - recoveringAfterStartup=false > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync sync > INFO: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr START > replicas=[http://solr-shard-1.sys.id.build.com:8080/solr/productindex/] > nUpdates=100 > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > runLeaderProcess > INFO: Running the leader process. > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync handleResponse > WARNING: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr exception talking to > http://solr-shard-1.sys.id.build.com:8080/solr/productindex/, failed > org.apache.solr.client.solrj.SolrServerException: Server refused connection > at: http://solr-shard-1.sys.id.build.com:8080/solr/productindex > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:406) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:166) > at > org.apache.solr.handler.component.HttpShardHandler$1.call(HttpShardHandler.java:133) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:722) > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to > http://solr-shard-1.sys.id.build.com:8080 refused > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158) > at > org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) > at > org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) > at > org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 11 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) > at java.net.Socket.connect(Socket.java:579) > at > org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) > ... 19 more > > Jan 07, 2013 6:11:54 PM org.apache.solr.update.PeerSync sync > INFO: PeerSync: core=productindex > url=http://solr-shard-4.sys.id.build.com:8080/solr DONE. sync failed > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: PeerSync Recovery was not successful - trying replication. > core=productindex > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: Starting Replication Recovery. core=productindex > Jan 07, 2013 6:11:54 PM org.apache.solr.client.solrj.impl.HttpClientUtil > createClient > INFO: Creating new http client, > config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=179999 > Jan 07, 2013 6:11:54 PM org.apache.solr.common.SolrException log > SEVERE: Error while trying to recover. > core=productindex:org.apache.solr.client.solrj.SolrServerException: Server > refused connection at: http://solr-shard-1.sys.id.build.com:8080/solr > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:406) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:199) > at > org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:388) > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:220) > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to > http://solr-shard-1.sys.id.build.com:8080 refused > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158) > at > org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) > at > org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) > at > org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 4 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) > at java.net.Socket.connect(Socket.java:579) > at > org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) > ... 12 more > > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > SEVERE: Recovery failed - trying again... core=productindex > Jan 07, 2013 6:11:54 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=179496 > Jan 07, 2013 6:11:55 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=178993 > Jan 07, 2013 6:11:55 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=178489 > Jan 07, 2013 6:11:56 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=177986 > Jan 07, 2013 6:11:56 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: Starting Replication Recovery. core=productindex > Jan 07, 2013 6:11:56 PM org.apache.solr.client.solrj.impl.HttpClientUtil > createClient > INFO: Creating new http client, > config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false > Jan 07, 2013 6:11:56 PM org.apache.solr.common.SolrException log > SEVERE: Error while trying to recover. > core=productindex:org.apache.solr.client.solrj.SolrServerException: Server > refused connection at: http://solr-shard-1.sys.id.build.com:8080/solr > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:406) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:199) > at > org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:388) > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:220) > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to > http://solr-shard-1.sys.id.build.com:8080 refused > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158) > at > org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) > at > org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) > at > org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 4 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) > at java.net.Socket.connect(Socket.java:579) > at > org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) > ... 12 more > > Jan 07, 2013 6:11:56 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > SEVERE: Recovery failed - trying again... core=productindex > Jan 07, 2013 6:11:56 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=177483 > Jan 07, 2013 6:11:57 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=176979 > Jan 07, 2013 6:11:57 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=176476 > Jan 07, 2013 6:11:58 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=175973 > Jan 07, 2013 6:11:58 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=175470 > Jan 07, 2013 6:11:59 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=174966 > Jan 07, 2013 6:11:59 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=174462 > Jan 07, 2013 6:12:00 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=173959 > Jan 07, 2013 6:12:00 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: Starting Replication Recovery. core=productindex > Jan 07, 2013 6:12:00 PM org.apache.solr.client.solrj.impl.HttpClientUtil > createClient > INFO: Creating new http client, > config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false > Jan 07, 2013 6:12:00 PM org.apache.solr.common.SolrException log > SEVERE: Error while trying to recover. > core=productindex:org.apache.solr.client.solrj.SolrServerException: Server > refused connection at: http://solr-shard-1.sys.id.build.com:8080/solr > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:406) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:199) > at > org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:388) > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:220) > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to > http://solr-shard-1.sys.id.build.com:8080 refused > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158) > at > org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) > at > org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) > at > org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 4 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) > at java.net.Socket.connect(Socket.java:579) > at > org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) > ... 12 more > > Jan 07, 2013 6:12:00 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > SEVERE: Recovery failed - trying again... core=productindex > Jan 07, 2013 6:12:00 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=173456 > Jan 07, 2013 6:12:01 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=172952 > Jan 07, 2013 6:12:01 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=172449 > Jan 07, 2013 6:12:02 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=171946 > Jan 07, 2013 6:12:02 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=171443 > Jan 07, 2013 6:12:03 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=170939 > Jan 07, 2013 6:12:03 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=170436 > Jan 07, 2013 6:12:04 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=169933 > Jan 07, 2013 6:12:04 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=169430 > Jan 07, 2013 6:12:05 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=168927 > Jan 07, 2013 6:12:05 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=168423 > Jan 07, 2013 6:12:06 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=167920 > Jan 07, 2013 6:12:07 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=167416 > Jan 07, 2013 6:12:07 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=166913 > Jan 07, 2013 6:12:08 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=166410 > Jan 07, 2013 6:12:08 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > INFO: Starting Replication Recovery. core=productindex > Jan 07, 2013 6:12:08 PM org.apache.solr.client.solrj.impl.HttpClientUtil > createClient > INFO: Creating new http client, > config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false > Jan 07, 2013 6:12:08 PM org.apache.solr.common.SolrException log > SEVERE: Error while trying to recover. > core=productindex:org.apache.solr.client.solrj.SolrServerException: Server > refused connection at: http://solr-shard-1.sys.id.build.com:8080/solr > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:406) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181) > at > org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:199) > at > org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:388) > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:220) > Caused by: org.apache.http.conn.HttpHostConnectException: Connection to > http://solr-shard-1.sys.id.build.com:8080 refused > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158) > at > org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150) > at > org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121) > at > org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) > at > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:352) > ... 4 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391) > at java.net.Socket.connect(Socket.java:579) > at > org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123) > at > org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148) > ... 12 more > > Jan 07, 2013 6:12:08 PM org.apache.solr.cloud.RecoveryStrategy doRecovery > SEVERE: Recovery failed - trying again... core=productindex > Jan 07, 2013 6:12:08 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=165907 > Jan 07, 2013 6:12:09 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=165404 > Jan 07, 2013 6:12:09 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=164901 > Jan 07, 2013 6:12:10 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=164397 > Jan 07, 2013 6:12:10 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=163894 > Jan 07, 2013 6:12:11 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=163390 > Jan 07, 2013 6:12:11 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=162887 > Jan 07, 2013 6:12:12 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=162383 > Jan 07, 2013 6:12:12 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=161880 > Jan 07, 2013 6:12:13 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=161377 > Jan 07, 2013 6:12:13 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=160874 > Jan 07, 2013 6:12:14 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=160370 > Jan 07, 2013 6:12:14 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=159867 > Jan 07, 2013 6:12:15 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=159363 > Jan 07, 2013 6:12:15 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=158860 > Jan 07, 2013 6:12:16 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > INFO: Waiting until we see more replicas up: total=2 found=1 > timeoutin=158357 > Jan 07, 2013 6:12:16 PM org.apache.solr.cloud.ShardLeaderElectionContext > waitForReplicasToComeUp > > When I then restart solr-shard-1 this is what SolrCloud is reporting: > http://d.pr/i/zRTQ > > I then have to restart solr-shard-1 and solr-shard-4 before everything is > back to normal. > > Any ideas why leader election is failing? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-Cloud-not-electing-leader-properly-tp4031439.html > Sent from the Solr - User mailing list archive at Nabble.com.
