> What does the core renames itself to, that would probably be the biggest hint.
At 4:01pm 1/14/21, Solr decided on its own to drop the core ipg_report_large_shard1_replica_n1 and to create the core ipg_report_large_shard1_replica_n7 in its place At 4:33am 1/16/21, Solr decided on its own to drop the core ipg_report_large_shard1_replica_n5 (on another node of the same SolrCloud) and to create the core ipg_report_large_shard1_replica_n9 in its place At about 4:10pm 1/26/21, Solr decided on its own to drop this core ipg_report_large_shard1_replica_n9 and to create the core ipg_report_large_shard1_replica_n13 in its place In March, we created a new SolrCloud for the same collection, and reloaded the data At 7:59am 5/12/21, Solr decided on its own to drop the core ipg_report_large_shard1_replica_n1 and to create the core ipg_report_large_shard1_replica_n5 in its place I am attaching an excerpt from solr.log for the most recent problem (with IP addresses and port numbers redacted) Please not that Master/Slave replication breaks when a core is renamed, so this can be a major problem Any ideas? -----Original Message----- From: Alexandre Rafalovitch <arafa...@gmail.com> Sent: Wednesday, May 12, 2021 2:10 PM To: users@solr.apache.org Subject: Re: Cores renamed This is truly a shot in the dark, but is it possible you have something in core.properties file (which is where the core name is for non-Cloud setup)? What does the core renames itself to, that would probably be the biggest hint. Regards, Alex. On Wed, 12 May 2021 at 14:00, Oakley, Craig (NIH/NLM/NCBI) [C] <craig.oak...@nih.gov.invalid> wrote: > > This phenomenon has happened again (this time without any REQUESTRECOVERY) > > Does anyone yet have any explanation of this? > > -----Original Message----- > From: Oakley, Craig (NIH/NLM/NCBI) [C] <craig.oak...@nih.gov.INVALID> > Sent: Thursday, January 28, 2021 10:57 AM > To: solr-u...@lucene.apache.org > Subject: Cores renamed > > We recently have had a few occasions when cores for one specific collection > were renamed (or more likely dropped and recreated, and thus ended up with a > different core name). > > Is this a known phenomenon? Is there any explanation? > > It may be relevant that we just recently started running this SolrCloud on > version 8.5.2, although the collection was created under Solr7.4. Also, this > collection seems to experience some heavy updates such that the non-Leader > replica has trouble keeping up. One of these renames occurred at 4:33am, so I > highly suspect that the rename (or drop and recreate) was done by some > internal Solr thread rather than by any of my coworkers. One other potential > clue is that I can see that /solr/admin/cores?action=REQUESTRECOVERY was > usually run on the new core a moment after it was created. > > Does anyone have any insights?
2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.HttpSolrCall no handler or core retrieved for /ipg_report_large_shard1_replica_n1/replication, follow through... 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : true 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.HttpSolrCall AuthorizationContext : userPrincipal: [org.apache.solr.security.BasicAuthPlugin$BasicAuthUserPrincipal@4c75c463[username=solreplic,pwd=*****]] type: [UNKNOWN], collections: [ipg_report_large_shard1_replica_n1,], Path: [/ipg_report_large_shard1_replica_n1/replication] path : /ipg_report_large_shard1_replica_n1/replication params :null 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Attempting to authorize request to [/ipg_report_large_shard1_replica_n1/replication] of type: [UNKNOWN], associated with collections [[CollectionRequest(ipg_report_large_shard1_replica_n1)]] 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to specific collection [ipg_report_large_shard1_replica_n1] 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to all (*) collections 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Found perm [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] to govern resource [/ipg_report_large_shard1_replica_n1/replication] 2021-05-12 07:28:57.703 DEBUG (qtp2024453272-13760) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Governing permission [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] allows access to role [allgen]; permitting access 2021-05-12 07:28:57.854 INFO (qtp2024453272-13730) [ x:ipg_report_large_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/ipg_report_large/terms/shard1 to Terms{values={core_node4=16}, version=46} 2021-05-12 07:28:57.855 DEBUG (qtp2024453272-13730) [ x:ipg_report_large_shard1_replica_n1] o.a.s.c.ElectionContext Canceling election /collections/ipg_report_large/leader_elect/shard1/election/864691194255292424-core_node2-n_0000000022 2021-05-12 07:28:57.908 INFO (zkCallback-10-thread-85) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:57.908 INFO (zkCallback-10-thread-86) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:57.908 INFO (zkCallback-10-thread-87) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.392 INFO (zkCallback-10-thread-88) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.392 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.SolrDispatchFilter Request to authenticate: org.apache.solr.servlet.SolrDispatchFilter$1@2399f643, domain: #.#.#.#, port: #### 2021-05-12 07:28:59.392 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.SolrDispatchFilter User principal: [principal: subsolr] 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : true 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.HttpSolrCall AuthorizationContext : userPrincipal: [[principal: subsolr]] type: [UNKNOWN], collections: [ipg_report_large_shard1_replica_n1,], Path: [/ipg_report_large_shard1_replica_n1/update] path : /ipg_report_large_shard1_replica_n1/update params :null 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Attempting to authorize request to [/ipg_report_large_shard1_replica_n1/update] of type: [UNKNOWN], associated with collections [[CollectionRequest(ipg_report_large_shard1_replica_n1)]] 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to specific collection [ipg_report_large_shard1_replica_n1] 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to all (*) collections 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Found perm [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] to govern resource [/ipg_report_large_shard1_replica_n1/update] 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Governing permission [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] allows access to role [allgen]; permitting access 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.SolrDispatchFilter Request to authenticate: org.apache.solr.security.PKIAuthenticationPlugin$1@7e7710a, domain: #.#.#.#, port: #### 2021-05-12 07:28:59.396 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.SolrDispatchFilter User principal: [principal: subsolr] 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.HttpSolrCall no handler or core retrieved for /ipg_report_large_shard1_replica_n1/update, follow through... 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : true 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.HttpSolrCall AuthorizationContext : userPrincipal: [[principal: subsolr]] type: [UNKNOWN], collections: [ipg_report_large_shard1_replica_n1,], Path: [/ipg_report_large_shard1_replica_n1/update] path : /ipg_report_large_shard1_replica_n1/update params :null 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Attempting to authorize request to [/ipg_report_large_shard1_replica_n1/update] of type: [UNKNOWN], associated with collections [[CollectionRequest(ipg_report_large_shard1_replica_n1)]] 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to specific collection [ipg_report_large_shard1_replica_n1] 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing collection-aware request, checking perms applicable to all (*) collections 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Found perm [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] to govern resource [/ipg_report_large_shard1_replica_n1/update] 2021-05-12 07:28:59.397 DEBUG (qtp2024453272-13688) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Governing permission [{ "name":"all-core-handlers", "path":"/*", "role":"allgen", "index":11}] allows access to role [allgen]; permitting access 2021-05-12 07:28:59.398 INFO (qtp2024453272-13730) [ x:ipg_report_large_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=ipg_report_large_shard1_replica_n1&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} status=0 QTime=46200 2021-05-12 07:28:59.398 DEBUG (qtp2024453272-13730) [ ] o.a.s.s.HttpSolrCall Closing out SolrRequest: {deleteInstanceDir=true&core=ipg_report_large_shard1_replica_n1&deleteMetricsHistory=true&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2&deleteIndex=true} 2021-05-12 07:28:59.515 INFO (zkCallback-10-thread-87) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.515 INFO (zkCallback-10-thread-85) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.515 INFO (zkCallback-10-thread-88) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.515 INFO (zkCallback-10-thread-86) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.515 INFO (zkCallback-10-thread-89) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ipg_report_large/state.json] for collection [ipg_report_large] has occurred - updating... (live nodes size: [2]) 2021-05-12 07:28:59.522 INFO (OverseerThreadFactory-18-thread-5-processing-n:solrdbprod25.be-md:####_solr) [c:ipg_report_large s:shard1 r:core_node2 ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000052 doesn't exist. Requestor may have disconnected from ZooKeeper 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.SolrDispatchFilter Request to authenticate: org.apache.solr.servlet.SolrDispatchFilter$1@7f6b0ced, domain: 127.0.0.1, port: #### 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.SolrDispatchFilter User principal: org.apache.solr.security.BasicAuthPlugin$BasicAuthUserPrincipal@14712f1e[username=pysolrmon,pwd=*****] 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : true 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.HttpSolrCall AuthorizationContext : userPrincipal: [org.apache.solr.security.BasicAuthPlugin$BasicAuthUserPrincipal@1a3a53d7[username=pysolrmon,pwd=*****]] type: [ADMIN], collections: [], Path: [/admin/cores] path : /admin/cores params :action=STATUS&indexInfo=false&wt=json 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Attempting to authorize request to [/admin/cores] of type: [ADMIN], associated with collections [[]] 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing an ADMIN request, checking admin permissions 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Found perm [{ "name":"corestatus", "path":"/admin/cores", "params":{"action":["REGEX:(?i)STATUS"]}, "role":[ "allgen", "clustatus_role"], "collection":null, "index":5}] to govern resource [/admin/cores] 2021-05-12 07:29:00.590 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Governing permission [{ "name":"corestatus", "path":"/admin/cores", "params":{"action":["REGEX:(?i)STATUS"]}, "role":[ "allgen", "clustatus_role"], "collection":null, "index":5}] allows access to role [clustatus_role]; permitting access 2021-05-12 07:29:00.591 INFO (qtp2024453272-13715) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=json} status=0 QTime=0 2021-05-12 07:29:00.591 DEBUG (qtp2024453272-13715) [ ] o.a.s.s.HttpSolrCall Closing out SolrRequest: {action=STATUS&indexInfo=false&wt=json} 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.SolrDispatchFilter Request to authenticate: org.apache.solr.servlet.SolrDispatchFilter$1@92ee9f6, domain: 127.0.0.1, port: #### 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.SolrDispatchFilter User principal: org.apache.solr.security.BasicAuthPlugin$BasicAuthUserPrincipal@6c5ec89c[username=pysolrmon,pwd=*****] 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : true 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.HttpSolrCall AuthorizationContext : userPrincipal: [org.apache.solr.security.BasicAuthPlugin$BasicAuthUserPrincipal@20fd9f8b[username=pysolrmon,pwd=*****]] type: [ADMIN], collections: [], Path: [/admin/collections] path : /admin/collections params :action=clusterstatus&wt=json 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Attempting to authorize request to [/admin/collections] of type: [ADMIN], associated with collections [[]] 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Authorizing an ADMIN request, checking admin permissions 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Found perm [{ "name":"clustatus", "path":"/admin/collections", "params":{"action":["REGEX:(?i)CLUSTERSTATUS"]}, "role":[ "clustatus_role", "allgen"], "collection":null, "index":4}] to govern resource [/admin/collections] 2021-05-12 07:29:00.592 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.RuleBasedAuthorizationPlugin Governing permission [{ "name":"clustatus", "path":"/admin/collections", "params":{"action":["REGEX:(?i)CLUSTERSTATUS"]}, "role":[ "clustatus_role", "allgen"], "collection":null, "index":4}] allows access to role [clustatus_role]; permitting access 2021-05-12 07:29:00.592 INFO (qtp2024453272-13702) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=clusterstatus&wt=json and sendToOCPQueue=true 2021-05-12 07:29:00.605 INFO (qtp2024453272-13702) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=clusterstatus&wt=json} status=0 QTime=12 2021-05-12 07:29:00.605 DEBUG (qtp2024453272-13702) [ ] o.a.s.s.HttpSolrCall Closing out SolrRequest: {action=clusterstatus&wt=json} 2021-05-12 07:29:01.403 INFO (OverseerCollectionConfigSetProcessor-864691194255292424-solrdbprod25.be-md:####_solr-n_0000000025) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000052 doesn't exist. Requestor may have disconnected from ZooKeeper 2021-05-12 07:29:01.420 INFO (OverseerThreadFactory-18-thread-5-processing-n:solrdbprod25.be-md:####_solr) [c:ipg_report_large s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified solrdbprod25.be-md:####_solr for creating new replica of shard shard1 for collection ipg_report_large 2021-05-12 07:29:01.429 INFO (OverseerThreadFactory-18-thread-5-processing-n:solrdbprod25.be-md:####_solr) [c:ipg_report_large s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command. 2021-05-12 07:29:01.437 INFO (OverseerStateUpdate-864691194255292424-solrdbprod25.be-md:####_solr-n_0000000025) [ ] o.a.s.c.o.SliceMutator createReplica() { "operation":"addreplica", "collection":"ipg_report_large", "shard":"shard1", "core":"ipg_report_large_shard1_replica_n5", "state":"down", "base_url":"http://solrdbprod25.be-md:####/solr", "node_name":"solrdbprod25.be-md:####_solr", "type":"NRT"} 2021-05-12 07:29:01.656 DEBUG (qtp2024453272-13730) [ ] o.a.s.s.SolrDispatchFilter Request to authenticate: org.apache.solr.servlet.SolrDispatchFilter$1@30d12491, domain: #.#.#.#, port: #### 2021-05-12 07:29:01.657 DEBUG (qtp2024453272-13730) [ ] o.a.s.s.SolrDispatchFilter User principal: [principal: $] 2021-05-12 07:29:01.657 DEBUG (qtp2024453272-13730) [ ] o.a.s.s.HttpSolrCall PkiAuthenticationPlugin says authorization required : false 2021-05-12 07:29:01.657 INFO (qtp2024453272-13730) [ x:ipg_report_large_shard1_replica_n5] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=ipg_report_large&name=ipg_report_large_shard1_replica_n5&action=CREATE&collection=ipg_report_large&shard=shard1&wt=javabin&version=2&replicaType=NRT 2021-05-12 07:29:01.663 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.ZkController publishing state=down 2021-05-12 07:29:01.663 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property 2021-05-12 07:29:01.668 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.ZkController Registering watch for collection ipg_report_large 2021-05-12 07:29:01.668 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.ZkController waiting to find shard id in clusterstate for ipg_report_large_shard1_replica_n5 2021-05-12 07:29:01.694 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.2 2021-05-12 07:29:01.725 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.SolrIndexConfig IndexWriter infoStream solr logging is enabled 2021-05-12 07:29:01.806 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.s.IndexSchema [ipg_report_large_shard1_replica_n5] Schema name=example 2021-05-12 07:29:01.999 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.s.IndexSchema Loaded schema example/1.5 with uniqueid field id 2021-05-12 07:29:02.100 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'ipg_report_large_shard1_replica_n5' using configuration from configset ipg_report_large, trusted=true 2021-05-12 07:29:02.101 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.ipg_report_large.shard1.replica_n5' (registry 'solr.core.ipg_report_large.shard1.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff2a664 2021-05-12 07:29:02.101 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrCore [[ipg_report_large_shard1_replica_n5] ] Opening new SolrCore at [/data/solr/solr26/ipg_report_large_shard1_replica_n5], dataDir=[/data/solr/solr26/ipg_report_large_shard1_replica_n5/data/] 2021-05-12 07:29:02.112 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1 commit{dir=NRTCachingDirectory(MMapDirectory@/data/solr/solr26/ipg_report_large_shard1_replica_n5/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@508ea9d2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]} 2021-05-12 07:29:02.112 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 2021-05-12 07:29:02.113 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5 2021-05-12 07:29:02.178 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2021-05-12 07:29:02.178 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 2021-05-12 07:29:02.182 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 2021-05-12 07:29:02.182 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: if uncommitted for 3600000ms; 2021-05-12 07:29:02.185 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1 commit{dir=NRTCachingDirectory(MMapDirectory@/data/solr/solr26/ipg_report_large_shard1_replica_n5/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@508ea9d2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]} 2021-05-12 07:29:02.185 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 2021-05-12 07:29:02.185 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@67f285f5[ipg_report_large_shard1_replica_n5] main] 2021-05-12 07:29:02.189 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/ipg_report_large 2021-05-12 07:29:02.190 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/ipg_report_large 2021-05-12 07:29:02.191 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.h.c.SpellCheckComponent Initializing spell checkers 2021-05-12 07:29:02.191 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01} 2021-05-12 07:29:02.193 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. 2021-05-12 07:29:02.193 INFO (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1699551843128967168 2021-05-12 07:29:02.200 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.ZkController watch zkdir /configs/ipg_report_large 2021-05-12 07:29:02.200 DEBUG (qtp2024453272-13730) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.CoreContainer registering core: ipg_report_large_shard1_replica_n5 2021-05-12 07:29:02.200 INFO (searcherExecutor-19-thread-1-processing-n:solrdbprod25.be-md:####_solr x:ipg_report_large_shard1_replica_n5 c:ipg_report_large s:shard1 r:core_node6) [c:ipg_report_large s:shard1 r:core_node6 x:ipg_report_large_shard1_replica_n5] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@67f285f5[ipg_report_large_shard1_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}