Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.0/133/
1 tests failed. FAILED: org.apache.solr.cloud.TestStressInPlaceUpdates.stressTest Error Message: Captured an uncaught exception in thread: Thread[id=20282, name=WRITER2, state=RUNNABLE, group=TGRP-TestStressInPlaceUpdates] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=20282, name=WRITER2, state=RUNNABLE, group=TGRP-TestStressInPlaceUpdates] Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:49112/collection1: Cannot talk to ZooKeeper - Updates are disabled. at __randomizedtesting.SeedInfo.seed([EF2A1348D287BB44]:0) at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:306) Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:49112/collection1: Cannot talk to ZooKeeper - Updates are disabled. at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178) at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:524) at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:544) at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:169) Build Log: [...truncated 12652 lines...] [junit4] Suite: org.apache.solr.cloud.TestStressInPlaceUpdates [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/init-core-data-001 [junit4] 2> 3577486 WARN (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1 [junit4] 2> 3577486 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 3577487 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 3577487 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / [junit4] 2> 3577490 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore [junit4] 2> 3577490 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/lib/classes] [junit4] 2> 3577595 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3577716 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.s.IndexSchema [null] Schema name=inplace-updates [junit4] 2> 3577966 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3578162 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3578191 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3578191 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3578197 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/lib, /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/lib/classes] [junit4] 2> 3578242 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3578262 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=inplace-updates [junit4] 2> 3578265 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3578265 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1, trusted=true [junit4] 2> 3578266 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3578266 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 3578270 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/init-core-data-001/] [junit4] 2> 3578272 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=12.3115234375, floorSegmentMB=0.3662109375, forceMergeDeletesPctAllowed=28.308600613926327, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1342914256719907 [junit4] 2> 3578277 WARN (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 3578351 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 3578351 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 3578352 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 3578352 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 3578361 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=18.6806640625, floorSegmentMB=0.4033203125, forceMergeDeletesPctAllowed=18.106691962156436, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3578372 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7c6db897[collection1] main] [junit4] 2> 3578373 WARN (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead. [junit4] 2> 3578373 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 3578373 INFO (coreLoadExecutor-7214-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578362947169681408 [junit4] 2> 3578374 INFO (searcherExecutor-7215-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7c6db897[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3578376 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 ####initCore end [junit4] 2> 3578378 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 3578390 INFO (Thread-5990) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 3578390 INFO (Thread-5990) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 3578512 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkTestServer start zk server on port:59367 [junit4] 2> 3578563 ERROR (Thread-5990) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 3579010 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 3579011 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/schema-inplace-updates.xml to /configs/conf1/schema.xml [junit4] 2> 3579011 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 3579012 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 3579014 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 3579015 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 3579015 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 3579016 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 3579016 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 3579017 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 3579017 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 3579032 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise [junit4] 2> 3579272 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 3579427 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1f5939a3{/,null,AVAILABLE} [junit4] 2> 3579427 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@77eb7b59{SSL,[ssl, http/1.1]}{127.0.0.1:43812} [junit4] 2> 3579427 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server Started @3592412ms [junit4] 2> 3579427 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/tempDir-001/control/data, hostContext=/, hostPort=43812, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/control-001/cores} [junit4] 2> 3579428 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 3579428 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.0.0 [junit4] 2> 3579428 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 3579428 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null [junit4] 2> 3579428 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-12T19:23:25.738Z [junit4] 2> 3579461 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 3579461 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/control-001/solr.xml [junit4] 2> 3579466 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 3579478 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59367/solr [junit4] 2> 3580038 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 3580038 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43812_ [junit4] 2> 3580039 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.c.Overseer Overseer (id=98647684199940101-127.0.0.1:43812_-n_0000000000) starting [junit4] 2> 3580082 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43812_ [junit4] 2> 3580142 INFO (OverseerStateUpdate-98647684199940101-127.0.0.1:43812_-n_0000000000) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 3582016 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3582133 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3582133 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3582143 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43812_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/control-001/cores [junit4] 2> 3582210 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 3582211 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59367/solr ready [junit4] 2> 3582266 INFO (qtp195673936-20144) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43812_&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 3582267 INFO (OverseerThreadFactory-7225-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection [junit4] 2> 3582471 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 3582471 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 3582573 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 3586128 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3586140 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=inplace-updates [junit4] 2> 3586164 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3586164 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true [junit4] 2> 3586165 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3586165 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 3586165 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/control-001/cores/control_collection_shard1_replica_n1/data/] [junit4] 2> 3586182 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=12.3115234375, floorSegmentMB=0.3662109375, forceMergeDeletesPctAllowed=28.308600613926327, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1342914256719907 [junit4] 2> 3586186 WARN (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 3586507 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 3586507 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 3586508 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 3586508 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 3586526 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=18.6806640625, floorSegmentMB=0.4033203125, forceMergeDeletesPctAllowed=18.106691962156436, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3586527 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c22b676[control_collection_shard1_replica_n1] main] [junit4] 2> 3586528 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3586528 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3586528 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 3586529 INFO (searcherExecutor-7228-thread-1-processing-n:127.0.0.1:43812_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3c22b676[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3586529 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578362955721867264 [junit4] 2> 3586536 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:43812/control_collection_shard1_replica_n1/ [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:43812/control_collection_shard1_replica_n1/ has no replicas [junit4] 2> 3586537 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 3586540 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:43812/control_collection_shard1_replica_n1/ shard1 [junit4] 2> 3586711 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 3586760 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 3586761 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4290 [junit4] 2> 3586763 INFO (qtp195673936-20144) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas [junit4] 2> 3586864 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) [junit4] 2> 3587766 INFO (qtp195673936-20144) [n:127.0.0.1:43812_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43812_&wt=javabin&version=2} status=0 QTime=5500 [junit4] 2> 3587926 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 3587927 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59367/solr ready [junit4] 2> 3587927 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 3587934 INFO (qtp195673936-20137) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 3587935 INFO (OverseerCollectionConfigSetProcessor-98647684199940101-127.0.0.1:43812_-n_0000000000) [n:127.0.0.1:43812_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 3587935 INFO (OverseerThreadFactory-7225-thread-2-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.CreateCollectionCmd Create collection collection1 [junit4] 2> 3587936 WARN (OverseerThreadFactory-7225-thread-2-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores. [junit4] 2> 3588227 INFO (qtp195673936-20137) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas [junit4] 2> 3588228 INFO (qtp195673936-20137) [n:127.0.0.1:43812_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=294 [junit4] 2> 3588751 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001 of type NRT [junit4] 2> 3588771 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 3588798 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@453fee51{/,null,AVAILABLE} [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1950a521{SSL,[ssl, http/1.1]}{127.0.0.1:51371} [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server Started @3601783ms [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=51371, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001/cores} [junit4] 2> 3588799 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.0.0 [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 3588799 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null [junit4] 2> 3588800 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-12T19:23:35.110Z [junit4] 2> 3588830 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 3588830 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001/solr.xml [junit4] 2> 3588834 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 3588836 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59367/solr [junit4] 2> 3588841 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 3588842 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 3588847 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51371_ [junit4] 2> 3588848 INFO (zkCallback-3015-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 3588854 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 3588873 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 3589221 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3589246 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3589246 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3589247 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:51371_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001/cores [junit4] 2> 3589293 INFO (qtp195673936-20141) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51371_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 3589301 INFO (OverseerCollectionConfigSetProcessor-98647684199940101-127.0.0.1:43812_-n_0000000000) [n:127.0.0.1:43812_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 3589306 INFO (OverseerThreadFactory-7225-thread-3-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:51371_ for creating new replica [junit4] 2> 3589348 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 3589348 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 3589452 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2]) [junit4] 2> 3590361 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3591007 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema [collection1_shard1_replica_n0] Schema name=inplace-updates [junit4] 2> 3591059 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3591059 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n0' using configuration from collection collection1, trusted=true [junit4] 2> 3591059 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n0' (registry 'solr.core.collection1.shard1.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3591059 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 3591059 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [[collection1_shard1_replica_n0] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001/cores/collection1_shard1_replica_n0], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-1-001/cores/collection1_shard1_replica_n0/data/] [junit4] 2> 3591068 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=12.3115234375, floorSegmentMB=0.3662109375, forceMergeDeletesPctAllowed=28.308600613926327, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1342914256719907 [junit4] 2> 3591070 WARN (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 3592204 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 3592204 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 3592205 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 3592205 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 3592209 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=18.6806640625, floorSegmentMB=0.4033203125, forceMergeDeletesPctAllowed=18.106691962156436, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3592210 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@3723fed2[collection1_shard1_replica_n0] main] [junit4] 2> 3592211 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3592212 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3592213 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 3592218 INFO (searcherExecutor-7239-thread-1-processing-n:127.0.0.1:51371_ x:collection1_shard1_replica_n0 s:shard1 c:collection1) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [collection1_shard1_replica_n0] Registered new searcher Searcher@3723fed2[collection1_shard1_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3592218 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578362961687216128 [junit4] 2> 3592227 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2]) [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51371/collection1_shard1_replica_n0/ [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy https://127.0.0.1:51371/collection1_shard1_replica_n0/ has no replicas [junit4] 2> 3592227 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR [junit4] 2> 3592230 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51371/collection1_shard1_replica_n0/ shard1 [junit4] 2> 3592331 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2]) [junit4] 2> 3592411 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 3592413 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3065 [junit4] 2> 3592448 INFO (qtp195673936-20141) [n:127.0.0.1:43812_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:51371_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=3155 [junit4] 2> 3592554 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2]) [junit4] 2> 3593316 INFO (OverseerCollectionConfigSetProcessor-98647684199940101-127.0.0.1:43812_-n_0000000000) [n:127.0.0.1:43812_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 3593590 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001 of type NRT [junit4] 2> 3593591 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 3594522 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55eb99{/,null,AVAILABLE} [junit4] 2> 3594522 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@e912a23{SSL,[ssl, http/1.1]}{127.0.0.1:49112} [junit4] 2> 3594522 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server Started @3607507ms [junit4] 2> 3594522 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=49112, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001/cores} [junit4] 2> 3594522 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 3594550 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.0.0 [junit4] 2> 3594550 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 3594550 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null [junit4] 2> 3594550 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-12T19:23:40.860Z [junit4] 2> 3594652 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 3594652 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001/solr.xml [junit4] 2> 3594656 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 3594774 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59367/solr [junit4] 2> 3594812 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 3594815 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 3594816 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49112_ [junit4] 2> 3594817 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 3594823 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 3594823 INFO (zkCallback-3015-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 3594848 INFO (zkCallback-3026-thread-2-processing-n:127.0.0.1:49112_) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 3595171 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3595198 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3595198 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3595199 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:49112_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001/cores [junit4] 2> 3595286 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:49112_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 3595288 INFO (OverseerThreadFactory-7225-thread-4-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:49112_ for creating new replica [junit4] 2> 3595377 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 3596137 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 3596141 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 3596184 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3596204 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=inplace-updates [junit4] 2> 3596208 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3596208 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true [junit4] 2> 3596208 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3596208 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 3596208 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001/cores/collection1_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-2-001/cores/collection1_shard1_replica_n1/data/] [junit4] 2> 3596210 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=12.3115234375, floorSegmentMB=0.3662109375, forceMergeDeletesPctAllowed=28.308600613926327, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1342914256719907 [junit4] 2> 3596212 WARN (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 3596319 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 3596319 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 3597110 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 3597110 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 3597112 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=18.6806640625, floorSegmentMB=0.4033203125, forceMergeDeletesPctAllowed=18.106691962156436, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3597112 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@78f0283c[collection1_shard1_replica_n1] main] [junit4] 2> 3597113 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3597113 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3597114 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 3597114 INFO (searcherExecutor-7250-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@78f0283c[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3597114 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578362966821044224 [junit4] 2> 3597118 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n1 [junit4] 2> 3597126 INFO (qtp1978219411-20214) [n:127.0.0.1:49112_ c:collection1 s:shard1 x:collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1749 [junit4] 2> 3597127 INFO (qtp195673936-20142) [n:127.0.0.1:43812_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:49112_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1841 [junit4] 2> 3597129 INFO (updateExecutor-3023-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 3597151 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true [junit4] 2> 3597152 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]] [junit4] 2> 3597152 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n1] [junit4] 2> 3597152 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null} [junit4] 2> 3597152 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n1] as recovering, leader is [https://127.0.0.1:51371/collection1_shard1_replica_n0/] and I am [https://127.0.0.1:49112/collection1_shard1_replica_n1/] [junit4] 2> 3597172 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:51371]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n0&nodeName=127.0.0.1:49112_&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true] [junit4] 2> 3597190 INFO (qtp1634276917-20180) [n:127.0.0.1:51371_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s [junit4] 2> 3597190 INFO (qtp1634276917-20180) [n:127.0.0.1:51371_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n0, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:49112_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1_shard1_replica_n1","base_url":"https://127.0.0.1:49112","node_name":"127.0.0.1:49112_","state":"down","type":"NRT"} [junit4] 2> 3597254 INFO (zkCallback-3026-thread-2-processing-n:127.0.0.1:49112_) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 3597254 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3]) [junit4] 2> 3597287 INFO (OverseerCollectionConfigSetProcessor-98647684199940101-127.0.0.1:43812_-n_0000000000) [n:127.0.0.1:43812_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper [junit4] 2> 3597657 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001 of type NRT [junit4] 2> 3597714 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 3597826 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28cdd04{/,null,AVAILABLE} [junit4] 2> 3597826 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@ec22be1{SSL,[ssl, http/1.1]}{127.0.0.1:43769} [junit4] 2> 3598061 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.e.j.s.Server Started @3611046ms [junit4] 2> 3598061 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=43769, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001/cores} [junit4] 2> 3598062 ERROR (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 3598068 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.0.0 [junit4] 2> 3598068 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 3598068 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null [junit4] 2> 3598068 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-09-12T19:23:44.378Z [junit4] 2> 3598191 INFO (qtp1634276917-20180) [n:127.0.0.1:51371_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n0, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:49112_, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"core":"collection1_shard1_replica_n1","base_url":"https://127.0.0.1:49112","node_name":"127.0.0.1:49112_","state":"recovering","type":"NRT"} [junit4] 2> 3598191 INFO (qtp1634276917-20180) [n:127.0.0.1:51371_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds. [junit4] 2> 3598191 INFO (qtp1634276917-20180) [n:127.0.0.1:51371_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:49112_&onlyIfLeaderActive=true&core=collection1_shard1_replica_n0&coreNodeName=core_node2&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1001 [junit4] 2> 3598236 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 3598236 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001/solr.xml [junit4] 2> 3598241 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3, but no JMX reporters were configured - adding default JMX reporter. [junit4] 2> 3598270 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59367/solr [junit4] 2> 3598543 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 3598543 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 3598545 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43769_ [junit4] 2> 3598546 INFO (zkCallback-3015-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 3598552 INFO (zkCallback-3008-thread-1-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 3598552 INFO (zkCallback-3026-thread-2-processing-n:127.0.0.1:49112_) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 3598552 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 3598602 INFO (zkCallback-3033-thread-2-processing-n:127.0.0.1:43769_) [n:127.0.0.1:43769_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 3598810 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [https://127.0.0.1:51371/collection1_shard1_replica_n0/] - recoveringAfterStartup=[true] [junit4] 2> 3598810 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=https://127.0.0.1:49112 START replicas=[https://127.0.0.1:51371/collection1_shard1_replica_n0/] nUpdates=100 [junit4] 2> 3598836 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n0] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0} [junit4] 2> 3598836 INFO (qtp1634276917-20183) [n:127.0.0.1:51371_ c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n0] o.a.s.c.S.Request [collection1_shard1_replica_n0] webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.IndexFingerprint IndexFingerprint millis:0.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0} [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful. [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync. [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy No replay needed. [junit4] 2> 3598837 INFO (recoveryExecutor-3024-thread-1-processing-n:127.0.0.1:49112_ x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:49112_ c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n1] o.a.s.c.RecoveryStrategy Registering as Active after recovery. [junit4] 2> 3598928 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3598939 INFO (zkCallback-3026-thread-2-processing-n:127.0.0.1:49112_) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4]) [junit4] 2> 3598939 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4]) [junit4] 2> 3598972 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3598972 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3598973 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [n:127.0.0.1:43769_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001/cores [junit4] 2> 3599241 INFO (qtp195673936-20144) [n:127.0.0.1:43812_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:43769_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 3599281 INFO (OverseerThreadFactory-7225-thread-5-processing-n:127.0.0.1:43812_) [n:127.0.0.1:43812_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:43769_ for creating new replica [junit4] 2> 3599451 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 3599451 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores [junit4] 2> 3599560 INFO (zkCallback-3026-thread-2-processing-n:127.0.0.1:49112_) [n:127.0.0.1:49112_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4]) [junit4] 2> 3599560 INFO (zkCallback-3033-thread-2-processing-n:127.0.0.1:43769_) [n:127.0.0.1:43769_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4]) [junit4] 2> 3599560 INFO (zkCallback-3020-thread-2-processing-n:127.0.0.1:51371_) [n:127.0.0.1:51371_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4]) [junit4] 2> 3600809 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0 [junit4] 2> 3600867 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema [collection1_shard1_replica_n2] Schema name=inplace-updates [junit4] 2> 3600890 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema inplace-updates/1.6 with uniqueid field id [junit4] 2> 3600890 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from collection collection1, trusted=true [junit4] 2> 3600891 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6533d3d3 [junit4] 2> 3600891 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder [junit4] 2> 3600891 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001/cores/collection1_shard1_replica_n2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.0/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressInPlaceUpdates_EF2A1348D287BB44-001/shard-3-001/cores/collection1_shard1_replica_n2/data/] [junit4] 2> 3601279 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=12.3115234375, floorSegmentMB=0.3662109375, forceMergeDeletesPctAllowed=28.308600613926327, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1342914256719907 [junit4] 2> 3601283 WARN (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}} [junit4] 2> 3601560 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 3601560 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 3601561 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 3601561 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 3601574 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=18.6806640625, floorSegmentMB=0.4033203125, forceMergeDeletesPctAllowed=18.106691962156436, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3601574 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@70db40eb[collection1_shard1_replica_n2] main] [junit4] 2> 3601575 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3601575 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3601576 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 3601577 INFO (searcherExecutor-7261-thread-1-processing-n:127.0.0.1:43769_ x:collection1_shard1_replica_n2 s:shard1 c:collection1) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher Searcher@70db40eb[collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3601577 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1578362971500838912 [junit4] 2> 3601581 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n2 [junit4] 2> 3601590 INFO (qtp2010131695-20247) [n:127.0.0.1:43769_ c:collection1 s:shard1 x:collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2139 [junit4] 2> 3601591 INFO (qtp195673936-20144) [n:127.0.0.1:43812_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:43769_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=2350 [junit4] 2> 3601593 INFO (updateExecutor-3030-thread-1-processing-n:127.0.0.1:43769_ x:collection1_shard1_replica_n2 s:shard1 c:collection1) [n:127.0.0.1:43769_ c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n2] o.a.s.u.DefaultSolrCoreState Running recovery [junit4] 2> 3601605 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.SolrTestCaseJ4 ###Starting stressTest [junit4] 2> 3601605 INFO (TEST-TestStressInPlaceUpdates.stressTest-seed#[EF2A1348D287BB44]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330 [junit4] 1> - [junit4] 1> replica:core_node1 rstate:active live:true [junit4] 1> replica:core_node2 rstate:active live:true [junit4] 1> replica:core_node3 rstate:down live:true [junit4] 2> 3601704 INFO (recoveryExecutor-3031-thread-1-processing-n:127.0.0.1:43769_ x:collection1_shard1_replica_n2 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:43769_ c:collection1 s:shard1 r:core_ [...truncated too long message...] izedtesting.SeedInfo.seed([EF2A1348D287BB44]:0) [junit4] > at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:306) [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:43769/collection1: Cannot talk to ZooKeeper - Updates are disabled. [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242) [junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178) [junit4] > at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484) [junit4] > at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463) [junit4] > at org.apache.solr.cloud.TestStressInPlaceUpdates$1.run(TestStressInPlaceUpdates.java:173) [junit4] 2> 3657479 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> 3657479 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=545216740 [junit4] 2> 3657479 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 3657479 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b209177: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2f9aca30 [junit4] 2> 3657480 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 3657480 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e8fec16: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2201ee9d [junit4] 2> 3657481 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 3657481 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e9becf1: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@513c71d3 [junit4] 2> 3657481 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 3657502 INFO (coreCloseExecutor-7280-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4ac29a60 [junit4] 2> 3657502 INFO (coreCloseExecutor-7280-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1254267488 [junit4] 2> 3657502 INFO (coreCloseExecutor-7280-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@178ae599: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@40362345 [junit4] 2> 3657590 INFO (SUITE-TestStressInPlaceUpdates-seed#[EF2A1348D287BB44]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {title_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=Lucene50(blocksize=128), id_field_copy_that_does_not_support_in_place_update_s=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{val1_i_dvo=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Memory), val2_l_dvo=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Direct), inplace_updatable_int_with_default=DocValuesFormat(name=Memory), inplace_updatable_float_with_default=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=151, maxMBSortInHeap=5.184683205173828, sim=RandomSimilarity(queryNorm=true): {}, locale=es-UY, timezone=Libya [junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=259904992,total=527433728 [junit4] 2> NOTE: All tests run in this JVM: [TestFastLRUCache, TestCloudPivotFacet, TestDeleteCollectionOnDownNodes, TestReqParamsAPI, CustomCollectionTest, TestCoreDiscovery, SampleTest, TestHashQParserPlugin, HighlighterTest, TestFieldCacheReopen, QueryParsingTest, TestSolrCloudWithHadoopAuthPlugin, CheckHdfsIndexTest, LeaderElectionContextKeyTest, TestSQLHandlerNonCloud, TestGeoJSONResponseWriter, TestTrieFacet, InfoHandlerTest, StatelessScriptUpdateProcessorFactoryTest, TestPostingsSolrHighlighter, LukeRequestHandlerTest, TestHttpShardHandlerFactory, MissingSegmentRecoveryTest, TestStressVersions, HdfsRecoveryZkTest, TestAnalyzeInfixSuggestions, TestCoreContainer, CdcrVersionReplicationTest, RequestLoggingTest, SpatialFilterTest, TestJsonFacetRefinement, SystemInfoHandlerTest, TestDistributedGrouping, CdcrReplicationDistributedZkTest, BasicAuthIntegrationTest, TestFieldSortValues, DocValuesNotIndexedTest, SchemaVersionSpecificBehaviorTest, TestFieldCacheVsDocValues, DeleteStatusTest, ClusterStateUpdateTest, DOMUtilTest, TestOrdValues, TestXIncludeConfig, BadComponentTest, TestShardHandlerFactory, TestBinaryResponseWriter, TestRandomRequestDistribution, CollectionsAPIDistributedZkTest, TestPushWriter, TestSchemaResource, DistribJoinFromCollectionTest, TestRTGBase, OverseerModifyCollectionTest, SliceStateTest, TlogReplayBufferedWhileIndexingTest, TestCursorMarkWithoutUniqueKey, DistributedMLTComponentTest, MetricUtilsTest, BasicFunctionalityTest, PrimUtilsTest, TestCloudDeleteByQuery, CollectionsAPIAsyncDistributedZkTest, TestDocBasedVersionConstraints, SolrMetricsIntegrationTest, TestDynamicLoading, GraphQueryTest, DistanceFunctionTest, MoreLikeThisHandlerTest, ZkControllerTest, RestartWhileUpdatingTest, TestSmileRequest, DocValuesTest, TestReloadDeadlock, TestAtomicUpdateErrorCases, TestFiltering, BlockJoinFacetDistribTest, TestMaxScoreQueryParser, OutOfBoxZkACLAndCredentialsProvidersTest, ShardRoutingCustomTest, TestSolrCLIRunExample, TestSubQueryTransformerCrossCore, TestSearchPerf, TestSolrIndexConfig, TestAuthorizationFramework, ShardRoutingTest, ClassificationUpdateProcessorTest, TestScoreJoinQPNoScore, TestApiFramework, AsyncCallRequestStatusResponseTest, TestPerFieldSimilarity, TestPullReplica, TestSystemIdResolver, ShufflingReplicaListTransformerTest, TestCoreAdminApis, ActionThrottleTest, TestSolrCloudWithDelegationTokens, DistributedIntervalFacetingTest, ZkSolrClientTest, DocValuesMultiTest, TestStressRecovery, HdfsLockFactoryTest, TestSolrJ, TestPayloadScoreQParserPlugin, SolrCloudReportersTest, RemoteQueryErrorTest, FileBasedSpellCheckerTest, HdfsThreadLeakTest, HdfsDirectoryFactoryTest, TestSolrQueryResponse, SortSpecParsingTest, TermVectorComponentTest, TestConfigSets, TestEmbeddedSolrServerSchemaAPI, SoftAutoCommitTest, TestPartialUpdateDeduplication, DisMaxRequestHandlerTest, TestValueSourceCache, DateRangeFieldTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, ZkCLITest, TestDistributedSearch, TermVectorComponentDistributedTest, TestRealTimeGet, TestJoin, TestRangeQuery, TestGroupingSearch, PeerSyncTest, AnalysisAfterCoreReloadTest, SuggesterFSTTest, CoreAdminHandlerTest, PolyFieldTest, TestPseudoReturnFields, TestWordDelimiterFilterFactory, TestRemoteStreaming, CacheHeaderTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, TestOmitPositions, PathHierarchyTokenizerFactoryTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, TestPHPSerializedResponseWriter, SearchHandlerTest, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, CopyFieldTest, SolrIndexConfigTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, TestCharFilters, TestCodecSupport, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, ChaosMonkeyNothingIsSafeTest, AliasIntegrationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CollectionReloadTest, ConfigSetsAPITest, ConnectionManagerTest, DeleteNodeTest, DeleteReplicaTest, DistributedVersionInfoTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MoveReplicaTest, SolrCloudExampleTest, TestExclusionRuleCollectionAccess, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestRequestForwarding, TestSegmentSorting, TestSolrCloudWithSecureImpersonation, TestStressInPlaceUpdates] [junit4] Completed [544/729 (1!)] on J1 in 81.54s, 1 test, 1 error <<< FAILURES! [...truncated 44039 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
