I believe I’ve seen this kind of error under disk full conditions, but I don’t
see any other indications of that in this Jenkins log. Maybe some other kind
of disk problem?
FWIW (probably not much): there are 62 failures like this, but only 5 unique
resources that aren’t accessible; each fails a different number times:
$ perl -ne 'if (/invalid api spec:/i) { s/^.*(?=invalid api spec:)//i;
s/\s+$//; $c{$_}++; } END { for (sort {$c{$b}<=>$c{$a}} keys %c) { print
"$c{$_}\t$_\n"; } }' consoleText
40 invalid API spec: apispec/emptySpec.json
12 invalid API spec: apispec/core.SchemaRead.json
5 invalid API spec: apispec/core.config.Commands.json
4 invalid API spec: apispec/core.SchemaRead.fields.json
1 invalid API spec: apispec/cluster.configs.delete.json
--
Steve
www.lucidworks.com
> On Jan 25, 2018, at 11:06 AM, Shalin Shekhar Mangar <[email protected]>
> wrote:
>
> This is a strange failure. The logs are full of messages "invalid API
> spec:" which is a misleading message. The message is logged if the
> call to
> ValidatingJsonMap.class.getClassLoader().getResourceAsStream(resourceName);
> returns a null input stream. I'll fix the message but I am not sure
> why the call failed. I looked through the last two mac os failures and
> I don't see this exception. Does anyone have any ideas?
>
> On Thu, Jan 25, 2018 at 7:53 PM, Policeman Jenkins Server
> <[email protected]> wrote:
>> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/4407/
>> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC
>>
>> 8 tests failed.
>> FAILED:
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testSpecificConfigsets
>>
>> Error Message:
>> KeeperErrorCode = NoNode for /collections/withconfigset2
>>
>> Stack Trace:
>> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
>> NoNode for /collections/withconfigset2
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:530732B00F155C13]:0)
>> at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
>> at
>> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339)
>> at
>> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339)
>> at
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testSpecificConfigsets(CollectionsAPIDistributedZkTest.java:373)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> FAILED:
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionReload
>>
>> Error Message:
>> Could not find collection : reloaded_collection
>>
>> Stack Trace:
>> org.apache.solr.common.SolrException: Could not find collection :
>> reloaded_collection
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:7FC051D42DBE4980]:0)
>> at
>> org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:118)
>> at
>> org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
>> at
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.collectStartTimes(CollectionsAPIDistributedZkTest.java:550)
>> at
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionReload(CollectionsAPIDistributedZkTest.java:491)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> FAILED:
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
>>
>> Error Message:
>> Error from server at http://127.0.0.1:63452/solr: ADDREPLICA failed to
>> create replica
>>
>> Stack Trace:
>> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error
>> from server at http://127.0.0.1:63452/solr: ADDREPLICA failed to create
>> replica
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:54F9110F4FEBC6D7]:0)
>> at
>> org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
>> at
>> org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
>> at
>> org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
>> at
>> org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
>> at
>> org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
>> at
>> org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
>> at
>> org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
>> at
>> org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
>> at
>> org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
>> at
>> org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
>> at
>> org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection(CollectionsAPIDistributedZkTest.java:170)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> FAILED:
>> org.apache.solr.cloud.api.collections.CustomCollectionTest.testRouteFieldForImplicitRouter
>>
>> Error Message:
>> Collection not found: withShardField
>>
>> Stack Trace:
>> org.apache.solr.common.SolrException: Collection not found: withShardField
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:2B29957854C829EF]:0)
>> at
>> org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:851)
>> at
>> org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
>> at
>> org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
>> at
>> org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
>> at
>> org.apache.solr.cloud.api.collections.CustomCollectionTest.testRouteFieldForImplicitRouter(CustomCollectionTest.java:142)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> FAILED:
>> org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple
>>
>> Error Message:
>>
>>
>> Stack Trace:
>> java.lang.NullPointerException
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:46CA5914DFC232CE]:0)
>> at
>> org.apache.solr.client.solrj.embedded.JettySolrRunner.getNodeName(JettySolrRunner.java:345)
>> at
>> org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest.testSimple(AutoAddReplicasPlanActionTest.java:65)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> FAILED:
>> junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest
>>
>> Error Message:
>> 10 threads leaked from SUITE scope at
>> org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest: 1)
>> Thread[id=25475, name=Connection evictor, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> java.lang.Thread.sleep(Native Method) at
>> org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
>> at java.lang.Thread.run(Thread.java:748) 2) Thread[id=25489,
>> name=jetty-launcher-5573-thread-2-SendThread(127.0.0.1:63752),
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest] at
>> java.lang.Thread.sleep(Native Method) at
>> org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 3)
>> Thread[id=25523, name=zkCallback-5597-thread-4, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25493,
>> name=zkConnectionManagerCallback-5598-thread-1, state=WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25490,
>> name=jetty-launcher-5573-thread-2-EventThread, state=WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 6)
>> Thread[id=25495, name=zkCallback-5597-thread-1, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25470,
>> name=Connection evictor, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> java.lang.Thread.sleep(Native Method) at
>> org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
>> at java.lang.Thread.run(Thread.java:748) 8) Thread[id=25522,
>> name=zkCallback-5597-thread-3, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 9) Thread[id=25524,
>> name=zkCallback-5597-thread-5, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 10) Thread[id=25521,
>> name=zkCallback-5597-thread-2-processing-n:127.0.0.1:63757_solr,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest] at
>> java.lang.Thread.sleep(Native Method) at
>> org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
>> at
>> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:494)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:437)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
>> at
>> org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:788)
>> at
>> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
>> at
>> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
>> at
>> org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
>> at
>> org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
>> at
>> org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
>> at
>> org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$231/1095815815.run(Unknown
>> Source) at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
>> at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$114/259134832.run(Unknown
>> Source) at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>>
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: 10 threads leaked from
>> SUITE scope at
>> org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest:
>> 1) Thread[id=25475, name=Connection evictor, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at java.lang.Thread.sleep(Native Method)
>> at
>> org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
>> at java.lang.Thread.run(Thread.java:748)
>> 2) Thread[id=25489,
>> name=jetty-launcher-5573-thread-2-SendThread(127.0.0.1:63752),
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at java.lang.Thread.sleep(Native Method)
>> at
>> org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
>> 3) Thread[id=25523, name=zkCallback-5597-thread-4, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 4) Thread[id=25493, name=zkConnectionManagerCallback-5598-thread-1,
>> state=WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 5) Thread[id=25490, name=jetty-launcher-5573-thread-2-EventThread,
>> state=WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
>> 6) Thread[id=25495, name=zkCallback-5597-thread-1, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 7) Thread[id=25470, name=Connection evictor, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at java.lang.Thread.sleep(Native Method)
>> at
>> org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
>> at java.lang.Thread.run(Thread.java:748)
>> 8) Thread[id=25522, name=zkCallback-5597-thread-3, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 9) Thread[id=25524, name=zkCallback-5597-thread-5, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 10) Thread[id=25521,
>> name=zkCallback-5597-thread-2-processing-n:127.0.0.1:63757_solr,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at java.lang.Thread.sleep(Native Method)
>> at
>> org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
>> at
>> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:494)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:437)
>> at
>> org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
>> at
>> org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:788)
>> at
>> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
>> at
>> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
>> at
>> org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
>> at
>> org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
>> at
>> org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
>> at
>> org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$231/1095815815.run(Unknown
>> Source)
>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
>> at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$114/259134832.run(Unknown
>> Source)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> at __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F]:0)
>>
>>
>> FAILED:
>> junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.AutoAddReplicasPlanActionTest
>>
>> Error Message:
>> There are still zombie threads that couldn't be terminated: 1)
>> Thread[id=25489,
>> name=jetty-launcher-5573-thread-2-SendThread(127.0.0.1:63752),
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest] at
>> java.lang.Thread.sleep(Native Method) at
>> org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2)
>> Thread[id=25523, name=zkCallback-5597-thread-4, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 3) Thread[id=25493,
>> name=zkConnectionManagerCallback-5598-thread-1, state=WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 4) Thread[id=25495,
>> name=zkCallback-5597-thread-1, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 5) Thread[id=25522,
>> name=zkCallback-5597-thread-3, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 6) Thread[id=25524,
>> name=zkCallback-5597-thread-5, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) 7) Thread[id=25521,
>> name=zkCallback-5597-thread-2, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest] at
>> sun.misc.Unsafe.park(Native Method) at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>>
>> Stack Trace:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
>> threads that couldn't be terminated:
>> 1) Thread[id=25489,
>> name=jetty-launcher-5573-thread-2-SendThread(127.0.0.1:63752),
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at java.lang.Thread.sleep(Native Method)
>> at
>> org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
>> 2) Thread[id=25523, name=zkCallback-5597-thread-4, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 3) Thread[id=25493, name=zkConnectionManagerCallback-5598-thread-1,
>> state=WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 4) Thread[id=25495, name=zkCallback-5597-thread-1, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 5) Thread[id=25522, name=zkCallback-5597-thread-3, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 6) Thread[id=25524, name=zkCallback-5597-thread-5, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> 7) Thread[id=25521, name=zkCallback-5597-thread-2, state=TIMED_WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>> at __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F]:0)
>>
>>
>> FAILED:
>> org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger
>>
>> Error Message:
>>
>>
>> Stack Trace:
>> java.lang.NullPointerException
>> at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F:C4754A65A7D93050]:0)
>> at
>> org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1565)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 11654 lines...]
>> [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
>> [junit4] 2> Creating dataDir:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_7E797DEAF831E61F-001/init-core-data-001
>> [junit4] 2> 16244 WARN
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
>> [junit4] 2> 16244 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
>> w/NUMERIC_DOCVALUES_SYSPROP=false
>> [junit4] 2> 16249 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via:
>> @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN,
>> clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
>> [junit4] 2> 16249 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
>> test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
>> [junit4] 2> 16252 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_7E797DEAF831E61F-001/tempDir-001
>> [junit4] 2> 16267 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
>> [junit4] 2> 16270 INFO (Thread-14) [ ] o.a.s.c.ZkTestServer client
>> port:0.0.0.0/0.0.0.0:0
>> [junit4] 2> 16270 INFO (Thread-14) [ ] o.a.s.c.ZkTestServer Starting
>> server
>> [junit4] 2> 16481 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.c.ZkTestServer start zk server on port:53024
>> [junit4] 2> 16566 ERROR (Thread-14) [ ] o.a.z.s.ZooKeeperServer
>> ZKShutdownHandler is not registered, so ZooKeeper server won't take any
>> action on ERROR or SHUTDOWN server state changes
>> [junit4] 2> 16670 INFO (zkConnectionManagerCallback-10-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 16754 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
>> 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>> [junit4] 2> 16755 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
>> 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.session Scavenging every 660000ms
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 16757 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.session Scavenging every 660000ms
>> [junit4] 2> 16758 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.h.ContextHandler Started
>> o.e.j.s.ServletContextHandler@d63a739{/solr,null,AVAILABLE}
>> [junit4] 2> 16758 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.h.ContextHandler Started
>> o.e.j.s.ServletContextHandler@1257398a{/solr,null,AVAILABLE}
>> [junit4] 2> 16760 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.AbstractConnector Started
>> ServerConnector@356cfda{HTTP/1.1,[http/1.1]}{127.0.0.1:53029}
>> [junit4] 2> 16761 INFO (jetty-launcher-7-thread-1) [ ]
>> o.e.j.s.Server Started @20200ms
>> [junit4] 2> 16760 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.AbstractConnector Started
>> ServerConnector@1e6e5b7a{HTTP/1.1,[http/1.1]}{127.0.0.1:53028}
>> [junit4] 2> 16761 INFO (jetty-launcher-7-thread-2) [ ]
>> o.e.j.s.Server Started @20200ms
>> [junit4] 2> 16761 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
>> hostPort=53029}
>> [junit4] 2> 16761 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
>> hostPort=53028}
>> [junit4] 2> 16761 ERROR (jetty-launcher-7-thread-1) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
>> missing or incomplete.
>> [junit4] 2> 16761 ERROR (jetty-launcher-7-thread-2) [ ]
>> o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
>> missing or incomplete.
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
>> 8.0.0
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2018-01-25T13:19:30.715Z
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
>> 8.0.0
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port
>> null
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2018-01-25T13:19:30.715Z
>> [junit4] 2> 16762 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find
>> system property or JNDI)
>> [junit4] 2> 16766 INFO (zkConnectionManagerCallback-13-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 16767 INFO (zkConnectionManagerCallback-14-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 16769 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>> [junit4] 2> 16769 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>> [junit4] 2> 16796 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
>> o.a.z.s.NIOServerCnxn caught end of stream exception
>> [junit4] 2> EndOfStreamException: Unable to read additional data from
>> client sessionid 0x1612d7928310002, likely client has closed socket
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
>> [junit4] 2> at java.lang.Thread.run(Thread.java:748)
>> [junit4] 2> 16800 INFO (jetty-launcher-7-thread-2) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53024/solr
>> [junit4] 2> 16800 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
>> o.a.z.s.NIOServerCnxn caught end of stream exception
>> [junit4] 2> EndOfStreamException: Unable to read additional data from
>> client sessionid 0x1612d7928310001, likely client has closed socket
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
>> [junit4] 2> at java.lang.Thread.run(Thread.java:748)
>> [junit4] 2> 16804 INFO (jetty-launcher-7-thread-1) [ ]
>> o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53024/solr
>> [junit4] 2> 16842 INFO (zkConnectionManagerCallback-20-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 16849 INFO (zkConnectionManagerCallback-22-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 16853 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ]
>> o.a.z.s.NIOServerCnxn caught end of stream exception
>> [junit4] 2> EndOfStreamException: Unable to read additional data from
>> client sessionid 0x1612d7928310004, likely client has closed socket
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
>> [junit4] 2> at
>> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
>> [junit4] 2> at java.lang.Thread.run(Thread.java:748)
>> [junit4] 2> 16867 INFO
>> (zkConnectionManagerCallback-24-thread-1-processing-n:127.0.0.1:53028_solr)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.c.ConnectionManager zkClient has
>> connected
>> [junit4] 2> 16868 INFO
>> (zkConnectionManagerCallback-26-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.c.ConnectionManager zkClient has
>> connected
>> [junit4] 2> 17135 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.Overseer Overseer (id=null) closing
>> [junit4] 2> 17135 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.Overseer Overseer (id=null) closing
>> [junit4] 2> 17138 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.OverseerElectionContext I am going to
>> be the leader 127.0.0.1:53029_solr
>> [junit4] 2> 17139 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.ZkController Register node as live in
>> ZooKeeper:/live_nodes/127.0.0.1:53028_solr
>> [junit4] 2> 17142 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.Overseer Overseer
>> (id=99410665167454214-127.0.0.1:53029_solr-n_0000000000) starting
>> [junit4] 2> 17173 INFO
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (0) -> (1)
>> [junit4] 2> 17173 INFO
>> (zkCallback-23-thread-1-processing-n:127.0.0.1:53028_solr)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (0) -> (1)
>> [junit4] 2> 17508 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.ZkController Register node as live in
>> ZooKeeper:/live_nodes/127.0.0.1:53029_solr
>> [junit4] 2> 17524 INFO
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (1) -> (2)
>> [junit4] 2> 17525 INFO
>> (zkCallback-23-thread-1-processing-n:127.0.0.1:53028_solr)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (1) -> (2)
>> [junit4] 2> 17573 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Adding
>> .autoAddReplicas trigger
>> [junit4] 2> 17579 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
>> /autoscaling.json with znode version 1
>> [junit4] 2> 18329 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
>> [127.0.0.1:53029_solr, 127.0.0.1:53028_solr]
>> [junit4] 2> 18329 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 1, lastZnodeVersion -1
>> [junit4] 2> 18329 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Processed
>> trigger updates upto znodeVersion 1
>> [junit4] 2> 18362 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeAdded markers
>> [junit4] 2> 18365 DEBUG (ScheduledTrigger-48-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
>> [junit4] 2> 18371 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53028.solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18380 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 1, lastZnodeVersion 1
>> [junit4] 2> 18428 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53029.solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18489 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53028.solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18489 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53028.solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18502 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53029.solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18502 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53029.solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 18577 INFO (jetty-launcher-7-thread-2)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
>> definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_7E797DEAF831E61F-001/tempDir-001/node2/.
>> [junit4] 2> 18581 INFO (jetty-launcher-7-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
>> definitions underneath
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_7E797DEAF831E61F-001/tempDir-001/node1/.
>> [junit4] 2> 18697 INFO (zkConnectionManagerCallback-32-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 18704 INFO (zkConnectionManagerCallback-36-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 18707 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
>> [junit4] 2> 18709 INFO
>> (SUITE-TriggerIntegrationTest-seed#[7E797DEAF831E61F]-worker) [ ]
>> o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53024/solr
>> ready
>> [junit4] 2> 18727 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
>> [junit4] 2> 18728 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode
>> version 2
>> [junit4] 2> 18729 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
>> /autoscaling.json with znode version 2
>> [junit4] 2> 18729 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Processed
>> trigger updates upto znodeVersion 2
>> [junit4] 2> 18734 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeLost markers
>> [junit4] 2> 18735 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeAdded markers
>> [junit4] 2> 18736 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 2, lastZnodeVersion 2
>> [junit4] 2> 18747 INFO (qtp657754392-72) [n:127.0.0.1:53028_solr ]
>> o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with
>> params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
>> [junit4] 2> 18777 INFO (qtp657754392-72) [n:127.0.0.1:53028_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
>> params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=30
>> [junit4] 2> 18873 INFO (qtp657754392-76) [n:127.0.0.1:53028_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
>> status=0 QTime=10
>> [junit4] 2> 18876 INFO (qtp1778631180-70) [n:127.0.0.1:53029_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
>> status=0 QTime=0
>> [junit4] 2> 18877 DEBUG (qtp1778631180-66) [n:127.0.0.1:53029_solr ]
>> o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
>> [junit4] 2> 18878 INFO (qtp1778631180-66) [n:127.0.0.1:53029_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling
>> params={wt=javabin&version=2} status=0 QTime=65
>> [junit4] 2> 18879 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
>> /autoscaling.json with znode version 3
>> [junit4] 2> 18880 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
>> [127.0.0.1:53029_solr, 127.0.0.1:53028_solr]
>> [junit4] 2> 18880 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Processed
>> trigger updates upto znodeVersion 3
>> [junit4] 2> 18883 INFO
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.TriggerIntegrationTest
>> TestTriggerAction init
>> [junit4] 2> 18883 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeAdded markers
>> [junit4] 2> 18884 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 3, lastZnodeVersion 3
>> [junit4] 2> 18884 DEBUG (ScheduledTrigger-48-thread-1)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: node_lost_trigger with currently live nodes: 2
>> [junit4] 2> 18884 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.e.j.s.AbstractConnector Stopped
>> ServerConnector@1e6e5b7a{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
>> [junit4] 2> 18885 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=950881581
>> [junit4] 2> 18885 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.SolrMetricManager Closing metric reporters for
>> registry=solr.node, tag=null
>> [junit4] 2> 18885 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.r.SolrJmxReporter Closing reporter
>> [org.apache.solr.metrics.reporters.SolrJmxReporter@1634fb6: rootName =
>> solr_53028, domain = solr.node, service url = null, agent id = null] for
>> registry solr.node / com.codahale.metrics.MetricRegistry@1fb41f0a
>> [junit4] 2> 18895 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.SolrMetricManager Closing metric reporters for
>> registry=solr.jvm, tag=null
>> [junit4] 2> 18895 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.r.SolrJmxReporter Closing reporter
>> [org.apache.solr.metrics.reporters.SolrJmxReporter@6b7253ba: rootName =
>> solr_53028, domain = solr.jvm, service url = null, agent id = null] for
>> registry solr.jvm / com.codahale.metrics.MetricRegistry@43d06aba
>> [junit4] 2> 18900 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.SolrMetricManager Closing metric reporters for
>> registry=solr.jetty, tag=null
>> [junit4] 2> 18901 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.r.SolrJmxReporter Closing reporter
>> [org.apache.solr.metrics.reporters.SolrJmxReporter@59b22ff4: rootName =
>> solr_53028, domain = solr.jetty, service url = null, agent id = null] for
>> registry solr.jetty / com.codahale.metrics.MetricRegistry@2116ae4f
>> [junit4] 2> 18903 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.c.ZkController Remove node as live in
>> ZooKeeper:/live_nodes/127.0.0.1:53028_solr
>> [junit4] 2> 18904 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.m.SolrMetricManager Closing metric reporters for
>> registry=solr.cluster, tag=null
>> [junit4] 2> 18904 INFO
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (2) -> (1)
>> [junit4] 2> 18905 INFO (zkCallback-35-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
>> [junit4] 2> 18904 INFO
>> (zkCallback-23-thread-1-processing-n:127.0.0.1:53028_solr)
>> [n:127.0.0.1:53028_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (2) -> (1)
>> [junit4] 2> 18905 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for
>> 2147483647 transient cores
>> [junit4] 2> 18907 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.e.j.s.h.ContextHandler Stopped
>> o.e.j.s.ServletContextHandler@d63a739{/solr,null,UNAVAILABLE}
>> [junit4] 2> 18908 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.e.j.s.session Stopped scavenging
>> [junit4] 2> 19897 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: node_lost_trigger with currently live nodes: 1
>> [junit4] 2> 19897 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node:
>> 127.0.0.1:53028_solr
>> [junit4] 2> 20771 INFO
>> (OverseerCollectionConfigSetProcessor-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.OverseerTaskQueue Response ZK path:
>> /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may
>> have disconnected from ZooKeeper
>> [junit4] 2> 20900 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: node_lost_trigger with currently live nodes: 1
>> [junit4] 2> 21901 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: node_lost_trigger with currently live nodes: 1
>> [junit4] 2> 22902 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Running
>> NodeLostTrigger: node_lost_trigger with currently live nodes: 1
>> [junit4] 2> 22902 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger
>> firing registered processor for lost nodes: [127.0.0.1:53028_solr]
>> [junit4] 2> 22905 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown
>> inactive - processing event: {
>> [junit4] 2> "id":"215c6a28112b6Tztlufkk2v8h7oh4p3og9272t",
>> [junit4] 2> "source":"node_lost_trigger",
>> [junit4] 2> "eventTime":586892827497142,
>> [junit4] 2> "eventType":"NODELOST",
>> [junit4] 2> "properties":{
>> [junit4] 2> "eventTimes":[586892827497142],
>> [junit4] 2> "nodeNames":["127.0.0.1:53028_solr"]}}
>> [junit4] 2> 22905 DEBUG (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.ScheduledTriggers Pausing all
>> triggers: [node_lost_trigger]
>> [junit4] 2> 22910 INFO (ScheduledTrigger-48-thread-2)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.SystemLogListener Collection .system
>> does not exist, disabling logging.
>> [junit4] 2> 22912 DEBUG
>> (AutoscalingActionExecutor-49-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.ScheduledTriggers -- processing
>> actions for {
>> [junit4] 2> "id":"215c6a28112b6Tztlufkk2v8h7oh4p3og9272t",
>> [junit4] 2> "source":"node_lost_trigger",
>> [junit4] 2> "eventTime":586892827497142,
>> [junit4] 2> "eventType":"NODELOST",
>> [junit4] 2> "properties":{
>> [junit4] 2> "eventTimes":[586892827497142],
>> [junit4] 2> "_enqueue_time_":586895836278162,
>> [junit4] 2> "nodeNames":["127.0.0.1:53028_solr"]}}
>> [junit4] 2> 22917 DEBUG
>> (AutoscalingActionExecutor-49-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger:
>> node_lost_trigger after 5000ms
>> [junit4] 2> 22917 DEBUG
>> (AutoscalingActionExecutor-49-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.ScheduledTriggers -- processing took
>> 6 ms for event id=215c6a28112b6Tztlufkk2v8h7oh4p3og9272t
>> [junit4] 2> 22928 INFO (qtp1778631180-70) [n:127.0.0.1:53029_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
>> params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
>> status=0 QTime=7
>> [junit4] 2> 22929 DEBUG (qtp1778631180-68) [n:127.0.0.1:53029_solr ]
>> o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
>> [junit4] 2> 22930 INFO (qtp1778631180-68) [n:127.0.0.1:53029_solr ]
>> o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling
>> params={wt=javabin&version=2} status=0 QTime=12
>> [junit4] 2> 22931 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
>> /autoscaling.json with znode version 4
>> [junit4] 2> 22931 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes:
>> [127.0.0.1:53029_solr]
>> [junit4] 2> 22932 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Processed
>> trigger updates upto znodeVersion 4
>> [junit4] 2> 22932 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeAdded markers
>> [junit4] 2> 22933 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 4, lastZnodeVersion 4
>> [junit4] 2> 24933 INFO
>> (TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[7E797DEAF831E61F]) [
>> ] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
>> [junit4] 2> 24941 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.SolrTestCaseJ4 ###Starting
>> testContinueTriggersOnOverseerRestart
>> [junit4] 2> 24943 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode
>> version 5
>> [junit4] 2> 24944 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
>> 2017-11-22T05:27:37+08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
>> [junit4] 2> 24945 DEBUG
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing
>> /autoscaling.json with znode version 5
>> [junit4] 2> 24945 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Processed
>> trigger updates upto znodeVersion 5
>> [junit4] 2> 24946 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
>> [junit4] 2> 24946 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.session No SessionScavenger set, using defaults
>> [junit4] 2> 24946 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.session Scavenging every 600000ms
>> [junit4] 2> 24947 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.h.ContextHandler Started
>> o.e.j.s.ServletContextHandler@338dbf4b{/solr,null,AVAILABLE}
>> [junit4] 2> 24948 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.AbstractConnector Started
>> ServerConnector@12a9a774{HTTP/1.1,[http/1.1]}{127.0.0.1:53065}
>> [junit4] 2> 24948 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.e.j.s.Server Started @28387ms
>> [junit4] 2> 24948 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
>> hostPort=53065}
>> [junit4] 2> 24948 ERROR
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir.
>> Logging may be missing or incomplete.
>> [junit4] 2> 24948 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
>> version 8.0.0
>> [junit4] 2> 24949 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode
>> on port null
>> [junit4] 2> 24949 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
>> [junit4] 2> 24949 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
>> 2018-01-25T13:19:38.902Z
>> [junit4] 2> 24950 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeLost markers
>> [junit4] 2> 24951 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old
>> nodeAdded markers
>> [junit4] 2> 24951 DEBUG
>> (OverseerAutoScalingTriggerThread-99410665167454214-127.0.0.1:53029_solr-n_0000000000)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.a.OverseerTriggerThread Current
>> znodeVersion 5, lastZnodeVersion 5
>> [junit4] 2> 24952 INFO (zkConnectionManagerCallback-38-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 24953 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
>> [junit4] 2> 24964 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53024/solr
>> [junit4] 2> 24967 INFO (zkConnectionManagerCallback-42-thread-1) [ ]
>> o.a.s.c.c.ConnectionManager zkClient has connected
>> [junit4] 2> 24971 INFO
>> (zkConnectionManagerCallback-44-thread-1-processing-n:127.0.0.1:53065_solr)
>> [n:127.0.0.1:53065_solr ] o.a.s.c.c.ConnectionManager zkClient has
>> connected
>> [junit4] 2> 24984 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.c.c.ZkStateReader Updated live nodes
>> from ZooKeeper... (0) -> (1)
>> [junit4] 2> 24988 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.c.Overseer Overseer (id=null) closing
>> [junit4] 2> 24992 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.c.ZkController Register node as live in
>> ZooKeeper:/live_nodes/127.0.0.1:53065_solr
>> [junit4] 2> 24993 INFO
>> (zkCallback-25-thread-1-processing-n:127.0.0.1:53029_solr)
>> [n:127.0.0.1:53029_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (1) -> (2)
>> [junit4] 2> 24993 INFO (zkCallback-35-thread-1) [ ]
>> o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
>> [junit4] 2> 24994 INFO
>> (zkCallback-43-thread-1-processing-n:127.0.0.1:53065_solr)
>> [n:127.0.0.1:53065_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
>> ZooKeeper... (1) -> (2)
>> [junit4] 2> 25107 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53065.solr.node' (registry 'solr.node') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 25123 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53065.solr.jvm' (registry 'solr.jvm') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 25123 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
>> 'solr_53065.solr.jetty' (registry 'solr.jetty') enabled at server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@752cda5c
>> [junit4] 2> 25125 INFO
>> (TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[7E797DEAF831E61F])
>> [n:127.0.0.1:53065_solr ] o.a
>>
>> [...truncated too long message...]
>>
>> pache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
>> [junit4] > at
>> org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
>> [junit4] > at
>> org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$231/1095815815.run(Unknown
>> Source)
>> [junit4] > at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> [junit4] > at
>> java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> [junit4] > at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
>> [junit4] > at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$114/259134832.run(Unknown
>> Source)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F]:0)Throwable #2:
>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
>> threads that couldn't be terminated:
>> [junit4] > 1) Thread[id=25489,
>> name=jetty-launcher-5573-thread-2-SendThread(127.0.0.1:63752),
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at java.lang.Thread.sleep(Native Method)
>> [junit4] > at
>> org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
>> [junit4] > at
>> org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
>> [junit4] > at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
>> [junit4] > 2) Thread[id=25523, name=zkCallback-5597-thread-4,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > 3) Thread[id=25493,
>> name=zkConnectionManagerCallback-5598-thread-1, state=WAITING,
>> group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>> [junit4] > at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> [junit4] > at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > 4) Thread[id=25495, name=zkCallback-5597-thread-1,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > 5) Thread[id=25522, name=zkCallback-5597-thread-3,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > 6) Thread[id=25524, name=zkCallback-5597-thread-5,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > 7) Thread[id=25521, name=zkCallback-5597-thread-2,
>> state=TIMED_WAITING, group=TGRP-AutoAddReplicasPlanActionTest]
>> [junit4] > at sun.misc.Unsafe.park(Native Method)
>> [junit4] > at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>> [junit4] > at
>> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>> [junit4] > at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> [junit4] > at java.lang.Thread.run(Thread.java:748)
>> [junit4] > at
>> __randomizedtesting.SeedInfo.seed([7E797DEAF831E61F]:0)
>> [junit4] Completed [561/768 (4!)] on J1 in 24.26s, 1 test, 3 errors <<<
>> FAILURES!
>>
>> [...truncated 37138 lines...]
>> -ecj-javadoc-lint-tests:
>> [mkdir] Created dir:
>> /var/folders/qg/h2dfw5s161s51l2bn79mrb7r0000gn/T/ecj1722876386
>> [ecj-lint] Compiling 19 source files to
>> /var/folders/qg/h2dfw5s161s51l2bn79mrb7r0000gn/T/ecj1722876386
>> [ecj-lint] ----------
>> [ecj-lint] 1. ERROR in
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/spatial3d/src/test/org/apache/lucene/spatial3d/geom/RandomPlaneTest.java
>> (at line 20)
>> [ecj-lint] import java.util.ArrayList;
>> [ecj-lint] ^^^^^^^^^^^^^^^^^^^
>> [ecj-lint] The import java.util.ArrayList is never used
>> [ecj-lint] ----------
>> [ecj-lint] 2. ERROR in
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/spatial3d/src/test/org/apache/lucene/spatial3d/geom/RandomPlaneTest.java
>> (at line 21)
>> [ecj-lint] import java.util.List;
>> [ecj-lint] ^^^^^^^^^^^^^^
>> [ecj-lint] The import java.util.List is never used
>> [ecj-lint] ----------
>> [ecj-lint] 2 problems (2 errors)
>>
>> BUILD FAILED
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:836: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/build.xml:208: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2281:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2112:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/lucene/common-build.xml:2145:
>> Compile failed; see the compiler error output for details.
>>
>> Total time: 81 minutes 26 seconds
>> Build step 'Invoke Ant' marked build as failure
>> Archiving artifacts
>> [WARNINGS] Skipping publisher since build result is FAILURE
>> Recording test results
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [email protected]
>> For additional commands, e-mail: [email protected]
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
