Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-4.x/587/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=19795, 
name=qtp1220221503-19795, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=19795, name=qtp1220221503-19795, state=RUNNABLE, 
group=TGRP-MultiThreadedOCPTest]
Caused by: java.lang.OutOfMemoryError: unable to create new native thread
        at __randomizedtesting.SeedInfo.seed([A5CEC7F740A5F943]:0)
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:714)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
        at 
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12962 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/init-core-data-001
   [junit4]   2> 4532911 T18117 oas.SolrTestCaseJ4.buildSSLConfig Randomized 
ssl (true) and clientAuth (true)
   [junit4]   2> 4532911 T18117 
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system 
property: /x_u/c
   [junit4]   2> 4532915 T18117 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 4532916 T18117 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4532917 T18118 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 4533017 T18117 oasc.ZkTestServer.run start zk server on 
port:50300
   [junit4]   2> 4533018 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4533021 T18124 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6513411d 
name:ZooKeeperConnection Watcher:127.0.0.1:50300 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4533021 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4533021 T18117 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 4533024 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4533025 T18126 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@4b33727f 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4533025 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4533025 T18117 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 4533027 T18117 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 4533028 T18117 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 4533030 T18117 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 4533031 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 4533032 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 4533034 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 4533034 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 4533136 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4533137 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4533139 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 4533139 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 4533141 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 4533141 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 4533142 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 4533143 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 4533144 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4533145 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 4533146 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4533147 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 4533148 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4533149 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4533150 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4533150 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 4533152 T18117 oasc.AbstractZkTestCase.putConfig put 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 4533152 T18117 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 4533154 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4533155 T18128 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@14e99d17 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4533156 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4533982 T18117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4533987 T18117 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 4533988 T18117 oejs.AbstractConnector.doStart Started 
[email protected]:62879
   [junit4]   2> 4533990 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 4533991 T18117 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 4533991 T18117 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002
   [junit4]   2> 4533991 T18117 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/'
   [junit4]   2> 4534021 T18117 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/solr.xml
   [junit4]   2> 4534072 T18117 oasc.CoreContainer.<init> New CoreContainer 
1573121967
   [junit4]   2> 4534072 T18117 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/]
   [junit4]   2> 4534073 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 4534073 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 4534074 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 4534074 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4534074 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 4534074 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4534075 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 4534075 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 4534075 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 4534077 T18117 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4534079 T18117 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4534079 T18117 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4534079 T18117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4534079 T18117 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:50300/solr
   [junit4]   2> 4534080 T18117 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 4534080 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4534082 T18139 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c4952a2 
name:ZooKeeperConnection Watcher:127.0.0.1:50300 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4534082 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4534083 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4534084 T18141 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@647ed223 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4534084 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4534085 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 4534087 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 4534089 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 4534091 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 4534092 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 4534095 T18117 oascc.SolrZkClient.makePath makePath: 
/live_nodes
   [junit4]   2> 4534096 T18117 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62879_x_u%2Fc
   [junit4]   2> 4534096 T18117 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:62879_x_u%2Fc
   [junit4]   2> 4534098 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 4534099 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 4534101 T18117 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:62879_x_u%2Fc
   [junit4]   2> 4534101 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 4534103 T18117 oasc.Overseer.start Overseer 
(id=92192000302776324-127.0.0.1:62879_x_u%2Fc-n_0000000000) starting
   [junit4]   2> 4534104 T18117 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 4534109 T18143 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 4534110 T18117 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 4534111 T18117 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 4534112 T18117 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4534113 T18142 oasc.Overseer$ClusterStateUpdater.run Starting 
to work on the main queue
   [junit4]   2> 4534117 T18144 oasc.ZkController.publish publishing 
core=collection1 state=down collection=control_collection
   [junit4]   2> 4534117 T18144 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4534118 T18144 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 4534118 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4534119 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4534120 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"https://127.0.0.1:62879/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:62879_x_u%2Fc",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 4534120 T18142 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
control_collection with shards [shard1]
   [junit4]   2> 4534120 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 4534121 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4534122 T18145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4535119 T18144 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for collection1
   [junit4]   2> 4535120 T18144 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:control_collection
   [junit4]   2> 4535120 T18144 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 4535120 T18144 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 4535121 T18144 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 4535121 T18144 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/collection1/'
   [junit4]   2> 4535123 T18144 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 4535124 T18144 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/collection1/lib/classes/'
 to classloader
   [junit4]   2> 4535125 T18144 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/collection1/lib/README'
 to classloader
   [junit4]   2> 4535185 T18144 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 4535230 T18144 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 4535332 T18144 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 4535342 T18144 oass.IndexSchema.readSchema [collection1] 
Schema name=test
   [junit4]   2> 4535760 T18144 oass.ByteField.init WARN ByteField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4535761 T18144 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4535761 T18144 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4535774 T18144 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 4535777 T18144 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4535787 T18144 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4535791 T18144 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4535795 T18144 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4535796 T18144 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4535796 T18144 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4535796 T18144 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4535797 T18144 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4535797 T18144 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4535797 T18144 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection control_collection
   [junit4]   2> 4535798 T18144 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4535798 T18144 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-002/collection1/,
 
dataDir=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-001/control/data/
   [junit4]   2> 4535798 T18144 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5d930dd2
   [junit4]   2> 4535799 T18144 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-001/control/data
   [junit4]   2> 4535799 T18144 oasc.SolrCore.getNewIndexDir New index 
directory detected: old=null 
new=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-001/control/data/index/
   [junit4]   2> 4535799 T18144 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-001/control/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 4535800 T18144 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-001/control/data/index
   [junit4]   2> 4535800 T18144 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7360249940013058]
   [junit4]   2> 4535801 T18144 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@6ee92840 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@443c238d),segFN=segments_1,generation=1}
   [junit4]   2> 4535801 T18144 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4535805 T18144 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4535805 T18144 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 4535806 T18144 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 4535806 T18144 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4535806 T18144 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 4535806 T18144 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4535807 T18144 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4535807 T18144 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 4535807 T18144 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4535808 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 4535808 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 4535809 T18144 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 4535809 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 4535809 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 4535810 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 4535810 T18144 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 4535829 T18144 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4535834 T18144 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 4535834 T18144 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 4535835 T18144 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=0.943359375, 
floorSegmentMB=0.845703125, forceMergeDeletesPctAllowed=13.190674733804611, 
segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4535835 T18144 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@6ee92840 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@443c238d),segFN=segments_1,generation=1}
   [junit4]   2> 4535836 T18144 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4535836 T18144 oass.SolrIndexSearcher.<init> Opening 
Searcher@4c57a272[collection1] main
   [junit4]   2> 4535836 T18144 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 4535837 T18144 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 4535837 T18144 oasr.ManagedResourceStorage.newStorageIO 
Setting up ZooKeeper-based storage for the RestManager with znodeBase: 
/configs/conf1
   [junit4]   2> 4535838 T18144 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4535838 T18144 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 4535838 T18144 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4535839 T18144 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4535839 T18144 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4535840 T18144 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 4535841 T18144 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4535841 T18144 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4535842 T18144 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 4535844 T18146 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@4c57a272[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4535846 T18144 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 4535847 T18149 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:62879/x_u/c 
collection:control_collection shard:shard1
   [junit4]   2> 4535847 T18117 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0
   [junit4]   2> 4535847 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 4535847 T18149 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4535851 T18149 
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for 
shard shard1
   [junit4]   2> 4535852 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4535853 T18149 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 4535853 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4535853 T18149 
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try 
and sync
   [junit4]   2> 4535854 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> ASYNC  NEW_CORE C1885 name=collection1 
org.apache.solr.core.SolrCore@58ae62e8 
url=https://127.0.0.1:62879/x_u/c/collection1 node=127.0.0.1:62879_x_u%2Fc 
C1885_STATE=coll:control_collection core:collection1 props:{state=down, 
base_url=https://127.0.0.1:62879/x_u/c, core=collection1, 
node_name=127.0.0.1:62879_x_u%2Fc}
   [junit4]   2> 4535854 T18149 C1885 P62879 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:62879/x_u/c/collection1/
   [junit4]   2> 4535854 T18151 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@13eecff8 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4535854 T18149 C1885 P62879 oasc.SyncStrategy.syncReplicas 
Sync Success - now sync replicas to me
   [junit4]   2> 4535854 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4535855 T18149 C1885 P62879 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:62879/x_u/c/collection1/ has no replicas
   [junit4]   2> 4535855 T18149 
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: 
https://127.0.0.1:62879/x_u/c/collection1/ shard1
   [junit4]   2> 4535855 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4535856 T18117 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4535856 T18145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4535856 T18149 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 4535857 T18117 oasc.ChaosMonkey.monkeyLog monkey: init - 
expire sessions:false cause connection loss:false
   [junit4]   2> 4535859 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4535860 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4535862 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4535963 T18145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4535963 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4536012 T18149 oasc.ZkController.register We are 
https://127.0.0.1:62879/x_u/c/collection1/ and leader is 
https://127.0.0.1:62879/x_u/c/collection1/
   [junit4]   2> 4536013 T18149 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:62879/x_u/c
   [junit4]   2> 4536013 T18149 oasc.ZkController.checkRecovery I am the 
leader, no recovery necessary
   [junit4]   2> 4536013 T18149 oasc.ZkController.publish publishing 
core=collection1 state=active collection=control_collection
   [junit4]   2> 4536013 T18149 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4536014 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4536014 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4536014 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4536014 T18149 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4536016 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4536016 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"https://127.0.0.1:62879/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:62879_x_u%2Fc",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node1"}
   [junit4]   2> 4536018 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4536119 T18154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4536119 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4536968 T18117 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 4536970 T18117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4536974 T18117 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 4536975 T18117 oejs.AbstractConnector.doStart Started 
[email protected]:14436
   [junit4]   2> 4536977 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 4536978 T18117 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 4536978 T18117 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003
   [junit4]   2> 4536978 T18117 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/'
   [junit4]   2> 4537008 T18117 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/solr.xml
   [junit4]   2> 4537074 T18117 oasc.CoreContainer.<init> New CoreContainer 
1254036488
   [junit4]   2> 4537075 T18117 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/]
   [junit4]   2> 4537076 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 4537077 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 4537077 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 4537077 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4537078 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 4537078 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4537078 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 4537079 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 4537079 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 4537082 T18117 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4537084 T18117 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4537084 T18117 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4537085 T18117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4537085 T18117 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:50300/solr
   [junit4]   2> 4537085 T18117 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 4537086 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4537088 T18165 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@29b46f03 
name:ZooKeeperConnection Watcher:127.0.0.1:50300 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4537088 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4537089 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4537090 T18167 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@24ec1aa0 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4537090 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4537095 T18117 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4538097 T18117 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14436_x_u%2Fc
   [junit4]   2> 4538098 T18117 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:14436_x_u%2Fc
   [junit4]   2> 4538100 T18154 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 4538100 T18168 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 4538100 T18152 oascc.ZkStateReader$3.process Updating live 
nodes... (2)
   [junit4]   2> 4538106 T18169 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 4538106 T18169 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4538107 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4538107 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4538107 T18169 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 4538107 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4538108 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4538109 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"https://127.0.0.1:14436/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:14436_x_u%2Fc",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 4538109 T18142 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2]
   [junit4]   2> 4538109 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard2
   [junit4]   2> 4538111 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4538111 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4538111 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4538111 T18153 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539109 T18169 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for collection1
   [junit4]   2> 4539110 T18169 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 4539111 T18169 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 4539111 T18169 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 4539111 T18169 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 4539112 T18169 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/'
   [junit4]   2> 4539114 T18169 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/lib/classes/'
 to classloader
   [junit4]   2> 4539115 T18169 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 4539115 T18169 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/lib/README'
 to classloader
   [junit4]   2> 4539175 T18169 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 4539220 T18169 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 4539322 T18169 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 4539332 T18169 oass.IndexSchema.readSchema [collection1] 
Schema name=test
   [junit4]   2> 4539749 T18169 oass.ByteField.init WARN ByteField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4539750 T18169 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4539751 T18169 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4539763 T18169 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 4539766 T18169 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4539776 T18169 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4539781 T18169 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4539784 T18169 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4539785 T18169 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4539785 T18169 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4539785 T18169 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4539786 T18169 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4539786 T18169 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4539787 T18169 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 4539787 T18169 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4539787 T18169 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/,
 
dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/data/
   [junit4]   2> 4539788 T18169 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5d930dd2
   [junit4]   2> 4539788 T18169 oasc.CachingDirectoryFactory.get return new 
directory for 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/data
   [junit4]   2> 4539789 T18169 oasc.SolrCore.getNewIndexDir New index 
directory detected: old=null 
new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/data/index/
   [junit4]   2> 4539789 T18169 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 4539789 T18169 oasc.CachingDirectoryFactory.get return new 
directory for 
../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-003/collection1/data/index
   [junit4]   2> 4539790 T18169 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7360249940013058]
   [junit4]   2> 4539791 T18169 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@46d081d0 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f27c866),segFN=segments_1,generation=1}
   [junit4]   2> 4539791 T18169 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4539795 T18169 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4539796 T18169 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 4539796 T18169 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 4539796 T18169 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4539797 T18169 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 4539797 T18169 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4539797 T18169 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4539798 T18169 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 4539798 T18169 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4539798 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 4539799 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 4539799 T18169 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 4539800 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 4539800 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 4539801 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 4539801 T18169 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 4539820 T18169 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4539825 T18169 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 4539825 T18169 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 4539826 T18169 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=0.943359375, 
floorSegmentMB=0.845703125, forceMergeDeletesPctAllowed=13.190674733804611, 
segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4539826 T18169 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@46d081d0 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f27c866),segFN=segments_1,generation=1}
   [junit4]   2> 4539827 T18169 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4539827 T18169 oass.SolrIndexSearcher.<init> Opening 
Searcher@702b9aee[collection1] main
   [junit4]   2> 4539827 T18169 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 4539828 T18169 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 4539828 T18169 oasr.ManagedResourceStorage.newStorageIO 
Setting up ZooKeeper-based storage for the RestManager with znodeBase: 
/configs/conf1
   [junit4]   2> 4539829 T18169 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4539829 T18169 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 4539829 T18169 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4539830 T18169 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4539830 T18169 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4539830 T18169 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 4539831 T18169 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 4539834 T18170 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@702b9aee[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4539836 T18169 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 4539837 T18173 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:14436/x_u/c collection:collection1 
shard:shard2
   [junit4]   2> 4539838 T18117 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0
   [junit4]   2> 4539838 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 4539838 T18173 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard2/election
   [junit4]   2> 4539842 T18173 
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for 
shard shard2
   [junit4]   2> 4539843 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4539844 T18173 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 4539844 T18173 
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try 
and sync
   [junit4]   2> ASYNC  NEW_CORE C1886 name=collection1 
org.apache.solr.core.SolrCore@2f654726 
url=https://127.0.0.1:14436/x_u/c/collection1 node=127.0.0.1:14436_x_u%2Fc 
C1886_STATE=coll:collection1 core:collection1 props:{state=down, 
base_url=https://127.0.0.1:14436/x_u/c, core=collection1, 
node_name=127.0.0.1:14436_x_u%2Fc}
   [junit4]   2> 4539844 T18173 C1886 P14436 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:14436/x_u/c/collection1/
   [junit4]   2> 4539844 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4539844 T18173 C1886 P14436 oasc.SyncStrategy.syncReplicas 
Sync Success - now sync replicas to me
   [junit4]   2> 4539845 T18173 C1886 P14436 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:14436/x_u/c/collection1/ has no replicas
   [junit4]   2> 4539845 T18173 
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: 
https://127.0.0.1:14436/x_u/c/collection1/ shard2
   [junit4]   2> 4539845 T18173 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard2
   [junit4]   2> 4539846 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4539847 T18153 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539847 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539847 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539849 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4539850 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4539852 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4539954 T18153 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539954 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4539954 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4540002 T18173 oasc.ZkController.register We are 
https://127.0.0.1:14436/x_u/c/collection1/ and leader is 
https://127.0.0.1:14436/x_u/c/collection1/
   [junit4]   2> 4540003 T18173 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:14436/x_u/c
   [junit4]   2> 4540003 T18173 oasc.ZkController.checkRecovery I am the 
leader, no recovery necessary
   [junit4]   2> 4540003 T18173 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 4540003 T18173 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4540004 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4540004 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4540004 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4540004 T18173 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4540006 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4540006 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"https://127.0.0.1:14436/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:14436_x_u%2Fc",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node1"}
   [junit4]   2> 4540008 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4540109 T18145 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4540109 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4540109 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 4540961 T18117 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 4540962 T18117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4540966 T18117 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 4540967 T18117 oejs.AbstractConnector.doStart Started 
[email protected]:65073
   [junit4]   2> 4540969 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 4540970 T18117 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 4540970 T18117 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004
   [junit4]   2> 4540970 T18117 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/'
   [junit4]   2> 4540999 T18117 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/solr.xml
   [junit4]   2> 4541049 T18117 oasc.CoreContainer.<init> New CoreContainer 
995389302
   [junit4]   2> 4541050 T18117 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/]
   [junit4]   2> 4541051 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 4541051 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 4541051 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 4541051 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4541051 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 4541052 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4541052 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 4541052 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 4541052 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 4541054 T18117 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4541056 T18117 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4541056 T18117 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4541056 T18117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4541057 T18117 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:50300/solr
   [junit4]   2> 4541057 T18117 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 4541058 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4541059 T18184 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@49bfda84 
name:ZooKeeperConnection Watcher:127.0.0.1:50300 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4541059 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4541061 T18117 oascc.ConnectionManager.waitForConnected 
Waiting for client to connect to ZooKeeper
   [junit4]   2> 4541062 T18186 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@6d2e50c7 
name:ZooKeeperConnection Watcher:127.0.0.1:50300/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4541062 T18117 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 4541066 T18117 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 4542069 T18117 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65073_x_u%2Fc
   [junit4]   2> 4542070 T18117 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:65073_x_u%2Fc
   [junit4]   2> 4542072 T18152 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 4542072 T18145 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 4542072 T18187 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 4542072 T18168 oascc.ZkStateReader$3.process Updating live 
nodes... (3)
   [junit4]   2> 4542078 T18188 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 4542079 T18188 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4542079 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4542079 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4542079 T18188 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 4542079 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4542080 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4542081 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "base_url":"https://127.0.0.1:65073/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:65073_x_u%2Fc",
   [junit4]   2>          "shard":null,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":null}
   [junit4]   2> 4542081 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Collection already exists with numShards=2
   [junit4]   2> 4542081 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 4542083 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4542083 T18154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4542083 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4542083 T18187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4542083 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543080 T18188 oasc.ZkController.waitForShardId waiting to 
find shard id in clusterstate for collection1
   [junit4]   2> 4543081 T18188 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 4543081 T18188 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 4543081 T18188 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 4543082 T18188 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 4543082 T18188 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/'
   [junit4]   2> 4543084 T18188 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/lib/classes/'
 to classloader
   [junit4]   2> 4543085 T18188 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 4543085 T18188 oasc.SolrResourceLoader.replaceClassLoader 
Adding 
'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/lib/README'
 to classloader
   [junit4]   2> 4543145 T18188 oasc.SolrConfig.<init> Using Lucene 
MatchVersion: LUCENE_4_10
   [junit4]   2> 4543205 T18188 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 4543307 T18188 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 4543317 T18188 oass.IndexSchema.readSchema [collection1] 
Schema name=test
   [junit4]   2> 4543731 T18188 oass.ByteField.init WARN ByteField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4543731 T18188 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 4543732 T18188 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4543744 T18188 oass.IndexSchema.readSchema default search 
field in schema is text
   [junit4]   2> 4543747 T18188 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4543758 T18188 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4543762 T18188 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 4543765 T18188 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4543766 T18188 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4543766 T18188 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4543767 T18188 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4543767 T18188 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 4543768 T18188 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 4543768 T18188 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 4543768 T18188 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4543768 T18188 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/,
 
dataDir=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/data/
   [junit4]   2> 4543769 T18188 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5d930dd2
   [junit4]   2> 4543770 T18188 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/data
   [junit4]   2> 4543770 T18188 oasc.SolrCore.getNewIndexDir New index 
directory detected: old=null 
new=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/data/index/
   [junit4]   2> 4543770 T18188 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 4543770 T18188 oasc.CachingDirectoryFactory.get return new 
directory for 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-004/collection1/data/index
   [junit4]   2> 4543771 T18188 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: 
[LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, 
maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, 
calibrateSizeByDeletes=true, maxMergeDocs=2147483647, 
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7360249940013058]
   [junit4]   2> 4543772 T18188 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@24ebfebe 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50ea915e),segFN=segments_1,generation=1}
   [junit4]   2> 4543772 T18188 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4543776 T18188 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4543777 T18188 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 4543777 T18188 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"dedupe"
   [junit4]   2> 4543777 T18188 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4543777 T18188 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"stored_sig"
   [junit4]   2> 4543778 T18188 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4543778 T18188 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4543779 T18188 oasup.UpdateRequestProcessorChain.init 
inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 4543779 T18188 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4543779 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 4543780 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 4543780 T18188 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 4543780 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 4543781 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 4543781 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 4543782 T18188 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 4543804 T18188 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4543809 T18188 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 4543809 T18188 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 4543810 T18188 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=0.943359375, 
floorSegmentMB=0.845703125, forceMergeDeletesPctAllowed=13.190674733804611, 
segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4543810 T18188 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@24ebfebe 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50ea915e),segFN=segments_1,generation=1}
   [junit4]   2> 4543811 T18188 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 4543811 T18188 oass.SolrIndexSearcher.<init> Opening 
Searcher@7a3fc2e[collection1] main
   [junit4]   2> 4543811 T18188 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 4543812 T18188 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 4543812 T18188 oasr.ManagedResourceStorage.newStorageIO 
Setting up ZooKeeper-based storage for the RestManager with znodeBase: 
/configs/conf1
   [junit4]   2> 4543813 T18188 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4543813 T18188 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 4543813 T18188 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4543814 T18188 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes 
from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4543815 T18188 oasr.ManagedResourceStorage.load Loaded 
LinkedHashMap at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4543815 T18188 oasr.ManagedResource.reloadFromStorage Loaded 
initArgs {} for /rest/managed
   [junit4]   2> 4543815 T18188 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 4543819 T18189 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@7a3fc2e[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4543821 T18188 oasc.CoreContainer.registerCore registering 
core: collection1
   [junit4]   2> 4543822 T18192 oasc.ZkController.register Register replica - 
core:collection1 address:https://127.0.0.1:65073/x_u/c collection:collection1 
shard:shard1
   [junit4]   2> 4543822 T18117 oass.SolrDispatchFilter.init 
user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0
   [junit4]   2> 4543823 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 4543823 T18192 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leader_elect/shard1/election
   [junit4]   2> 4543827 T18192 
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for 
shard shard1
   [junit4]   2> 4543829 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543829 T18192 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 4543829 T18192 
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try 
and sync
   [junit4]   2> ASYNC  NEW_CORE C1887 name=collection1 
org.apache.solr.core.SolrCore@17ac8cf0 
url=https://127.0.0.1:65073/x_u/c/collection1 node=127.0.0.1:65073_x_u%2Fc 
C1887_STATE=coll:collection1 core:collection1 props:{state=down, 
base_url=https://127.0.0.1:65073/x_u/c, core=collection1, 
node_name=127.0.0.1:65073_x_u%2Fc}
   [junit4]   2> 4543830 T18192 C1887 P65073 oasc.SyncStrategy.sync Sync 
replicas to https://127.0.0.1:65073/x_u/c/collection1/
   [junit4]   2> 4543830 T18192 C1887 P65073 oasc.SyncStrategy.syncReplicas 
Sync Success - now sync replicas to me
   [junit4]   2> 4543830 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4543830 T18192 C1887 P65073 oasc.SyncStrategy.syncToMe 
https://127.0.0.1:65073/x_u/c/collection1/ has no replicas
   [junit4]   2> 4543831 T18192 
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: 
https://127.0.0.1:65073/x_u/c/collection1/ shard1
   [junit4]   2> 4543831 T18192 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/leaders/shard1
   [junit4]   2> 4543832 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543833 T18154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543833 T18187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543833 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543833 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543836 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4543837 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543939 T18187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543939 T18154 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543939 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543939 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4543987 T18192 oasc.ZkController.register We are 
https://127.0.0.1:65073/x_u/c/collection1/ and leader is 
https://127.0.0.1:65073/x_u/c/collection1/
   [junit4]   2> 4543988 T18192 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=https://127.0.0.1:65073/x_u/c
   [junit4]   2> 4543988 T18192 oasc.ZkController.checkRecovery I am the 
leader, no recovery necessary
   [junit4]   2> 4543988 T18192 oasc.ZkController.publish publishing 
core=collection1 state=active collection=collection1
   [junit4]   2> 4543988 T18192 oasc.ZkController.publish numShards not found 
on descriptor - reading it from system property
   [junit4]   2> 4543989 T18154 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543989 T18145 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543989 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4543989 T18192 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4543990 T18142 oascc.ZkStateReader.updateClusterState Updating 
cloud state from ZooKeeper... 
   [junit4]   2> 4543991 T18142 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "base_url":"https://127.0.0.1:65073/x_u/c";,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "node_name":"127.0.0.1:65073_x_u%2Fc",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "core_node_name":"core_node2"}
   [junit4]   2> 4543992 T18153 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 4544095 T18153 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4544095 T18168 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4544095 T18187 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4544095 T18152 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 4544972 T18117 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 4544973 T18117 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4544977 T18117 oejus.SslContextFactory.doStart Enabled 
Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, 
TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 4544978 T18117 oejs.AbstractConnector.doStart Started 
[email protected]:60155
   [junit4]   2> 4544981 T18117 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 4544981 T18117 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 4544981 T18117 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-005
   [junit4]   2> 4544981 T18117 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-005/'
   [junit4]   2> 4545011 T18117 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-005/solr.xml
   [junit4]   2> 4545062 T18117 oasc.CoreContainer.<init> New CoreContainer 
1828985004
   [junit4]   2> 4545062 T18117 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001/tempDir-005/]
   [junit4]   2> 4545063 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 4545063 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 4545063 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 4545064 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4545064 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 4545064 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4545064 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 4545065 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 4545065 T18117 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 4545067 T18117 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4545068 T18117 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4545069 T18117 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4545069 T18117 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4545069 T18117 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:50300/solr
   [junit4]   2> 4545069 T18117 oasc.ZkController.checkChrootPath zkHost 
includes chroot
   [junit4]   2> 4545070 T18117

[...truncated too long message...]

p1220221503-19795, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: unable to create new 
native thread
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([A5CEC7F740A5F943]:0)
   [junit4]    >        at java.lang.Thread.start0(Native Method)
   [junit4]    >        at java.lang.Thread.start(Thread.java:714)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
   [junit4]    >        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
   [junit4]    >        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)Throwable #3: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=18137, name=qtp1142230258-18137, state=RUNNABLE, 
group=TGRP-MultiThreadedOCPTest]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: unable to create new 
native thread
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([A5CEC7F740A5F943]:0)
   [junit4]    >        at java.lang.Thread.start0(Native Method)
   [junit4]    >        at java.lang.Thread.start(Thread.java:714)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
   [junit4]    >        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
   [junit4]    >        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 8268623 T18117 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-A5CEC7F740A5F943-001
   [junit4]   2> 3735718 T18116 ccr.ThreadLeakControl.checkThreadLeaks WARNING 
Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=DefaultSimilarity, locale=sl_SI, timezone=America/Cambridge_Bay
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 
(64-bit)/cpus=16,threads=1,free=231964088,total=468189184
   [junit4]   2> NOTE: All tests run in this JVM: [ZkCLITest, UpdateParamsTest, 
TestManagedSynonymFilterFactory, TestSolr4Spatial, JSONWriterTest, 
HdfsWriteToMultipleCollectionsTest, DistributedIntervalFacetingTest, 
ClusterStateTest, ClusterStateUpdateTest, TestNumberUtils, ReturnFieldsTest, 
TestStandardQParsers, TestShortCircuitedRequests, CoreAdminHandlerTest, 
AliasIntegrationTest, SpellPossibilityIteratorTest, SolrXmlInZkTest, 
QueryEqualityTest, MBeansHandlerTest, TestUtils, HdfsUnloadDistributedZkTest, 
StressHdfsTest, TestSolrDeletionPolicy2, UUIDFieldTest, 
DocExpirationUpdateProcessorFactoryTest, TestCollapseQParserPlugin, 
LeaderElectionTest, TestFileDictionaryLookup, RAMDirectoryFactoryTest, 
TestSolrXMLSerializer, BasicDistributedZkTest, RequiredFieldsTest, 
TestChildDocTransformer, TestFastOutputStream, ExternalFileFieldSortTest, 
FieldMutatingUpdateProcessorTest, TestBinaryResponseWriter, RecoveryZkTest, 
TermsComponentTest, TestRequestStatusCollectionAPI, AsyncMigrateRouteKeyTest, 
BadCopyFieldTest, TestFieldResource, SpellCheckComponentTest, BadComponentTest, 
DirectUpdateHandlerTest, TestDFRSimilarityFactory, RegexBoostProcessorTest, 
HdfsSyncSliceTest, OverseerTest, ShardRoutingTest, CursorPagingTest, 
TestRandomMergePolicy, TestSort, TestSolrCoreProperties, 
SolrCmdDistributorTest, QueryResultKeyTest, MinimalSchemaTest, 
TestClassNameShortening, TestPartialUpdateDeduplication, TestRestManager, 
PrimUtilsTest, ParsingFieldUpdateProcessorsTest, 
UUIDUpdateProcessorFallbackTest, ResourceLoaderTest, TestSearchPerf, 
TestFaceting, TestHighlightDedupGrouping, MergeStrategyTest, 
HdfsChaosMonkeySafeLeaderTest, TestFoldingMultitermQuery, 
TestSurroundQueryParser, TestTolerantSearch, 
TestLMJelinekMercerSimilarityFactory, DirectSolrSpellCheckerTest, 
TestComponentsName, CollectionsAPIAsyncDistributedZkTest, 
TestFieldTypeCollectionResource, ReplicationFactorTest, 
TestDynamicFieldResource, StatelessScriptUpdateProcessorFactoryTest, 
TestSearcherReuse, DocValuesMultiTest, DistribDocExpirationUpdateProcessorTest, 
TestBM25SimilarityFactory, TestDistributedSearch, 
TestComplexPhraseQParserPlugin, TestSolrIndexConfig, PingRequestHandlerTest, 
HdfsCollectionsAPIDistributedZkTest, TestConfig, TestReloadAndDeleteDocs, 
SliceStateTest, TestSolrXmlPersistence, TestDocSet, 
TestWordDelimiterFilterFactory, TestManagedSchema, 
CurrencyFieldOpenExchangeTest, TestLuceneMatchVersion, TestManagedResource, 
LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, 
TestRandomDVFaceting, TestRecovery, TestHashPartitioner, 
DistributedSpellCheckComponentTest, ZkControllerTest, TestRealTimeGet, 
TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, 
TestRangeQuery, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, 
TestGroupingSearch, PeerSyncTest, BadIndexSchemaTest, TestFiltering, 
TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, 
OverseerCollectionProcessorTest, HighlighterTest, ShowFileRequestHandlerTest, 
DistributedQueryElevationComponentTest, SolrIndexSplitterTest, 
SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, 
SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, 
SpellCheckCollatorTest, SuggesterFSTTest, SuggesterTSTTest, SuggesterTest, 
TestTrie, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, 
NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, 
SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, 
TestPseudoReturnFields, TestUpdate, DefaultValueUpdateProcessorTest, 
TestRemoteStreaming, DistanceFunctionTest, TestSolrDeletionPolicy1, 
XsltUpdateRequestHandlerTest, CacheHeaderTest, IndexBasedSpellCheckerTest, 
LukeRequestHandlerTest, DisMaxRequestHandlerTest, StandardRequestHandlerTest, 
DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, 
FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, 
PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, 
MoreLikeThisHandlerTest, TestArbitraryIndexDir, FastVectorHighlighterTest, 
IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, IndexSchemaTest, 
TestJmxIntegration, TestCSVResponseWriter, QueryParsingTest, 
TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, 
BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, SearchHandlerTest, 
CoreContainerCoreInitFailuresTest, TestLFUCache, HighlighterConfigTest, 
SOLR749Test, TestQuerySenderListener, CopyFieldTest, ResponseLogComponentTest, 
TestStressRecovery, MultiTermTest, TestBinaryField, TestElisionMultitermQuery, 
TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, 
NotRequiredUniqueKeyTest, TestCharFilters, TestCodecSupport, 
SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, 
TestDefaultSimilarityFactory, TestJmxMonitoredMap, TimeZoneUtilsTest, 
ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, 
PluginInfoTest, TestFastLRUCache, DateMathParserTest, TestSystemIdResolver, 
DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, TestLRUCache, 
TestDocumentBuilder, CircularListTest, TestRTGBase, SolrTestCaseJ4Test, 
TestDistributedMissingSort, TestCollationKeyRangeQueries, AssignTest, 
CustomCollectionTest, DeleteInactiveReplicaTest, DeleteReplicaTest, 
DeleteShardTest, HttpPartitionTest, MigrateRouteKeyTest, MultiThreadedOCPTest]
   [junit4] Completed on J0 in 3736.25s, 1 test, 1 error <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:474:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:447:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/build.xml:45:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/extra-targets.xml:37:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:1299:
 The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-4.x/lucene/common-build.xml:923:
 There were test failures: 411 suites, 1705 tests, 1 error, 51 ignored (9 
assumptions)

Total time: 270 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-4.x #586
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 518100209 bytes
Compression is 0.0%
Took 1 min 23 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to