Build: https://builds.apache.org/job/Lucene-Solr-repro/3203/
[...truncated 42 lines...] [repro] Jenkins log URL: https://builds.apache.org/job/Lucene-Solr-Tests-8.x/161/consoleText [repro] Revision: e02f25d975fb15013875965e5d929ce4a482d528 [repro] Repro line: ant test -Dtestcase=BasicAuthIntegrationTest -Dtests.method=testBasicAuth -Dtests.seed=437A2D177D668CD9 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=th-TH -Dtests.timezone=Europe/Malta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [repro] git rev-parse --abbrev-ref HEAD [repro] git rev-parse HEAD [repro] Initial local git branch/revision: 80d3ac8709c6d93c4e4634dc7c10ef667a029cb1 [repro] git fetch [repro] git checkout e02f25d975fb15013875965e5d929ce4a482d528 [...truncated 2 lines...] [repro] git merge --ff-only [...truncated 1 lines...] [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] BasicAuthIntegrationTest [repro] ant compile-test [...truncated 3576 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.BasicAuthIntegrationTest" -Dtests.showOutput=onerror -Dtests.seed=437A2D177D668CD9 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=th-TH -Dtests.timezone=Europe/Malta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [...truncated 762 lines...] [junit4] 2> ERROR: Solr requires authentication for https://127.0.0.1:44025/solr/admin/info/system. Please supply valid credentials. HTTP code=401 [junit4] 2> [junit4] 2> 32822 ERROR (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.s.BasicAuthIntegrationTest RunExampleTool failed due to: java.lang.NullPointerException; stdout from tool prior to failure: [junit4] 2> 32842 ERROR (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.s.i.BaseCloudSolrClient Request to collection [authCollection] failed due to (401) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:44025/solr/authCollection: Expected mime type application/octet-stream but got text/html. <html> [junit4] 2> <head> [junit4] 2> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> [junit4] 2> <title>Error 401 require authentication</title> [junit4] 2> </head> [junit4] 2> <body><h2>HTTP ERROR 401</h2> [junit4] 2> <p>Problem accessing /solr/authCollection/select. Reason: [junit4] 2> <pre> require authentication</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/> [junit4] 2> [junit4] 2> </body> [junit4] 2> </html> [junit4] 2> , retry=0 commError=false errorCode=401 [junit4] 2> 32842 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.s.i.BaseCloudSolrClient request was not communication error it seems [junit4] 2> 33191 INFO (qtp989159780-54) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.c.S.Request [authCollection_shard2_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:44025/solr/authCollection_shard2_replica_n2/&rows=10&version=2&q=*:*&NOW=1556063444640&isShard=true&wt=javabin} hits=1 status=0 QTime=60 [junit4] 2> 33194 INFO (qtp8830319-189) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.S.Request [authCollection_shard3_replica_n4] webapp=/solr path=/select params={df=text&distrib=false&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:36985/solr/authCollection_shard3_replica_n4/&rows=10&version=2&q=*:*&NOW=1556063444640&isShard=true&wt=javabin} hits=0 status=0 QTime=94 [junit4] 2> 33204 INFO (qtp328445848-38) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.c.S.Request [authCollection_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:46186/solr/authCollection_shard1_replica_n1/&rows=10&version=2&q=*:*&NOW=1556063444640&isShard=true&wt=javabin} hits=0 status=0 QTime=60 [junit4] 2> 33287 INFO (qtp989159780-57) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.c.S.Request [authCollection_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1556063444640&ids=4&isShard=true&shard.url=https://127.0.0.1:44025/solr/authCollection_shard2_replica_n2/&wt=javabin&version=2} status=0 QTime=6 [junit4] 2> 33303 INFO (qtp8830319-185) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.S.Request [authCollection_shard3_replica_n4] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=425 [junit4] 2> 33328 INFO (qtp8830319-187) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [authCollection_shard3_replica_n4] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5 (1631650782996594688)]} 0 3 [junit4] 2> 33355 INFO (qtp8830319-188) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [authCollection_shard3_replica_n4] webapp=/solr path=/update params={_stateVer_=authCollection:8&wt=javabin&version=2}{add=[5 (1631650783025954816)]} 0 2 [junit4] 2> 33374 INFO (qtp328445848-39) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1631650783046926336,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 33374 INFO (qtp989159780-55) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1631650783046926336,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 33374 INFO (qtp328445848-39) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit. [junit4] 2> 33383 INFO (qtp989159780-55) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@41c3fa63 commitCommandVersion:1631650783046926336 [junit4] 2> 33383 INFO (qtp328445848-39) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 33383 INFO (qtp328445848-39) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [authCollection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:36985/solr/authCollection_shard3_replica_n4/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 10 [junit4] 2> 33407 INFO (qtp989159780-55) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cfa9df7[authCollection_shard2_replica_n2] main] [junit4] 2> 33408 INFO (qtp989159780-55) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 33411 INFO (searcherExecutor-65-thread-1-processing-n:127.0.0.1:44025_solr x:authCollection_shard2_replica_n2 c:authCollection s:shard2 r:core_node5) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.c.SolrCore [authCollection_shard2_replica_n2] Registered new searcher Searcher@6cfa9df7[authCollection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(8.1.0):C1:[diagnostics={os=Linux, java.version=1.8.0_191, os.arch=amd64, java.runtime.version=1.8.0_191-b12, source=merge, os.version=4.4.0-137-generic, java.vendor=Oracle Corporation, java.vm.version=25.191-b12, lucene.version=8.1.0, mergeMaxNumSegments=-1, mergeFactor=1, timestamp=1556063444109}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_COMPRESSION}])))} [junit4] 2> 33418 INFO (qtp989159780-55) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [authCollection_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:36985/solr/authCollection_shard3_replica_n4/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 45 [junit4] 2> 33433 INFO (qtp8830319-186) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1631650783108792320,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} [junit4] 2> 33437 INFO (qtp8830319-186) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1d0d5cbc commitCommandVersion:1631650783108792320 [junit4] 2> 33465 INFO (qtp8830319-186) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@5a9b14ce[authCollection_shard3_replica_n4] main] [junit4] 2> 33468 INFO (qtp8830319-186) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 end_commit_flush [junit4] 2> 33473 INFO (searcherExecutor-64-thread-1-processing-n:127.0.0.1:36985_solr x:authCollection_shard3_replica_n4 c:authCollection s:shard3 r:core_node6) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrCore [authCollection_shard3_replica_n4] Registered new searcher Searcher@5a9b14ce[authCollection_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.1.0):C2/1:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=1.8.0_191, java.vm.version=25.191-b12, lucene.version=8.1.0, os.arch=amd64, java.runtime.version=1.8.0_191-b12, source=flush, os.version=4.4.0-137-generic, timestamp=1556063445205}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_COMPRESSION}]:delGen=1)))} [junit4] 2> 33486 INFO (qtp8830319-186) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [authCollection_shard3_replica_n4] webapp=/solr path=/update params={_stateVer_=authCollection:8&commit=true&wt=javabin&version=2}{commit=} 0 127 [junit4] 2> 33532 INFO (qtp328445848-40) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.c.S.Request [authCollection_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=authCollection:8&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:46186/solr/authCollection_shard1_replica_n1/&rows=10&version=2&q=id:5&NOW=1556063445253&isShard=true&wt=javabin} hits=0 status=0 QTime=15 [junit4] 2> 33537 INFO (qtp989159780-56) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.c.S.Request [authCollection_shard2_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=authCollection:8&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:44025/solr/authCollection_shard2_replica_n2/&rows=10&version=2&q=id:5&NOW=1556063445253&isShard=true&wt=javabin} hits=0 status=0 QTime=37 [junit4] 2> 33544 INFO (qtp8830319-185) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.S.Request [authCollection_shard3_replica_n4] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=authCollection:8&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=https://127.0.0.1:36985/solr/authCollection_shard3_replica_n4/&rows=10&version=2&q=id:5&NOW=1556063445253&isShard=true&wt=javabin} hits=1 status=0 QTime=31 [junit4] 2> 33747 ERROR (qtp8830319-189) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.h.RequestHandlerBase org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at null: Expected mime type application/octet-stream but got text/html. <html> [junit4] 2> <head> [junit4] 2> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> [junit4] 2> <title>Error 401 require authentication</title> [junit4] 2> </head> [junit4] 2> <body><h2>HTTP ERROR 401</h2> [junit4] 2> <p>Problem accessing /solr/authCollection_shard3_replica_n4/select. Reason: [junit4] 2> <pre> require authentication</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/> [junit4] 2> [junit4] 2> </body> [junit4] 2> </html> [junit4] 2> [junit4] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.processErrorsAndResponse(Http2SolrClient.java:681) [junit4] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:400) [junit4] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:739) [junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1274) [junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.request(HttpShardHandler.java:227) [junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:188) [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:181) [junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [junit4] 2> at java.lang.Thread.run(Thread.java:748) [junit4] 2> [junit4] 2> 33747 INFO (qtp8830319-189) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.S.Request [authCollection_shard3_replica_n4] webapp=/solr path=/select params={q=id:5&_stateVer_=authCollection:8&wt=javabin&version=2} hits=1 status=401 QTime=256 [junit4] 2> 33753 ERROR (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.s.i.BaseCloudSolrClient Request to collection [authCollection] failed due to (401) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36985/solr/authCollection: Error from server at null: Expected mime type application/octet-stream but got text/html. <html> [junit4] 2> <head> [junit4] 2> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> [junit4] 2> <title>Error 401 require authentication</title> [junit4] 2> </head> [junit4] 2> <body><h2>HTTP ERROR 401</h2> [junit4] 2> <p>Problem accessing /solr/authCollection_shard3_replica_n4/select. Reason: [junit4] 2> <pre> require authentication</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/> [junit4] 2> [junit4] 2> </body> [junit4] 2> </html> [junit4] 2> , retry=0 commError=false errorCode=401 [junit4] 2> 33753 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.s.i.BaseCloudSolrClient request was not communication error it seems [junit4] 2> 33769 INFO (jetty-closer-124-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=770154276 [junit4] 2> 33770 INFO (jetty-closer-124-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:46186_solr [junit4] 2> 33771 INFO (jetty-closer-124-thread-1) [ ] o.a.s.c.ZkController Publish this node as DOWN... [junit4] 2> 33771 INFO (jetty-closer-124-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:46186_solr as DOWN [junit4] 2> 33775 INFO (jetty-closer-124-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=638698748 [junit4] 2> 33775 INFO (jetty-closer-124-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44025_solr [junit4] 2> 33777 INFO (jetty-closer-124-thread-2) [ ] o.a.s.c.ZkController Publish this node as DOWN... [junit4] 2> 33777 INFO (jetty-closer-124-thread-2) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:44025_solr as DOWN [junit4] 2> 33782 INFO (zkCallback-38-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33782 INFO (zkCallback-38-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33782 INFO (zkCallback-38-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33782 INFO (zkCallback-87-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33782 INFO (zkCallback-36-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33782 INFO (zkCallback-36-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33790 INFO (jetty-closer-124-thread-3) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=352706752 [junit4] 2> 33790 INFO (jetty-closer-124-thread-3) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36985_solr [junit4] 2> 33791 INFO (zkCallback-87-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33792 INFO (zkCallback-87-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33793 INFO (jetty-closer-124-thread-3) [ ] o.a.s.c.ZkController Publish this node as DOWN... [junit4] 2> 33793 INFO (jetty-closer-124-thread-3) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:36985_solr as DOWN [junit4] 2> 33802 INFO (zkCallback-87-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33802 INFO (coreCloseExecutor-85-thread-1) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.c.SolrCore [authCollection_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@269cd539 [junit4] 2> 33802 INFO (coreCloseExecutor-85-thread-1) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.authCollection.shard2.replica_n2, tag=269cd539 [junit4] 2> 33802 INFO (coreCloseExecutor-85-thread-1) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6d507a2: rootName = solr_44025, domain = solr.core.authCollection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.authCollection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@234d6201 [junit4] 2> 33854 INFO (coreCloseExecutor-85-thread-1) [n:127.0.0.1:44025_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.authCollection.shard2.leader, tag=269cd539 [junit4] 2> 33880 INFO (coreCloseExecutor-86-thread-1) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.c.SolrCore [authCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@368fd1ea [junit4] 2> 33880 INFO (coreCloseExecutor-86-thread-1) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.authCollection.shard1.replica_n1, tag=368fd1ea [junit4] 2> 33880 INFO (coreCloseExecutor-86-thread-1) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7df7ae67: rootName = solr_46186, domain = solr.core.authCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.authCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@4c50d5a9 [junit4] 2> 33892 INFO (coreCloseExecutor-87-thread-1) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrCore [authCollection_shard3_replica_n4] CLOSING SolrCore org.apache.solr.core.SolrCore@119addcd [junit4] 2> 33892 INFO (coreCloseExecutor-87-thread-1) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.authCollection.shard3.replica_n4, tag=119addcd [junit4] 2> 33892 INFO (coreCloseExecutor-87-thread-1) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@681bf380: rootName = solr_36985, domain = solr.core.authCollection.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.authCollection.shard3.replica_n4 / com.codahale.metrics.MetricRegistry@2dec9345 [junit4] 2> 33902 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 33902 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5424face: rootName = solr_44025, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@157529ae [junit4] 2> 33909 INFO (zkCallback-87-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33909 INFO (zkCallback-38-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33909 INFO (zkCallback-87-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33909 INFO (zkCallback-87-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33909 INFO (zkCallback-87-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33910 INFO (zkCallback-38-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33910 INFO (zkCallback-38-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33910 INFO (zkCallback-36-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33910 INFO (zkCallback-36-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 33925 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 33925 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14f87e4c: rootName = solr_44025, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4737fc6a [junit4] 2> 33940 INFO (coreCloseExecutor-86-thread-1) [n:127.0.0.1:46186_solr c:authCollection s:shard1 r:core_node3 x:authCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.authCollection.shard1.leader, tag=368fd1ea [junit4] 2> 33956 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 33957 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6753018b: rootName = solr_44025, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f683048 [junit4] 2> 33957 INFO (jetty-closer-124-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 33972 INFO (coreCloseExecutor-87-thread-1) [n:127.0.0.1:36985_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.authCollection.shard3.leader, tag=119addcd [junit4] 2> 34224 INFO (zkCallback-51-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 34224 INFO (zkCallback-36-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 34224 INFO (zkCallback-94-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 34224 INFO (zkCallback-87-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2) [junit4] 2> 34247 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 34279 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@750042d0: rootName = solr_46186, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@46b33d1d [junit4] 2> 34297 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 34297 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@36f9fd97: rootName = solr_46186, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4737fc6a [junit4] 2> 34308 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 34303 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@367e7ab7{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 34310 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5fba7b6f: rootName = solr_46186, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f683048 [junit4] 2> 34310 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@46c4eac{/solr,null,UNAVAILABLE} [junit4] 2> 34311 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 34313 INFO (jetty-closer-124-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 34316 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 34318 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@295c5017: rootName = solr_36985, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1617f1b0 [junit4] 2> 34328 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 34328 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14846147: rootName = solr_36985, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4737fc6a [junit4] 2> 34334 INFO (closeThreadPool-135-thread-2) [ ] o.a.s.c.Overseer Overseer (id=73184693285289995-127.0.0.1:46186_solr-n_0000000000) closing [junit4] 2> 34334 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 34334 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@75a1a724: rootName = solr_36985, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f683048 [junit4] 2> 34335 INFO (jetty-closer-124-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 34339 INFO (zkCallback-87-thread-2) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36985_solr [junit4] 2> 34339 INFO (zkCallback-87-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 34342 INFO (zkCallback-94-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 34342 INFO (zkCallback-51-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 34349 INFO (OverseerStateUpdate-73184693285289995-127.0.0.1:46186_solr-n_0000000000) [n:127.0.0.1:46186_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46186_solr [junit4] 2> 34405 INFO (OverseerAutoScalingTriggerThread-73184693285289995-127.0.0.1:46186_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 34410 INFO (closeThreadPool-135-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73184693285289995-127.0.0.1:46186_solr-n_0000000000) closing [junit4] 2> 34410 INFO (jetty-closer-124-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73184693285289995-127.0.0.1:46186_solr-n_0000000000) closing [junit4] 2> 34425 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@33c79c18{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 34436 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6238c319{/solr,null,UNAVAILABLE} [junit4] 2> 34439 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 34442 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5ab622e4{SSL,[ssl, http/1.1]}{127.0.0.1:36985} [junit4] 2> 34447 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1cd99246{/solr,null,UNAVAILABLE} [junit4] 2> 34447 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 34450 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 34454 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 11 /solr/aliases.json [junit4] 2> 5 /solr/security.json [junit4] 2> 4 /solr/configs/conf [junit4] 2> 4 /solr/collections/authCollection/terms/shard3 [junit4] 2> 3 /solr/collections/authCollection/terms/shard2 [junit4] 2> 3 /solr/collections/authCollection/terms/shard1 [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 48 /solr/collections/authCollection/state.json [junit4] 2> 11 /solr/clusterstate.json [junit4] 2> 11 /solr/clusterprops.json [junit4] 2> 3 /solr/overseer_elect/election/73184693285289995-127.0.0.1:46186_solr-n_0000000000 [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 11 /solr/collections [junit4] 2> 9 /solr/live_nodes [junit4] 2> [junit4] 2> 34498 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:36754 [junit4] 2> 34505 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 36754 [junit4] 2> 34508 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBasicAuth [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicAuthIntegrationTest -Dtests.method=testBasicAuth -Dtests.seed=437A2D177D668CD9 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=th-TH -Dtests.timezone=Europe/Malta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 28.7s J1 | BasicAuthIntegrationTest.testBasicAuth <<< [junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36985/solr/authCollection: Error from server at null: Expected mime type application/octet-stream but got text/html. <html> [junit4] > <head> [junit4] > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> [junit4] > <title>Error 401 require authentication</title> [junit4] > </head> [junit4] > <body><h2>HTTP ERROR 401</h2> [junit4] > <p>Problem accessing /solr/authCollection_shard3_replica_n4/select. Reason: [junit4] > <pre> require authentication</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/> [junit4] > </body> [junit4] > </html> [junit4] > at __randomizedtesting.SeedInfo.seed([437A2D177D668CD9:FF145B05D9350FA3]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) [junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368) [junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1068) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:837) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:769) [junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207) [junit4] > at org.apache.solr.security.BasicAuthIntegrationTest.executeQuery(BasicAuthIntegrationTest.java:327) [junit4] > at org.apache.solr.security.BasicAuthIntegrationTest.testBasicAuth(BasicAuthIntegrationTest.java:300) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J1/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001 [junit4] 2> NOTE: test params are: codec=Lucene80, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@508a1f25), locale=th-TH, timezone=Europe/Malta [junit4] 2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation 1.8.0_191 (64-bit)/cpus=4,threads=2,free=177890736,total=320339968 [junit4] 2> NOTE: All tests run in this JVM: [BasicAuthIntegrationTest] [junit4] Completed [1/5 (1!)] on J1 in 33.36s, 1 test, 1 error <<< FAILURES! [junit4] [junit4] Suite: org.apache.solr.security.BasicAuthIntegrationTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/init-core-data-001 [junit4] 2> 5138 INFO (SUITE-BasicAuthIntegrationTest-seed#[437A2D177D668CD9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 5313 INFO (SUITE-BasicAuthIntegrationTest-seed#[437A2D177D668CD9]-worker) [ ] o.e.j.u.log Logging initialized @5426ms to org.eclipse.jetty.util.log.Slf4jLog [junit4] 2> 5329 INFO (SUITE-BasicAuthIntegrationTest-seed#[437A2D177D668CD9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 5952 INFO (SUITE-BasicAuthIntegrationTest-seed#[437A2D177D668CD9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 5971 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBasicAuth [junit4] 2> 5978 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001 [junit4] 2> 6037 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 6052 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 6052 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 6252 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer start zk server on port:45209 [junit4] 2> 6259 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45209 [junit4] 2> 6261 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45209 [junit4] 2> 6753 INFO (zkConnectionManagerCallback-3-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 6857 INFO (zkConnectionManagerCallback-5-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 6874 INFO (zkConnectionManagerCallback-7-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 7315 WARN (jetty-launcher-8-thread-3) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time [junit4] 2> 7315 WARN (jetty-launcher-8-thread-2) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time [junit4] 2> 7321 WARN (jetty-launcher-8-thread-1) [ ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time [junit4] 2> 7730 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0) [junit4] 2> 7730 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 7745 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0) [junit4] 2> 7745 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 7748 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0) [junit4] 2> 7748 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ... [junit4] 2> 7753 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12 [junit4] 2> 7760 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12 [junit4] 2> 7760 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12 [junit4] 2> 7786 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 7786 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 7791 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 7826 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17f10e79{/solr,null,AVAILABLE} [junit4] 2> 7865 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 7865 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 7865 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 7866 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 7866 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 7866 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 7871 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@71db15aa{/solr,null,AVAILABLE} [junit4] 2> 7885 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ec6e510{/solr,null,AVAILABLE} [junit4] 2> 7931 WARN (jetty-launcher-8-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5fa2c544[provider=null,keyStore=null,trustStore=null] [junit4] 2> 7937 WARN (jetty-launcher-8-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@43fd4354[provider=null,keyStore=null,trustStore=null] [junit4] 2> 7945 WARN (jetty-launcher-8-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@38c34c04[provider=null,keyStore=null,trustStore=null] [junit4] 2> 7966 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3bbd6e7c{SSL,[ssl, http/1.1]}{127.0.0.1:41449} [junit4] 2> 7966 INFO (jetty-launcher-8-thread-1) [ ] o.e.j.s.Server Started @8084ms [junit4] 2> 7968 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@70836b4b{SSL,[ssl, http/1.1]}{127.0.0.1:33172} [junit4] 2> 7968 INFO (jetty-launcher-8-thread-3) [ ] o.e.j.s.Server Started @8086ms [junit4] 2> 7968 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33172} [junit4] 2> 7970 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41449} [junit4] 2> 7977 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1962e5e2{SSL,[ssl, http/1.1]}{127.0.0.1:44782} [junit4] 2> 7977 INFO (jetty-launcher-8-thread-2) [ ] o.e.j.s.Server Started @8095ms [junit4] 2> 7977 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44782} [junit4] 2> 8262 ERROR (jetty-launcher-8-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 8262 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 8262 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0 [junit4] 2> 8269 ERROR (jetty-launcher-8-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 8269 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 8270 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0 [junit4] 2> 8287 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 8287 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 8288 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-23T23:50:20.095Z [junit4] 2> 8291 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 8291 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 8291 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-23T23:50:20.098Z [junit4] 2> 8300 ERROR (jetty-launcher-8-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 8300 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 8301 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.1.0 [junit4] 2> 8301 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 8301 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 8301 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2019-04-23T23:50:20.108Z [junit4] 2> 8361 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 8458 INFO (zkConnectionManagerCallback-12-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 8460 INFO (zkConnectionManagerCallback-14-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 8475 INFO (zkConnectionManagerCallback-10-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 8477 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 8485 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 8492 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 10282 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true] [junit4] 2> 10286 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true] [junit4] 2> 10290 WARN (jetty-launcher-8-thread-3) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 10308 WARN (jetty-launcher-8-thread-2) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 10453 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true] [junit4] 2> 10454 WARN (jetty-launcher-8-thread-1) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 10554 WARN (jetty-launcher-8-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@6a850af4[provider=null,keyStore=null,trustStore=null] [junit4] 2> 10554 WARN (jetty-launcher-8-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5e0710f[provider=null,keyStore=null,trustStore=null] [junit4] 2> 10565 WARN (jetty-launcher-8-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7217efab[provider=null,keyStore=null,trustStore=null] [junit4] 2> 11030 WARN (jetty-launcher-8-thread-2) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 11062 WARN (jetty-launcher-8-thread-1) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 11116 WARN (jetty-launcher-8-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@128084ff[provider=null,keyStore=null,trustStore=null] [junit4] 2> 11130 WARN (jetty-launcher-8-thread-3) [ ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2 [junit4] 2> 11151 WARN (jetty-launcher-8-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@45db128c[provider=null,keyStore=null,trustStore=null] [junit4] 2> 11176 INFO (jetty-launcher-8-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45209/solr [junit4] 2> 11186 WARN (jetty-launcher-8-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@7538619a[provider=null,keyStore=null,trustStore=null] [junit4] 2> 11187 INFO (jetty-launcher-8-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45209/solr [junit4] 2> 11191 INFO (jetty-launcher-8-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45209/solr [junit4] 2> 11240 INFO (zkConnectionManagerCallback-31-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 11248 INFO (zkConnectionManagerCallback-35-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 11259 INFO (zkConnectionManagerCallback-33-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 11284 INFO (zkConnectionManagerCallback-37-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 11334 INFO (zkConnectionManagerCallback-41-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 11345 INFO (zkConnectionManagerCallback-39-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 12762 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44782_solr [junit4] 2> 12762 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41449_solr [junit4] 2> 12763 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33172_solr [junit4] 2> 12795 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.Overseer Overseer (id=73184693293940746-127.0.0.1:44782_solr-n_0000000000) starting [junit4] 2> 12807 INFO (zkCallback-36-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 12845 INFO (zkCallback-38-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 12847 INFO (zkCallback-40-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 13193 INFO (zkConnectionManagerCallback-52-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 13200 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 13203 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45209/solr ready [junit4] 2> 13785 INFO (OverseerStateUpdate-73184693293940746-127.0.0.1:44782_solr-n_0000000000) [n:127.0.0.1:44782_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:44782_solr [junit4] 2> 13797 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:44782_solr as DOWN [junit4] 2> 13805 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 13807 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44782_solr [junit4] 2> 13810 INFO (zkCallback-38-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 13810 INFO (zkCallback-36-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 13811 INFO (zkCallback-40-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 13826 INFO (zkCallback-51-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 14077 INFO (zkConnectionManagerCallback-57-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 14106 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 14118 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45209/solr ready [junit4] 2> 14178 INFO (zkConnectionManagerCallback-62-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 14189 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 14191 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45209/solr ready [junit4] 2> 14233 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 14269 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 14283 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 15335 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41449.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15366 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33172.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15368 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44782.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15376 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44782.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15396 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44782.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15405 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41449.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15405 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41449.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15409 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33172.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15409 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33172.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 15527 INFO (jetty-launcher-8-thread-2) [n:127.0.0.1:44782_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node2/. [junit4] 2> 15531 INFO (jetty-launcher-8-thread-3) [n:127.0.0.1:33172_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node3/. [junit4] 2> 15541 INFO (jetty-launcher-8-thread-1) [n:127.0.0.1:41449_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node1/. [junit4] 2> 16728 INFO (zkConnectionManagerCallback-70-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 16732 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 16734 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45209/solr ready [junit4] 2> 18049 INFO (qtp1747775393-39) [n:127.0.0.1:33172_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=authCollection&nrtReplicas=1&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 18090 INFO (OverseerThreadFactory-19-thread-1-processing-n:127.0.0.1:44782_solr) [n:127.0.0.1:44782_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection authCollection [junit4] 2> 18289 INFO (OverseerStateUpdate-73184693293940746-127.0.0.1:44782_solr-n_0000000000) [n:127.0.0.1:44782_solr ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"authCollection", [junit4] 2> "shard":"shard1", [junit4] 2> "core":"authCollection_shard1_replica_n1", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:41449/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} [junit4] 2> 18314 INFO (OverseerStateUpdate-73184693293940746-127.0.0.1:44782_solr-n_0000000000) [n:127.0.0.1:44782_solr ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"authCollection", [junit4] 2> "shard":"shard2", [junit4] 2> "core":"authCollection_shard2_replica_n3", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:33172/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} [junit4] 2> 18321 INFO (OverseerStateUpdate-73184693293940746-127.0.0.1:44782_solr-n_0000000000) [n:127.0.0.1:44782_solr ] o.a.s.c.o.SliceMutator createReplica() { [junit4] 2> "operation":"ADDREPLICA", [junit4] 2> "collection":"authCollection", [junit4] 2> "shard":"shard3", [junit4] 2> "core":"authCollection_shard3_replica_n4", [junit4] 2> "state":"down", [junit4] 2> "base_url":"https://127.0.0.1:44782/solr", [junit4] 2> "type":"NRT", [junit4] 2> "waitForFinalState":"false"} [junit4] 2> 18701 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr x:authCollection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=authCollection_shard1_replica_n1&action=CREATE&numShards=3&collection=authCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT [junit4] 2> 18704 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr x:authCollection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 18709 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr x:authCollection_shard3_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=authCollection_shard3_replica_n4&action=CREATE&numShards=3&collection=authCollection&shard=shard3&wt=javabin&version=2&replicaType=NRT [junit4] 2> 18721 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr x:authCollection_shard2_replica_n3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=authCollection_shard2_replica_n3&action=CREATE&numShards=3&collection=authCollection&shard=shard2&wt=javabin&version=2&replicaType=NRT [junit4] 2> 18722 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr x:authCollection_shard2_replica_n3] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 19809 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0 [junit4] 2> 19814 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0 [junit4] 2> 19823 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0 [junit4] 2> 19946 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.s.IndexSchema [authCollection_shard2_replica_n3] Schema name=minimal [junit4] 2> 19951 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.s.IndexSchema [authCollection_shard1_replica_n1] Schema name=minimal [junit4] 2> 19955 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.s.IndexSchema [authCollection_shard3_replica_n4] Schema name=minimal [junit4] 2> 20052 WARN (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieIntField]. Please consult documentation how to replace it accordingly. [junit4] 2> 20053 WARN (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieIntField]. Please consult documentation how to replace it accordingly. [junit4] 2> 20064 WARN (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieLongField]. Please consult documentation how to replace it accordingly. [junit4] 2> 20065 WARN (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieIntField]. Please consult documentation how to replace it accordingly. [junit4] 2> 20068 WARN (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieLongField]. Please consult documentation how to replace it accordingly. [junit4] 2> 20092 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 20093 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 20094 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'authCollection_shard1_replica_n1' using configuration from collection authCollection, trusted=true [junit4] 2> 20094 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'authCollection_shard3_replica_n4' using configuration from collection authCollection, trusted=true [junit4] 2> 20096 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id [junit4] 2> 20097 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'authCollection_shard2_replica_n3' using configuration from collection authCollection, trusted=true [junit4] 2> 20162 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41449.solr.core.authCollection.shard1.replica_n1' (registry 'solr.core.authCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 20166 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44782.solr.core.authCollection.shard3.replica_n4' (registry 'solr.core.authCollection.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 20169 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33172.solr.core.authCollection.shard2.replica_n3' (registry 'solr.core.authCollection.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@839cc0a [junit4] 2> 20210 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SolrCore [[authCollection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node1/authCollection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node1/./authCollection_shard1_replica_n1/data/] [junit4] 2> 20213 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrCore [[authCollection_shard3_replica_n4] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node2/authCollection_shard3_replica_n4], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node2/./authCollection_shard3_replica_n4/data/] [junit4] 2> 20213 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SolrCore [[authCollection_shard2_replica_n3] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node3/authCollection_shard2_replica_n3], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001/tempDir-001/node3/./authCollection_shard2_replica_n3/data/] [junit4] 2> 23072 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 23072 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 23072 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 23089 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 23100 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 23100 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 23112 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 23112 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 23122 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 23123 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 23124 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 23124 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 23200 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f9e420e[authCollection_shard1_replica_n1] main] [junit4] 2> 23200 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ac0625[authCollection_shard2_replica_n3] main] [junit4] 2> 23201 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1035d134[authCollection_shard3_replica_n4] main] [junit4] 2> 23238 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 23238 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 23238 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf [junit4] 2> 23270 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf [junit4] 2> 23278 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf [junit4] 2> 23281 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf [junit4] 2> 23312 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 23316 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 23325 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms. [junit4] 2> 23339 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1631650772571652096 [junit4] 2> 23340 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1631650772572700672 [junit4] 2> 23349 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1631650772582137856 [junit4] 2> 23375 INFO (searcherExecutor-34-thread-1-processing-n:127.0.0.1:44782_solr x:authCollection_shard3_replica_n4 c:authCollection s:shard3 r:core_node6) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SolrCore [authCollection_shard3_replica_n4] Registered new searcher Searcher@1035d134[authCollection_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 23376 INFO (searcherExecutor-32-thread-1-processing-n:127.0.0.1:33172_solr x:authCollection_shard2_replica_n3 c:authCollection s:shard2 r:core_node5) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SolrCore [authCollection_shard2_replica_n3] Registered new searcher Searcher@6ac0625[authCollection_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 23387 INFO (searcherExecutor-33-thread-1-processing-n:127.0.0.1:41449_solr x:authCollection_shard1_replica_n1 c:authCollection s:shard1 r:core_node2) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SolrCore [authCollection_shard1_replica_n1] Registered new searcher Searcher@5f9e420e[authCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 23400 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/authCollection/terms/shard1 to Terms{values={core_node2=0}, version=0} [junit4] 2> 23405 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ZkShardTerms Successful update of terms at /collections/authCollection/terms/shard2 to Terms{values={core_node5=0}, version=0} [junit4] 2> 23405 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/authCollection/terms/shard3 to Terms{values={core_node6=0}, version=0} [junit4] 2> 23411 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/authCollection/leaders/shard1 [junit4] 2> 23411 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/authCollection/leaders/shard3 [junit4] 2> 23411 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/authCollection/leaders/shard2 [junit4] 2> 23427 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 23427 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 23427 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 23428 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33172/solr/authCollection_shard2_replica_n3/ [junit4] 2> 23430 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 23431 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.SyncStrategy https://127.0.0.1:33172/solr/authCollection_shard2_replica_n3/ has no replicas [junit4] 2> 23434 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/authCollection/leaders/shard2/leader after winning as /collections/authCollection/leader_elect/shard2/election/73184693293940747-core_node5-n_0000000000 [junit4] 2> 23438 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 23438 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:44782/solr/authCollection_shard3_replica_n4/ [junit4] 2> 23439 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 23439 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 23439 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41449/solr/authCollection_shard1_replica_n1/ [junit4] 2> 23440 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 23440 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 23441 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.SyncStrategy https://127.0.0.1:44782/solr/authCollection_shard3_replica_n4/ has no replicas [junit4] 2> 23441 INFO (qtp1598746878-50) [n:127.0.0.1:44782_solr c:authCollection s:shard3 r:core_node6 x:authCollection_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/authCollection/leaders/shard3/leader after winning as /collections/authCollection/leader_elect/shard3/election/73184693293940746-core_node6-n_0000000000 [junit4] 2> 23441 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:41449/solr/authCollection_shard1_replica_n1/ has no replicas [junit4] 2> 23449 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/authCollection/leaders/shard1/leader after winning as /collections/authCollection/leader_elect/shard1/election/73184693293940745-core_node2-n_0000000000 [junit4] 2> 23453 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33172/solr/authCollection_shard2_replica_n3/ shard2 [junit4] 2> 23465 INFO (zkCallback-40-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/authCollection/state.json] for collection [authCollection] has occurred - updating... (live nodes size: [3]) [junit4] 2> 23468 INFO (qtp1747775393-37) [n:127.0.0.1:33172_solr c:authCollection s:shard2 r:core_node5 x:authCollection_shard2_replica_n3] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 23479 INFO (qtp60075934-55) [n:127.0.0.1:41449_solr c:authCollection s:shard1 r:core_node2 x:authCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41449/solr/authCollection_shard1_replica_n1 [...truncated too long message...] solr [junit4] 2> 35302 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10401173ec8000e, likely client has closed socket [junit4] 2> 35355 INFO (zkCallback-94-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 35355 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x10401173ec80012, likely client has closed socket [junit4] 2> 35356 INFO (zkCallback-56-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 35356 INFO (zkCallback-40-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1) [junit4] 2> 35412 INFO (closeThreadPool-134-thread-1) [ ] o.a.s.c.Overseer Overseer (id=73184693293940745-127.0.0.1:41449_solr-n_0000000001) closing [junit4] 2> 35412 INFO (jetty-closer-124-thread-2) [ ] o.a.s.c.Overseer Overseer (id=73184693293940745-127.0.0.1:41449_solr-n_0000000001) closing [junit4] 2> 35674 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@3bbd6e7c{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 35674 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5ec6e510{/solr,null,UNAVAILABLE} [junit4] 2> 35674 INFO (jetty-closer-124-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 35694 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4ae2945{SSL,[ssl, http/1.1]}{127.0.0.1:44782} [junit4] 2> 35696 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2f00214e{/solr,null,UNAVAILABLE} [junit4] 2> 35696 INFO (jetty-closer-124-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 35710 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@70836b4b{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 35711 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@17f10e79{/solr,null,UNAVAILABLE} [junit4] 2> 35711 INFO (jetty-closer-124-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 35720 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. [junit4] 2> 35738 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45209 [junit4] 2> 35738 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45209 [junit4] 2> 35742 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 11 /solr/aliases.json [junit4] 2> 5 /solr/security.json [junit4] 2> 4 /solr/configs/conf [junit4] 2> 4 /solr/collections/authCollection/terms/shard3 [junit4] 2> 3 /solr/collections/authCollection/terms/shard2 [junit4] 2> 3 /solr/collections/authCollection/terms/shard1 [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 36 /solr/collections/authCollection/state.json [junit4] 2> 11 /solr/clusterstate.json [junit4] 2> 11 /solr/clusterprops.json [junit4] 2> 2 /solr/autoscaling.json [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 11 /solr/collections [junit4] 2> 9 /solr/live_nodes [junit4] 2> 2 /solr/overseer/queue [junit4] 2> 2 /solr/autoscaling/events/.scheduled_maintenance [junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> 2 /solr/overseer/collection-queue-work [junit4] 2> 2 /solr/overseer/queue-work [junit4] 2> [junit4] 2> 35744 INFO (TEST-BasicAuthIntegrationTest.testBasicAuth-seed#[437A2D177D668CD9]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBasicAuth [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicAuthIntegrationTest -Dtests.method=testBasicAuth -Dtests.seed=437A2D177D668CD9 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=th-TH -Dtests.timezone=Europe/Malta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 29.9s J2 | BasicAuthIntegrationTest.testBasicAuth <<< [junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33172/solr/authCollection: Error from server at null: Expected mime type application/octet-stream but got text/html. <html> [junit4] > <head> [junit4] > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> [junit4] > <title>Error 401 require authentication</title> [junit4] > </head> [junit4] > <body><h2>HTTP ERROR 401</h2> [junit4] > <p>Problem accessing /solr/authCollection_shard3_replica_n4/select. Reason: [junit4] > <pre> require authentication</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.14.v20181114</a><hr/> [junit4] > </body> [junit4] > </html> [junit4] > at __randomizedtesting.SeedInfo.seed([437A2D177D668CD9:FF145B05D9350FA3]:0) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244) [junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368) [junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1068) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:837) [junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:769) [junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207) [junit4] > at org.apache.solr.security.BasicAuthIntegrationTest.executeQuery(BasicAuthIntegrationTest.java:327) [junit4] > at org.apache.solr.security.BasicAuthIntegrationTest.testBasicAuth(BasicAuthIntegrationTest.java:300) [junit4] > at java.lang.Thread.run(Thread.java:748) [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_437A2D177D668CD9-001 [junit4] 2> Apr 23, 2019 11:50:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Lucene80, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3b5a83f3), locale=th-TH, timezone=Europe/Malta [junit4] 2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation 1.8.0_191 (64-bit)/cpus=4,threads=2,free=165795696,total=322437120 [junit4] 2> NOTE: All tests run in this JVM: [BasicAuthIntegrationTest] [junit4] Completed [2/5 (2!)] on J2 in 35.04s, 1 test, 1 error <<< FAILURES! [junit4] [junit4] Suite: org.apache.solr.security.BasicAuthIntegrationTest [junit4] OK 31.0s J0 | BasicAuthIntegrationTest.testBasicAuth [junit4] Completed [3/5 (2!)] on J0 in 36.22s, 1 test [junit4] [junit4] Suite: org.apache.solr.security.BasicAuthIntegrationTest [junit4] OK 9.66s J1 | BasicAuthIntegrationTest.testBasicAuth [junit4] Completed [4/5 (2!)] on J1 in 10.64s, 1 test [junit4] [junit4] Suite: org.apache.solr.security.BasicAuthIntegrationTest [junit4] OK 8.97s J2 | BasicAuthIntegrationTest.testBasicAuth [junit4] Completed [5/5 (2!)] on J2 in 10.14s, 1 test [junit4] [junit4] [junit4] Tests with failures [seed: 437A2D177D668CD9]: [junit4] - org.apache.solr.security.BasicAuthIntegrationTest.testBasicAuth [junit4] - org.apache.solr.security.BasicAuthIntegrationTest.testBasicAuth [junit4] [junit4] [junit4] JVM J0: 0.82 .. 38.80 = 37.98s [junit4] JVM J1: 1.05 .. 47.49 = 46.45s [junit4] JVM J2: 1.06 .. 48.51 = 47.46s [junit4] Execution time total: 48 seconds [junit4] Tests summary: 5 suites, 5 tests, 2 errors BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/lucene/common-build.xml:1573: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-repro/lucene/common-build.xml:1100: There were test failures: 5 suites, 5 tests, 2 errors [seed: 437A2D177D668CD9] Total time: 51 seconds [repro] Setting last failure code to 256 [repro] Failures: [repro] 2/5 failed: org.apache.solr.security.BasicAuthIntegrationTest [repro] git checkout 80d3ac8709c6d93c4e4634dc7c10ef667a029cb1 Previous HEAD position was e02f25d... SOLR-12120: Harden AuditLoggerIntegrationTest HEAD is now at 80d3ac8... SOLR-13418 - safer synchronization and zk version checking for collection properties [repro] Exiting with code 256 Archiving artifacts [Fast Archiver] No artifacts from Lucene-Solr-repro Repro-Lucene-Solr-NightlyTests-8.x#79 to compare, so performing full copy of artifacts Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures)
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org