[ 
https://issues.apache.org/jira/browse/SOLR-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Rowe updated SOLR-11025:
------------------------------
    Description: 
Non-reproducing Jenkins failure - this test hasn't failed in Jenkins in months, 
and suddenly several failures within days of each other:

[https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/18/]:

{noformat}
Checking out Revision 986175915927ee2bbd971340f858601c86b3c676 
(refs/remotes/origin/branch_7x)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testShardLeaderChange -Dtests.seed=995C82D4739EF7D8 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ru 
-Dtests.timezone=Asia/Calcutta -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE  223s J2 | OverseerTest.testShardLeaderChange <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([995C82D4739EF7D8:470F052369060229]:0)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
[...]
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=892, maxMBSortInHeap=5.965872045375053, 
sim=RandomSimilarity(queryNorm=false): {}, locale=ru, timezone=Asia/Calcutta
   [junit4]   2> NOTE: Linux 4.10.0-21-generic i386/Oracle Corporation 
1.8.0_131 (32-bit)/cpus=8,threads=1,free=96275160,total=293539840
   [junit4]   2> NOTE: All tests run in this JVM: [HardAutoCommitTest, 
SimplePostToolTest, TestSolrCoreSnapshots, ReplicationFactorTest, 
TestSolrCoreProperties, TestSha256AuthenticationProvider, TestExpandComponent, 
TestCloudRecovery, ConfigureRecoveryStrategyTest, TimeZoneUtilsTest, 
TestTolerantUpdateProcessorRandomCloud, TestExceedMaxTermLength, 
PrimitiveFieldTypeTest, SolrInfoBeanTest, FullSolrCloudDistribCmdsTest, 
UniqFieldsUpdateProcessorFactoryTest, TestReplicaProperties, 
SolrCloudReportersTest, UnloadDistributedZkTest, CleanupOldIndexTest, 
LeaderInitiatedRecoveryOnShardRestartTest, FastVectorHighlighterTest, 
TestOrdValues, MinimalSchemaTest, TestSubQueryTransformerCrossCore, 
ParsingFieldUpdateProcessorsTest, BufferStoreTest, TestLegacyFieldReuse, 
CollectionsAPISolrJTest, TestSchemalessBufferedUpdates, ConnectionManagerTest, 
MetricsConfigTest, TestPayloadScoreQParserPlugin, 
TermVectorComponentDistributedTest, TestLMJelinekMercerSimilarityFactory, 
TestFastWriter, MultiTermTest, HdfsBasicDistributedZk2Test, V2StandaloneTest, 
DocumentBuilderTest, TestMultiValuedNumericRangeQuery, 
AnalyticsMergeStrategyTest, TestNumericTokenStream, TestFieldCacheSort, 
TestSolrCloudWithSecureImpersonation, TestBlendedInfixSuggestions, 
ResponseLogComponentTest, CopyFieldTest, TestAuthenticationFramework, 
BlockJoinFacetDistribTest, TestFieldSortValues, TestJmxIntegration, 
SolrTestCaseJ4Test, BasicAuthIntegrationTest, URLClassifyProcessorTest, 
DateFieldTest, TestExactSharedStatsCache, TestFieldTypeCollectionResource, 
ExplicitHLLTest, ConjunctionSolrSpellCheckerTest, 
TestLeaderElectionWithEmptyReplica, TestReloadAndDeleteDocs, ClusterStateTest, 
TestSQLHandler, HdfsRecoverLeaseTest, QueryEqualityTest, 
UUIDUpdateProcessorFallbackTest, ClassificationUpdateProcessorFactoryTest, 
DistributedSuggestComponentTest, TestHalfAndHalfDocValues, 
ShowFileRequestHandlerTest, ExitableDirectoryReaderTest, TestInfoStreamLogging, 
TestLocalFSCloudBackupRestore, ChaosMonkeyNothingIsSafeWithPullReplicasTest, 
TestSort, NumericFieldsTest, DirectUpdateHandlerTest, SuggesterFSTTest, 
NodeMutatorTest, DateMathParserTest, DistribCursorPagingTest, CircularListTest, 
CloneFieldUpdateProcessorFactoryTest, OverseerCollectionConfigSetProcessorTest, 
DateRangeFieldTest, TestDFRSimilarityFactory, XsltUpdateRequestHandlerTest, 
TestConfigSetsAPI, CoreMergeIndexesAdminHandlerTest, 
TestSerializedLuceneMatchVersion, TestPrepRecovery, TestNoOpRegenerator, 
DistributedFacetPivotWhiteBoxTest, LeaderFailoverAfterPartitionTest, 
TestSolrFieldCacheBean, OverseerTest]
{noformat}

Following is the first of 4 failures from my Jenkins in the last 24 hours or so 
on branch_7_0 and branch_7x:

{noformat}
Checking out Revision 17245c2e5a93bca59572c09af78a6ad6045e75eb 
(refs/remotes/origin/branch_7x)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testShardLeaderChange -Dtests.seed=F2D09FE89D52D09C 
-Dtests.slow=true -Dtests.locale=en-CA 
-Dtests.timezone=America/Indiana/Indianapolis -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE  221s J1  | OverseerTest.testShardLeaderChange <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F2D09FE89D52D09C:2C83181F87CA256D]:0)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
[...]
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=true): {}, locale=en-CA, 
timezone=America/Indiana/Indianapolis
   [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 
1.8.0_77 (64-bit)/cpus=16,threads=1,free=189800952,total=529006592
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtendedDismaxParser, 
CopyFieldTest, TestBlobHandler, TestManagedSchema, 
LeaderFailoverAfterPartitionTest, SolrJmxReporterTest, PolyFieldTest, 
TestMinMaxOnMultiValuedField, SolrIndexConfigTest, 
TestSchemaSimilarityResource, AssignTest, TestSegmentSorting, 
HdfsRestartWhileUpdatingTest, CloneFieldUpdateProcessorFactoryTest, 
TestSQLHandler, TestLuceneMatchVersion, OverseerTest]
{noformat}


  was:
Non-reproducing Jenkins failure - this test hasn't failed in Jenkins in months, 
and suddenly several failures within days of each other:

[https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/18/]:

{noformat}
Checking out Revision 986175915927ee2bbd971340f858601c86b3c676 
(refs/remotes/origin/branch_7x)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testShardLeaderChange -Dtests.seed=995C82D4739EF7D8 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ru 
-Dtests.timezone=Asia/Calcutta -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE  223s J2 | OverseerTest.testShardLeaderChange <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([995C82D4739EF7D8:470F052369060229]:0)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
[...]
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=892, maxMBSortInHeap=5.965872045375053, 
sim=RandomSimilarity(queryNorm=false): {}, locale=ru, timezone=Asia/Calcutta
   [junit4]   2> NOTE: Linux 4.10.0-21-generic i386/Oracle Corporation 
1.8.0_131 (32-bit)/cpus=8,threads=1,free=96275160,total=293539840
   [junit4]   2> NOTE: All tests run in this JVM: [HardAutoCommitTest, 
SimplePostToolTest, TestSolrCoreSnapshots, ReplicationFactorTest, 
TestSolrCoreProperties, TestSha256AuthenticationProvider, TestExpandComponent, 
TestCloudRecovery, ConfigureRecoveryStrategyTest, TimeZoneUtilsTest, 
TestTolerantUpdateProcessorRandomCloud, TestExceedMaxTermLength, 
PrimitiveFieldTypeTest, SolrInfoBeanTest, FullSolrCloudDistribCmdsTest, 
UniqFieldsUpdateProcessorFactoryTest, TestReplicaProperties, 
SolrCloudReportersTest, UnloadDistributedZkTest, CleanupOldIndexTest, 
LeaderInitiatedRecoveryOnShardRestartTest, FastVectorHighlighterTest, 
TestOrdValues, MinimalSchemaTest, TestSubQueryTransformerCrossCore, 
ParsingFieldUpdateProcessorsTest, BufferStoreTest, TestLegacyFieldReuse, 
CollectionsAPISolrJTest, TestSchemalessBufferedUpdates, ConnectionManagerTest, 
MetricsConfigTest, TestPayloadScoreQParserPlugin, 
TermVectorComponentDistributedTest, TestLMJelinekMercerSimilarityFactory, 
TestFastWriter, MultiTermTest, HdfsBasicDistributedZk2Test, V2StandaloneTest, 
DocumentBuilderTest, TestMultiValuedNumericRangeQuery, 
AnalyticsMergeStrategyTest, TestNumericTokenStream, TestFieldCacheSort, 
TestSolrCloudWithSecureImpersonation, TestBlendedInfixSuggestions, 
ResponseLogComponentTest, CopyFieldTest, TestAuthenticationFramework, 
BlockJoinFacetDistribTest, TestFieldSortValues, TestJmxIntegration, 
SolrTestCaseJ4Test, BasicAuthIntegrationTest, URLClassifyProcessorTest, 
DateFieldTest, TestExactSharedStatsCache, TestFieldTypeCollectionResource, 
ExplicitHLLTest, ConjunctionSolrSpellCheckerTest, 
TestLeaderElectionWithEmptyReplica, TestReloadAndDeleteDocs, ClusterStateTest, 
TestSQLHandler, HdfsRecoverLeaseTest, QueryEqualityTest, 
UUIDUpdateProcessorFallbackTest, ClassificationUpdateProcessorFactoryTest, 
DistributedSuggestComponentTest, TestHalfAndHalfDocValues, 
ShowFileRequestHandlerTest, ExitableDirectoryReaderTest, TestInfoStreamLogging, 
TestLocalFSCloudBackupRestore, ChaosMonkeyNothingIsSafeWithPullReplicasTest, 
TestSort, NumericFieldsTest, DirectUpdateHandlerTest, SuggesterFSTTest, 
NodeMutatorTest, DateMathParserTest, DistribCursorPagingTest, CircularListTest, 
CloneFieldUpdateProcessorFactoryTest, OverseerCollectionConfigSetProcessorTest, 
DateRangeFieldTest, TestDFRSimilarityFactory, XsltUpdateRequestHandlerTest, 
TestConfigSetsAPI, CoreMergeIndexesAdminHandlerTest, 
TestSerializedLuceneMatchVersion, TestPrepRecovery, TestNoOpRegenerator, 
DistributedFacetPivotWhiteBoxTest, LeaderFailoverAfterPartitionTest, 
TestSolrFieldCacheBean, OverseerTest]
{noformat}

Following is the first of 4 failures from my Jenkins in the last 24 hours or so:

{noformat}
Checking out Revision 17245c2e5a93bca59572c09af78a6ad6045e75eb 
(refs/remotes/origin/branch_7x)
[...]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
-Dtests.method=testShardLeaderChange -Dtests.seed=F2D09FE89D52D09C 
-Dtests.slow=true -Dtests.locale=en-CA 
-Dtests.timezone=America/Indiana/Indianapolis -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE  221s J1  | OverseerTest.testShardLeaderChange <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([F2D09FE89D52D09C:2C83181F87CA256D]:0)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
   [junit4]    >        at 
org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
[...]
   [junit4]   2> NOTE: test params are: codec=Lucene70, 
sim=RandomSimilarity(queryNorm=true): {}, locale=en-CA, 
timezone=America/Indiana/Indianapolis
   [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 
1.8.0_77 (64-bit)/cpus=16,threads=1,free=189800952,total=529006592
   [junit4]   2> NOTE: All tests run in this JVM: [TestExtendedDismaxParser, 
CopyFieldTest, TestBlobHandler, TestManagedSchema, 
LeaderFailoverAfterPartitionTest, SolrJmxReporterTest, PolyFieldTest, 
TestMinMaxOnMultiValuedField, SolrIndexConfigTest, 
TestSchemaSimilarityResource, AssignTest, TestSegmentSorting, 
HdfsRestartWhileUpdatingTest, CloneFieldUpdateProcessorFactoryTest, 
TestSQLHandler, TestLuceneMatchVersion, OverseerTest]
{noformat}



> OverseerTest.testShardLeaderChange() failures
> ---------------------------------------------
>
>                 Key: SOLR-11025
>                 URL: https://issues.apache.org/jira/browse/SOLR-11025
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Steve Rowe
>
> Non-reproducing Jenkins failure - this test hasn't failed in Jenkins in 
> months, and suddenly several failures within days of each other:
> [https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/18/]:
> {noformat}
> Checking out Revision 986175915927ee2bbd971340f858601c86b3c676 
> (refs/remotes/origin/branch_7x)
> [...]
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
> -Dtests.method=testShardLeaderChange -Dtests.seed=995C82D4739EF7D8 
> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ru 
> -Dtests.timezone=Asia/Calcutta -Dtests.asserts=true 
> -Dtests.file.encoding=UTF-8
>    [junit4] FAILURE  223s J2 | OverseerTest.testShardLeaderChange <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
> leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
>    [junit4]    >      at 
> __randomizedtesting.SeedInfo.seed([995C82D4739EF7D8:470F052369060229]:0)
>    [junit4]    >      at 
> org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
>    [junit4]    >      at 
> org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
> [...]
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
> docValues:{}, maxPointsInLeafNode=892, maxMBSortInHeap=5.965872045375053, 
> sim=RandomSimilarity(queryNorm=false): {}, locale=ru, timezone=Asia/Calcutta
>    [junit4]   2> NOTE: Linux 4.10.0-21-generic i386/Oracle Corporation 
> 1.8.0_131 (32-bit)/cpus=8,threads=1,free=96275160,total=293539840
>    [junit4]   2> NOTE: All tests run in this JVM: [HardAutoCommitTest, 
> SimplePostToolTest, TestSolrCoreSnapshots, ReplicationFactorTest, 
> TestSolrCoreProperties, TestSha256AuthenticationProvider, 
> TestExpandComponent, TestCloudRecovery, ConfigureRecoveryStrategyTest, 
> TimeZoneUtilsTest, TestTolerantUpdateProcessorRandomCloud, 
> TestExceedMaxTermLength, PrimitiveFieldTypeTest, SolrInfoBeanTest, 
> FullSolrCloudDistribCmdsTest, UniqFieldsUpdateProcessorFactoryTest, 
> TestReplicaProperties, SolrCloudReportersTest, UnloadDistributedZkTest, 
> CleanupOldIndexTest, LeaderInitiatedRecoveryOnShardRestartTest, 
> FastVectorHighlighterTest, TestOrdValues, MinimalSchemaTest, 
> TestSubQueryTransformerCrossCore, ParsingFieldUpdateProcessorsTest, 
> BufferStoreTest, TestLegacyFieldReuse, CollectionsAPISolrJTest, 
> TestSchemalessBufferedUpdates, ConnectionManagerTest, MetricsConfigTest, 
> TestPayloadScoreQParserPlugin, TermVectorComponentDistributedTest, 
> TestLMJelinekMercerSimilarityFactory, TestFastWriter, MultiTermTest, 
> HdfsBasicDistributedZk2Test, V2StandaloneTest, DocumentBuilderTest, 
> TestMultiValuedNumericRangeQuery, AnalyticsMergeStrategyTest, 
> TestNumericTokenStream, TestFieldCacheSort, 
> TestSolrCloudWithSecureImpersonation, TestBlendedInfixSuggestions, 
> ResponseLogComponentTest, CopyFieldTest, TestAuthenticationFramework, 
> BlockJoinFacetDistribTest, TestFieldSortValues, TestJmxIntegration, 
> SolrTestCaseJ4Test, BasicAuthIntegrationTest, URLClassifyProcessorTest, 
> DateFieldTest, TestExactSharedStatsCache, TestFieldTypeCollectionResource, 
> ExplicitHLLTest, ConjunctionSolrSpellCheckerTest, 
> TestLeaderElectionWithEmptyReplica, TestReloadAndDeleteDocs, 
> ClusterStateTest, TestSQLHandler, HdfsRecoverLeaseTest, QueryEqualityTest, 
> UUIDUpdateProcessorFallbackTest, ClassificationUpdateProcessorFactoryTest, 
> DistributedSuggestComponentTest, TestHalfAndHalfDocValues, 
> ShowFileRequestHandlerTest, ExitableDirectoryReaderTest, 
> TestInfoStreamLogging, TestLocalFSCloudBackupRestore, 
> ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestSort, NumericFieldsTest, 
> DirectUpdateHandlerTest, SuggesterFSTTest, NodeMutatorTest, 
> DateMathParserTest, DistribCursorPagingTest, CircularListTest, 
> CloneFieldUpdateProcessorFactoryTest, 
> OverseerCollectionConfigSetProcessorTest, DateRangeFieldTest, 
> TestDFRSimilarityFactory, XsltUpdateRequestHandlerTest, TestConfigSetsAPI, 
> CoreMergeIndexesAdminHandlerTest, TestSerializedLuceneMatchVersion, 
> TestPrepRecovery, TestNoOpRegenerator, DistributedFacetPivotWhiteBoxTest, 
> LeaderFailoverAfterPartitionTest, TestSolrFieldCacheBean, OverseerTest]
> {noformat}
> Following is the first of 4 failures from my Jenkins in the last 24 hours or 
> so on branch_7_0 and branch_7x:
> {noformat}
> Checking out Revision 17245c2e5a93bca59572c09af78a6ad6045e75eb 
> (refs/remotes/origin/branch_7x)
> [...]
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest 
> -Dtests.method=testShardLeaderChange -Dtests.seed=F2D09FE89D52D09C 
> -Dtests.slow=true -Dtests.locale=en-CA 
> -Dtests.timezone=America/Indiana/Indianapolis -Dtests.asserts=true 
> -Dtests.file.encoding=US-ASCII
>    [junit4] FAILURE  221s J1  | OverseerTest.testShardLeaderChange <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: Unexpected shard 
> leader coll:collection1 shard:shard1 expected:<core1> but was:<null>
>    [junit4]    >      at 
> __randomizedtesting.SeedInfo.seed([F2D09FE89D52D09C:2C83181F87CA256D]:0)
>    [junit4]    >      at 
> org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:486)
>    [junit4]    >      at 
> org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:720)
> [...]
>    [junit4]   2> NOTE: test params are: codec=Lucene70, 
> sim=RandomSimilarity(queryNorm=true): {}, locale=en-CA, 
> timezone=America/Indiana/Indianapolis
>    [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 
> 1.8.0_77 (64-bit)/cpus=16,threads=1,free=189800952,total=529006592
>    [junit4]   2> NOTE: All tests run in this JVM: [TestExtendedDismaxParser, 
> CopyFieldTest, TestBlobHandler, TestManagedSchema, 
> LeaderFailoverAfterPartitionTest, SolrJmxReporterTest, PolyFieldTest, 
> TestMinMaxOnMultiValuedField, SolrIndexConfigTest, 
> TestSchemaSimilarityResource, AssignTest, TestSegmentSorting, 
> HdfsRestartWhileUpdatingTest, CloneFieldUpdateProcessorFactoryTest, 
> TestSQLHandler, TestLuceneMatchVersion, OverseerTest]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to