As all the security stuff settles down, I’m still taking these snapshots but
mostly to keep a complete record. The longer records, i.e. for the last 7 days
contains a lot of noise comparatively.
That said, it’s worth looking at Hoss’ last 7 day rollup, we do have a number
of tests failing quite regularly although many of those are “suite” level:
http://fucit.org/solr-jenkins-reports/failure-report.html
Short form:
********Failures in Hoss' reports for the last 4 rollups.
There were 1434 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 7.7 675 15
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
0123 1.6 801 44
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 1.9 805 14 RollingRestartTest.test
0123 2.9 99 5 ShardSplitTest.testSplitWithChaosMonkey
0123 3.6 807 18 SystemCollectionCompatTest.testBackCompat
0123 18.9 115 16 Test2BPostings.test
0123 3.6 862 51
TestModelManagerPersistence.testFilePersistence
0123 3.6 865 54
TestModelManagerPersistence.testWrapperModelPersistence
0123 0.8 781 6
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 2.6 809 16 TestStressLiveNodes.testStress
Full output attached
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
Processing file (History bit 3): HOSS-2019-12-23.csv
Processing file (History bit 2): HOSS-2019-12-09.csv
Processing file (History bit 1): HOSS-2019-12-02.csv
Processing file (History bit 0): HOSS-2019-11-25.csv
Number of AwaitsFix: 40 Number of BadApples: 7
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 108 failures
Week: 1 had 1170 failures
Week: 2 had 83 failures
Week: 3 had 253 failures
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
no tests removed
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 2
SolrZkClientTest.testSimpleUpdateACLs
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
********Failures in Hoss' reports for the last 4 rollups.
There were 1434 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 7.7 675 15
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
0123 1.6 801 44
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 1.9 805 14 RollingRestartTest.test
0123 2.9 99 5 ShardSplitTest.testSplitWithChaosMonkey
0123 3.6 807 18 SystemCollectionCompatTest.testBackCompat
0123 18.9 115 16 Test2BPostings.test
0123 3.6 862 51
TestModelManagerPersistence.testFilePersistence
0123 3.6 865 54
TestModelManagerPersistence.testWrapperModelPersistence
0123 0.8 781 6
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 2.6 809 16 TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the
top**************
012 0.8 600 6
MissingSegmentRecoveryTest.testLeaderRecovery
012 0.4 658 3 TestPackedInts.testPackedLongValues
01 3 0.8 582 5 ShardSplitTest.testSplitShardWithRuleLink
01 3 3.5 581 33
TestCloudSearcherWarming.testRepFactor1LeaderStartup
01 3 0.8 585 12
TestSkipOverseerOperations.testSkipLeaderOperations
01 3 3.4 564 16 TestSolrCloudWithKerberosAlt.testBasics
01 4.1 427 47
DocumentAnalysisRequestHandlerTest.testCharsetOutsideDocument
01 0.8 392 29
MBeansHandlerTest.testXMLDiffWithExternalEntity
01 5.3 591 131 TestXPathEntityProcessor.testMultiValued
01 5.6 563 139 TestXPathRecordReader.testError
01 6.9 49 3
TestXYMultiPolygonShapeQueries.testRandomBig
01 0.8 404 45
XmlUpdateRequestHandlerTest.testExternalEntities
01 0.8 404 45 XmlUpdateRequestHandlerTest.testNamedEntity
0 23 8.0 702 79 BasicAuthIntegrationTest.testBasicAuth
0 23 9.0 505 17
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
0 23 10.7 78 6 HdfsBasicDistributedZkTest.test
0 23 0.4 651 6 LeaderFailoverAfterPartitionTest.test
0 23 9.7 88 15 StressHdfsTest.test
0 23 0.8 613 6 TestPackages.testPluginLoading
0 23 27.5 110 33 TestXYPolygonShapeQueries.testRandomBig
0 2 8.8 57 4 HdfsChaosMonkeyNothingIsSafeTest.test
0 3 0.8 434 3 HttpPartitionWithTlogReplicasTest.test
0 3 0.8 449 9 SyncSliceTest.test
0 3 1.6 431 5 TestDistribIDF.testMultiCollectionQuery
0 3 0.4 444 16 TestInPlaceUpdatesDistrib.test
0 0.4 246 1 BasicAuthOnSingleNodeTest.basicTest
0 3.2 31 1
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
0 0.4 249 1 ExitableDirectoryReaderTest.testPrefixQuery
0 13.8 94 13 FuzzySearchTest.testTooComplex
0 3.6 28 1 HdfsBasicDistributedZk2Test.test
0 18.8 32 6 HdfsWriteToMultipleCollectionsTest.test
0 0.4 260 1
LoggingHandlerTest.testLogLevelHandlerOutput
0 0.4 249 1 OverseerTaskQueueTest.testDistributedQueue
0 13.9 287 40 ParseContextConfigTest.testAll
0 0.4 260 1 ShardSplitTest.testSplitMixedReplicaTypes
0 0.4 265 1
TestBinaryDocValuesUpdates.testMultipleDocValuesTypes
0 12.5 32 4
TestBinaryDocValuesUpdates.testTonsOfUpdates
0 0.4 243 1 TestCloudJSONFacetSKG.testRandom
0 0.4 244 1 TestCloudSchemaless.test
0 0.4 261 1 TestDemoParallelLeafReader.testRandom
0 0.8 262 2
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
0 6.7 30 2 TestDoubleRangeFieldQueries.testRandomBig
0 9.7 31 3 TestDuelingCodecsAtNight.testBigEquals
0 20.4 108 22 TestFuzzyQuery.testErrorMessage
0 3.7 27 1 TestIndexWriterOnVMError.testCheckpoint
0 1.5 265 4
TestIndexingSequenceNumbers.testStressConcurrentCommit
0 0.4 269 1
TestLucene80DocValuesFormat.testBooleanNumericsVsStoredFields
0 0.7 270 2
TestLucene80DocValuesFormat.testNumericFieldJumpTables
0 0.4 268 1
TestLucene80DocValuesFormat.testSortedSetAroundBlockSize
0 0.4 269 1
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
0 0.4 269 1
TestLucene80DocValuesFormat.testTermsEnumVariableWidth
0 0.4 245 1 TestNamedUpdateProcessors.test
0 0.4 261 1 TestPagedBytes.testDataInputOutput
0 0.8 248 2 TestPhraseWildcardQuery.testExplain
123 63.2 53 32 MoveReplicaHDFSTest.test
123 1.0 455 3
TestDelegationWithHadoopAuth.testDelegationTokenRenew
123 61.6 946 418 TestDictionary.testInvalidData
12 0.7 349 2 AssignBackwardCompatibilityTest.test
12 0.6 386 2 ComputePlanActionTest.testNodeAdded
12 1.4 353 3
HealthCheckHandlerTest.testHealthCheckHandler
1 3 0.8 311 3
ScheduledTriggerIntegrationTest.testScheduledTrigger
1 3 0.8 315 2
TestPullReplicaErrorHandling.testCantConnectToLeader
1 3 0.8 315 2
TestPullReplicaErrorHandling.testCantConnectToPullReplica
1 3 17.8 334 28
TestSSLRandomization.testRandomizedSslAndClientAuth
1 3 0.5 376 2
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
1 3 0.6 352 3 TestWithCollection.testAddReplicaSimple
1 1.1 189 2 ArcTangentEvaluatorTest.noValue
1 1.1 189 2 ArcTangentEvaluatorTest.nullValue
1 1.1 189 2 ArcTangentEvaluatorTest.oneField
1 0.5 188 1 ArrayEvaluatorTest.arrayLongSortAscTest
1 0.5 188 1 ArrayEvaluatorTest.arrayLongSortDescTest
1 0.5 188 1 ArrayEvaluatorTest.arrayStringSortAscTest
1 0.5 188 1 ArrayEvaluatorTest.arrayStringSortDescTest
1 0.5 188 1 ArrayEvaluatorTest.arrayStringUnsortedTest
1 0.8 121 1 AutoAddReplicasPlanActionTest.testSimple
1 0.8 129 1 BasicDistributedZk2Test.test
1 0.7 137 1
BlobRepositoryMockingTest.testGetBlobIncrRefByUrl
1 1.1 189 2
CloudHttp2SolrClientBuilderTest.testByDefaultConfiguresClientToSendUpdatesOnlyToShardLeaders
1 1.1 189 2
CloudHttp2SolrClientBuilderTest.testIsDirectUpdatesToLeadersOnlyDefault
1 1.1 189 2
CloudHttp2SolrClientBuilderTest.testSeveralZkHostsSpecifiedSingly
1 1.1 189 2
CloudHttp2SolrClientBuilderTest.testSeveralZkHostsSpecifiedTogether
1 1.1 189 2
CloudHttp2SolrClientBuilderTest.testSingleZkHostSpecified
1 1.1 189 2
CloudHttp2SolrClientMultiConstructorTest.testZkConnectionStringConstructorWithValidChroot
1 0.5 188 1 CloudSolrClientBuilderTest.test0Timeouts
1 0.5 188 1
CloudSolrClientBuilderTest.testByDefaultConfiguresClientToSendUpdatesOnlyToShardLeaders
1 0.5 188 1
CloudSolrClientBuilderTest.testIsDirectUpdatesToLeadersOnlyDefault
1 0.5 188 1
CloudSolrClientBuilderTest.testSeveralZkHostsSpecifiedSingly
1 0.5 188 1
CloudSolrClientBuilderTest.testSeveralZkHostsSpecifiedTogether
1 0.5 188 1
CloudSolrClientBuilderTest.testSingleZkHostSpecified
1 0.6 174 1
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_1Shard
1 0.5 188 1 ConcatOperationTest.concatMultipleFields
1 0.5 188 1
ConcatOperationTest.concatMultipleFieldsExpression
1 0.5 188 1
ConcatOperationTest.concatMultipleFieldsWithIgnoredFields
1 0.5 188 1
ConcatOperationTest.concatMultipleFieldsWithIgnoredFieldsExpression
1 0.5 188 1 ConcatOperationTest.concatSingleField
1 0.5 188 1
ConcatOperationTest.concatSingleFieldExpression
1 0.5 188 1 ConcatOperationTest.concatWithNullValues
1 0.5 188 1
ConcatOperationTest.concatWithNullValuesExpression
1 0.5 188 1
ConcurrentUpdateSolrClientBuilderTest.testMissingQueueSize
1 0.5 188 1 ConversionEvaluatorsTest.testCentimeters
1 0.5 188 1 ConversionEvaluatorsTest.testInches
1 0.5 188 1
ConversionEvaluatorsTest.testInvalidExpression
1 0.5 188 1 ConversionEvaluatorsTest.testKiloMeters
1 0.5 188 1 ConversionEvaluatorsTest.testMeters
1 0.5 188 1 ConversionEvaluatorsTest.testMiles
1 0.5 188 1 ConversionEvaluatorsTest.testMillimeters
1 0.5 188 1 ConversionEvaluatorsTest.testYards
1 3.8 131 5
CreateCollectionCleanupTest.testAsyncCreateCollectionCleanup
1 3.8 131 5
CreateCollectionCleanupTest.testCreateCollectionCleanup
1 4.4 136 6
DirectoryFactoryTest.testGetDataHomeByteBuffersDirectory
1 4.4 136 6
DirectoryFactoryTest.testGetDataHomeRAMDirectory
1 0.5 188 1 EqualToEvaluatorTest.eqTwoBooleans
1 0.5 188 1 EqualToEvaluatorTest.eqTwoIntegers
1 0.5 188 1 EqualToEvaluatorTest.eqTwoStrings
1 0.5 188 1 EqualToEvaluatorTest.operationFieldName
1 1.6 190 3 ExclusiveOrEvaluatorTest.eorTwoBooleans
1 1.6 190 3
ExclusiveOrEvaluatorTest.eorWithSubAndsBooleans
1 11.6 138 16
HadoopSSLCredentialProviderTest.testGetCredentials
1 20.2 188 38
HdfsBackupRepositoryTest.testCopyBufferDefaultSize
1 20.2 188 38 HdfsBackupRepositoryTest.testCopyBufferSet
1 20.2 188 38
HdfsBackupRepositoryTest.testHdfsHomePropertySet
1 0.7 138 1 HealthCheckHandlerTest.testHealthCheckV2Api
1 35.5 279 99 HttpReplicatorTest.testBasic
1 35.7 280 100 HttpReplicatorTest.testServerErrors
1 16.9 142 24
JWTAuthPluginTest.initFromSecurityJSONUrlJwk
1 0.5 188 1 JWTIssuerConfigTest.parseJwkSet
1 0.5 188 1
JWTIssuerConfigTest.wellKnownConfigNotReachable
1 0.5 188 1
LBHttpSolrClientTest.testLBHttpSolrClientHttpClientResponseParserStringArray
1 39.7 199 79 MetricsHistoryIntegrationTest.testGet
1 0.5 188 1 OperationsTest.replaceFieldNullWithInt
1 0.5 188 1
OperationsTest.replaceFieldNullWithNonExistantField
1 0.5 188 1 OperationsTest.replaceFieldNullWithString
1 0.5 188 1 OperationsTest.replaceValueNullWithDouble
1 0.5 188 1 OperationsTest.replaceValueNullWithFloat
1 0.5 188 1 OperationsTest.replaceValueNullWithInt
1 0.5 188 1 OperationsTest.replaceValueNullWithString
1 1.1 189 2 OrEvaluatorTest.orTwoBooleans
1 1.1 189 2 OrEvaluatorTest.orWithSubAndsBooleans
1 24.5 163 40 OutputWriterTest.testTrivialXsltWriter
1 24.5 163 40
OutputWriterTest.testTrivialXsltWriterInclude
1 0.5 188 1 PowerEvaluatorTest.powManyFieldsWithSubpows
1 0.5 188 1 PowerEvaluatorTest.powTwoFieldWithNulls
1 0.5 188 1 PowerEvaluatorTest.powTwoFieldsWithValues
1 0.5 188 1 RawValueEvaluatorTest.rawTypes
1 1.1 189 2 RecursiveEvaluatorTest.compoundTest
1 0.5 188 1 RegressionEvaluatorTest.test
1 0.7 142 1 ReplicationFactorTest.test
1 0.5 188 1 ReverseEvaluatorTest.test
1 0.5 188 1 RoundEvaluatorTest.noValue
1 0.5 188 1 RoundEvaluatorTest.nullValue
1 0.5 188 1 RoundEvaluatorTest.oneField
1 11.7 137 16
SSLConfigurationsTest.testGetClientKeyStorePasswordFromHadoopCredentialProvider
1 11.7 137 16
SSLConfigurationsTest.testGetClientTruststorePasswordFromHadoopCredentialProvider
1 11.7 137 16
SSLConfigurationsTest.testGetKeyStorePasswordFromHadoopCredentialProvider
1 11.7 137 16
SSLConfigurationsTest.testGetTruststorePasswordFromHadoopCredentialProvider
1 11.7 137 16
SSLConfigurationsTest.testHadoopCredentialProviderPrioritySysPropAndEnvVars
1 11.7 137 16
SSLConfigurationsTest.testSslConfigKeystorePwFromClientKeystoreHadoopCredentialProvider
1 11.7 137 16
SSLConfigurationsTest.testSslConfigKeystorePwFromKeystoreHadoopCredentialProvider
1 2.8 36 1
SearchRateTriggerIntegrationTest.testAboveSearchRate
1 0.5 188 1 SineEvaluatorTest.noValue
1 0.5 188 1 SineEvaluatorTest.nullValue
1 0.5 188 1 SineEvaluatorTest.oneField
1 1.1 95 1
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
1 1.1 95 1
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeRapidAdds
1 0.5 188 1 SquareRootEvaluatorTest.noValue
1 0.5 188 1 SquareRootEvaluatorTest.nullValue
1 0.5 188 1 SquareRootEvaluatorTest.oneField
1 0.5 188 1
SubtractEvaluatorTest.subManyFieldsWithSubsubs
1 0.5 188 1
SubtractEvaluatorTest.subManyFieldsWithValues
1 0.5 188 1 SubtractEvaluatorTest.subTwoFieldWithNulls
1 0.5 188 1
SubtractEvaluatorTest.subTwoFieldsWithMissingField
1 0.5 188 1 SubtractEvaluatorTest.subTwoFieldsWithNull
1 0.5 188 1
SubtractEvaluatorTest.subTwoFieldsWithValues
1 0.5 188 1 TemporalEvaluatorsTest.testAllFunctions
1 0.5 188 1 TemporalEvaluatorsTest.testExplain
1 0.5 188 1
TemporalEvaluatorsTest.testFunctionsLocalDateTime
1 0.5 188 1 TemporalEvaluatorsTest.testFunctionsOnDate
1 0.5 188 1
TemporalEvaluatorsTest.testFunctionsOnInstant
1 0.5 188 1 TemporalEvaluatorsTest.testFunctionsOnLong
1 0.5 188 1
TemporalEvaluatorsTest.testInvalidExpression
1 0.5 188 1 TemporalEvaluatorsTest.testInvalidValues
1 0.5 188 1 TemporalEvaluatorsTest.testLimitedFunctions
1 35.8 288 103 Test64kAffixes.test
1 0.5 192 1
TestAssertingDocValuesFormat.testSparseLongNumericsVsStoredFields
1 36.1 280 101 TestCharBlockArray.testArray
1 35.7 283 101 TestDemo.testDemo
1 26.8 414 111
TestDictionary.testCompressedBeforeSetDictionary
1 26.8 414 111 TestDictionary.testCompressedDictionary
1 26.8 414 111
TestDictionary.testCompressedEmptyAliasDictionary
1 26.8 414 111 TestDictionary.testInvalidFlags
1 26.8 414 111 TestDictionary.testResourceCleanup
1 26.8 414 111 TestDictionary.testSimpleDictionary
1 23.5 230 54 TestFreeTextSuggester.testBasic
1 22.1 226 50 TestFreeTextSuggester.testEmptyString
1 18.9 217 41 TestFreeTextSuggester.testEndingHole
1 21.4 224 48
TestFreeTextSuggester.testIllegalByteDuringBuild
1 24.1 232 56
TestFreeTextSuggester.testIllegalByteDuringQuery
1 22.1 226 50 TestFreeTextSuggester.testNoDupsAcrossGrams
1 16.6 211 35 TestFreeTextSuggester.testRandom
1 25.1 235 59 TestFreeTextSuggester.testTwoEndingHoles
1 23.5 230 54 TestFreeTextSuggester.testUnigrams
1 35.7 283 101 TestHandleLimitFS.testTooManyOpenFiles
1 37.3 292 109 TestHunspellStemFilterFactory.testStemming
1 0.5 192 1
TestPerFieldDocValuesFormat.testSparseLongNumericsVsStoredFields
1 24.8 246 61 TestPerfTasksParse.testParseExamples
1 9.6 229 22 TestRandomChains.testRandomChains
1 10.9 229 25
TestRandomChains.testRandomChainsWithLargeStrings
1 20.1 139 28
TestSolrCLIRunExample.testTechproductsExample
1 24.5 241 59 TestTestFramework.spatialExample
1 24.8 242 60 TestTestFramework.testQueries
1 28.7 254 73
TestXLSXResponseWriter.testForDVEnabledFields
1 28.7 254 73 TestXLSXResponseWriter.testPseudoFields
1 28.7 254 73
TestXLSXResponseWriter.testStructuredDataViaBaseWriters
1 11.7 325 38
TestXPathEntityProcessor.withDefaultSolrAndXsl
1 2.4 125 3 TransactionLogTest.testUUID
1 1.1 189 2 UniformDistributionEvaluatorTest.test
1 0.5 188 1 UuidEvaluatorTest.testUuid
1 23.4 158 37 XsltUpdateRequestHandlerTest.testEntities
1 23.4 158 37 XsltUpdateRequestHandlerTest.testUpdate
23 0.5 397 2
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
23 0.9 400 4 LeaderVoteWaitTimeoutTest.basicTest
23 0.5 401 2
TestSimpleTextTermVectorsFormat.testRamBytesUsed
23 0.5 362 3 TestSolrCachePerf.testGetPutCompute
23 0.5 364 2 TestTlogReplica.testKillLeader
2 0.5 212 1 AutoScalingHandlerTest.testReadApi
2 0.5 212 1
AutoScalingHandlerTest.testSuggestionsWithPayload
2 0.5 210 1 AutoscalingHistoryHandlerTest.testHistory
2 0.5 213 1
CollectionsAPISolrJTest.testReadOnlyCollection
2 0.5 215 1
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN
2 4.8 21 1
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
2 0.5 210 1 HttpPartitionTest.test
2 0.5 214 1 ShardSplitTest.testSplitShardWithRule
2 2.3 214 5 SplitShardTest.testLiveSplit
2 0.5 212 1
TestBugInSomething.testUnicodeShinglesAndNgrams
2 0.9 211 2
TestFieldCacheSortRandom.testRandomStringSort
2 0.9 211 2
TestFieldCacheSortRandom.testRandomStringValSort
2 0.6 166 1
TestHdfsCloudBackupRestore.testRestoreFailure
2 0.5 211 1 TestIndexWriterDelete.testDeletesOnDiskFull
2 1.2 259 3
TestLRUQueryCache.testBooleanQueryCachesSubClauses
2 20.0 75 15
TestLRUQueryCache.testLRUConcurrentCachingAcrossSegments
2 5.3 75 4
TestLRUQueryCache.testLRUConcurrentLoadAndEviction
2 34.7 75 26
TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery
2 1.2 241 3
TestLRUQueryCache.testSkipCachingForTermQuery
2 1.4 216 3 TestLatLonDocValuesQueries.testAllLatEqual
2 1.4 216 3
TestLatLonDocValuesQueries.testLowCardinality
2 1.9 212 4 TestLatLonPointQueries.testRandomMedium
2 0.9 214 2
TestLatLonPointShapeQueries.testRandomMedium
2 0.5 214 1
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
2 0.5 213 1
TestLucene80DocValuesFormat.testSparseLongNumericsVsStoredFields
2 0.5 213 1
TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue
2 0.5 214 1
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
2 4.0 150 6
TestPhraseWildcardQuery.testOneSingleTermTwoMultiTerms
2 0.5 211 1 TestRestoreCore.testFailedRestore
2 0.5 216 1
TestXYMultiLineShapeQueries.testLowCardinalityShapeManyTimes
2 3.4 29 1
TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation
3 0.5 183 1 AliasIntegrationTest.test
3 0.5 183 1
AliasIntegrationTest.testClusterStateProviderAPI
3 0.5 183 1
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
3 0.5 183 1
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
3 0.5 183 1 AliasIntegrationTest.testErrorChecks
3 0.5 183 1
AliasIntegrationTest.testModifyPropertiesCAR
3 0.5 183 1 AliasIntegrationTest.testModifyPropertiesV1
3 0.5 183 1 AliasIntegrationTest.testModifyPropertiesV2
3 0.5 183 1 AliasIntegrationTest.testProperties
3 0.5 182 1
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
3 0.6 170 1 AuditLoggerIntegrationTest.authValid
3 0.5 185 1
AuditLoggerIntegrationTest.searchWithException
3 0.5 185 1
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
3 1.1 185 2 ChaosMonkeySafeLeaderTest.test
3 0.5 184 1 CloudHttp2SolrClientRetryTest.testRetry
3 0.5 184 1
CloudHttp2SolrClientTest.checkCollectionParameters
3 0.5 184 1
CloudHttp2SolrClientTest.preferLocalShardsTest
3 0.5 184 1
CloudHttp2SolrClientTest.preferReplicaTypesTest
3 0.5 184 1
CloudHttp2SolrClientTest.stateVersionParamTest
3 0.5 184 1 CloudHttp2SolrClientTest.testAliasHandling
3 0.5 184 1
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
3 0.5 184 1
CloudHttp2SolrClientTest.testNonRetryableRequests
3 0.5 184 1
CloudHttp2SolrClientTest.testOverwriteOption
3 0.5 184 1
CloudHttp2SolrClientTest.testParallelUpdateQTime
3 0.5 184 1
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
3 0.5 184 1 CloudHttp2SolrClientTest.testRouting
3 0.5 184 1
CloudHttp2SolrClientTest.testVersionsAreReturned
3 0.5 184 1 CloudSolrClientRetryTest.testRetry
3 0.5 184 1
CloudSolrClientTest.checkCollectionParameters
3 0.5 184 1 CloudSolrClientTest.preferLocalShardsTest
3 0.5 184 1 CloudSolrClientTest.preferReplicaTypesTest
3 0.5 184 1 CloudSolrClientTest.stateVersionParamTest
3 0.5 184 1 CloudSolrClientTest.testAliasHandling
3 0.5 184 1
CloudSolrClientTest.testInitializationWithSolrUrls
3 0.5 184 1
CloudSolrClientTest.testNonRetryableRequests
3 0.5 184 1 CloudSolrClientTest.testOverwriteOption
3 0.5 184 1 CloudSolrClientTest.testParallelUpdateQTime
3 0.5 184 1 CloudSolrClientTest.testPing
3 0.5 184 1
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
3 0.5 184 1 CloudSolrClientTest.testRouting
3 0.5 184 1 CloudSolrClientTest.testVersionsAreReturned
3 0.5 183 1
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
3 0.6 181 1 CollectionTooManyReplicasTest.testAddShard
3 0.6 181 1
CollectionTooManyReplicasTest.testAddTooManyReplicas
3 0.6 181 1
CollectionTooManyReplicasTest.testDownedShards
3 0.5 183 1
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
3 0.5 183 1
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
3 0.5 184 1
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
3 0.5 184 1
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
3 0.6 180 1 DaemonStreamApiTest.testAPIs
3 0.5 183 1 DistribCursorPagingTest.test
3 0.5 183 1 ExecutePlanActionTest.testExecute
3 0.5 183 1 ExecutePlanActionTest.testIntegration
3 0.5 183 1 ExecutePlanActionTest.testTaskFail
3 0.5 183 1 ExecutePlanActionTest.testTaskTimeout
3 0.6 181 1 LeaderFailureAfterFreshStartTest.test
3 0.5 186 1
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
3 0.5 184 1 LegacyFieldFacetCloudTest.countTest
3 0.5 184 1 LegacyFieldFacetCloudTest.maxTest
3 0.5 184 1 LegacyFieldFacetCloudTest.meanTest
3 0.5 184 1
LegacyFieldFacetCloudTest.medianFacetAscTest
3 0.5 184 1 LegacyFieldFacetCloudTest.minTest
3 0.5 184 1 LegacyFieldFacetCloudTest.missingFacetTest
3 0.5 184 1 LegacyFieldFacetCloudTest.missingTest
3 0.5 184 1 LegacyFieldFacetCloudTest.multiValueTest
3 0.5 184 1 LegacyFieldFacetCloudTest.perc20Test
3 0.5 184 1 LegacyFieldFacetCloudTest.perc60Test
3 0.5 184 1
LegacyFieldFacetCloudTest.stddevFacetAscTest
3 0.5 184 1 LegacyFieldFacetCloudTest.sumTest
3 0.5 184 1 LegacyFieldFacetCloudTest.uniqueTest
3 0.5 184 1 LegacyFieldFacetExtrasCloudTest.limitTest
3 0.5 184 1 LegacyFieldFacetExtrasCloudTest.offsetTest
3 0.5 184 1 LegacyFieldFacetExtrasCloudTest.sortTest
3 0.5 184 1 LegacyNoFacetCloudTest.countTest
3 0.5 184 1 LegacyNoFacetCloudTest.maxTest
3 0.5 184 1 LegacyNoFacetCloudTest.meanTest
3 0.5 184 1 LegacyNoFacetCloudTest.medianTest
3 0.5 184 1 LegacyNoFacetCloudTest.minTest
3 0.5 184 1 LegacyNoFacetCloudTest.missingDefaultTest
3 0.5 184 1 LegacyNoFacetCloudTest.perc20Test
3 0.5 184 1 LegacyNoFacetCloudTest.perc60Test
3 0.5 184 1 LegacyNoFacetCloudTest.stddevTest
3 0.5 184 1 LegacyNoFacetCloudTest.sumTest
3 0.5 184 1 LegacyNoFacetCloudTest.uniqueTest
3 0.5 184 1 LegacyQueryFacetCloudTest.queryTest
3 0.5 184 1 LegacyRangeFacetCloudTest.hardendRangeTest
3 0.5 184 1 LegacyRangeFacetCloudTest.multiGapTest
3 0.5 184 1 LegacyRangeFacetCloudTest.rangeTest
3 0.5 182 1
MigrateRouteKeyTest.multipleShardMigrateTest
3 0.5 182 1 MigrateRouteKeyTest.testMissingSplitKey
3 0.5 185 1 OverseerModifyCollectionTest.testModifyColl
3 0.5 185 1 PeerSyncReplicationTest.test
3 0.5 188 1
ReindexCollectionTest.testSameTargetReindexing
3 1.1 184 2 RoutingToNodesWithPropertiesTest.test
3 0.5 183 1 RulesTest.doIntegrationTest
3 1.1 184 2 RulesTest.testHostFragmentRule
3 0.5 183 1 RulesTest.testModifyColl
3 1.1 184 2 RulesTest.testPortRule
3 1.1 184 2
RulesTest.testPortRuleInPresenceOfClusterPolicy
3 0.5 184 1 SearchHandlerTest.testRequireZkConnected
3 0.5 184 1
SearchHandlerTest.testRequireZkConnectedDistrib
3 0.5 184 1 SearchHandlerTest.testZkConnected
3 0.6 181 1 SearchRateTriggerTest.testWaitForElapsed
3 0.5 184 1 ShardRoutingTest.test
3 0.5 183 1 SimpleCollectionCreateDeleteTest.test
3 0.5 184 1 SolrZkClientTest.testWrappingWatches
3 0.5 182 1 SplitByPrefixTest.doTest
3 0.5 184 1 TestAuthenticationFramework.testBasics
3 0.5 184 1
TestCloudCollectionsListeners.testCollectionDeletion
3 0.5 184 1
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
3 0.5 184 1
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
3 0.5 192 1
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
3 0.5 183 1 TestCollectionAPI.test
3 0.5 183 1
TestCollectionAPI.testRecreateCollectionAfterFailure
3 0.5 184 1
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
3 0.5 184 1
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
3 0.5 184 1
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
3 0.5 184 1
TestCollectionStateWatchers.testDeletionsTriggerWatches
3 0.5 184 1
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
3 0.5 184 1
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
3 0.5 184 1
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
3 0.5 184 1
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
3 0.5 183 1
TestCustomStream.testDynamicLoadingCustomStream
3 1.1 185 2 TestDistribDocBasedVersion.test
3 0.5 183 1 TestDistribIDF.testSimpleQuery
3 0.5 184 1
TestDocCollectionWatcher.testDeletionsTriggerWatches
3 0.5 184 1
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
3 0.5 184 1
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
3 0.5 184 1
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
3 0.5 184 1
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
3 0.5 183 1 TestDynamicLoading.testDynamicLoading
3 0.6 181 1 TestDynamicLoadingUrl.testDynamicLoadingUrl
3 0.5 184 1 TestLTROnSolrCloud.testSimpleQuery
3 0.5 188 1
TestLucene50TermVectorsFormat.testRamBytesUsed
3 5.3 19 1
TestLucene70NormsFormat.testSparseNCommonBig
3 0.5 185 1
TestLucene80DocValuesFormat.testRandomAdvanceBinary
3 0.5 185 1
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
3 0.6 173 1 TestPackages.testAPI
3 0.5 183 1 TestPrepRecovery.testLeaderNotResponding
3 0.5 183 1 TestPrepRecovery.testLeaderUnloaded
3 0.5 183 1
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
3 0.5 183 1 TestRecovery.testExistOldBufferLog
3 0.5 183 1 TestSolrConfigHandlerCloud.test
3 0.5 184 1 TestV2Request.testCloudSolrClient
3 0.5 184 1 TestV2Request.testHttpSolrClient
3 0.5 184 1 TestV2Request.testV2Forwarding
3 1.1 185 2 TestWithCollection.testAddReplicaWithPolicy
3 1.1 185 2 TestWithCollection.testCreateCollection
3 1.1 185 2
TestWithCollection.testCreateCollectionNoWithCollection
3 1.1 185 2 TestWithCollection.testDeleteWithCollection
3 1.1 185 2
TestWithCollection.testMoveReplicaMainCollection
3 1.1 185 2
TestWithCollection.testMoveReplicaWithCollection
3 1.1 185 2
TestWithCollection.testMultipleWithCollections
3 1.1 185 2 TestWithCollection.testNodeAdded
3 0.5 184 1
TestZKPropertiesWriter.testZKPropertiesWriter
3 0.5 187 1 ZkConfigFilesTest.testCanUploadConfigToZk
***********************Annotations report
Number of AwaitsFix: 40 Number of BadApples: 7
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)
************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)
ComputePlanActionTest.testNodeLost
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)
MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) //
added 03-Oct-2018
ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
ReplaceNodeNoTargetTest.test
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
RoutedAliasUpdateProcessorTest.alias,
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)
ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
ScheduledTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
added 20-Sep-2018
SearchRateTriggerIntegrationTest.testDeleteNode
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)
SearchRateTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
TestSimComputePlanAction.testNodeLost
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) //
if you beast this, eventually you will see
TestSimExtremeIndexing.TestSimExtremeIndexing suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)
TestSimLargeCluster.testBasic
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
this test hits a timeout easily
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 6-Sep-2018
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)
TriLevelCompositeIdRoutingTest.test
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
MultiThreadedOCPTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// added 20-Jul-2018
SolrZkClientTest.testSimpleUpdateACLs
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
6-Sep-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059";)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
