Mike Drob created SOLR-16322:
--------------------------------

             Summary: Beast task does not print correct seeds
                 Key: SOLR-16322
                 URL: https://issues.apache.org/jira/browse/SOLR-16322
             Project: Solr
          Issue Type: Bug
            Reporter: Mike Drob


When there are multiple failing seeds, the beast task will not print all of 
them in the summary. Instead I have to go to the individual failing test 
outputs to find all of the seeds.

For example, the summary output at the end will show:

{noformat}
ERROR: The following test(s) have failed:
  - 
org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues
 (:solr:core)
    Test output: 
/Users/mdrob/code/solr/solr/core/build/test-results/test_16/outputs/OUTPUT-org.apache.solr.uninverting.TestUninvertingReader.txt
    Reproduce with: gradlew :solr:core:test --tests 
"org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues"
 -Ptests.jvms=16 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:ReservedCodeCacheSize=120m" -Ptests.seed=98CEE6B610F6FC3A 
-Ptests.badapples=true -Ptests.file.encoding=UTF-8 -Ptests.dups=50

  - 
org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues
 (:solr:core)
    Test output: 
/Users/mdrob/code/solr/solr/core/build/test-results/test_1/outputs/OUTPUT-org.apache.solr.uninverting.TestUninvertingReader.txt
    Reproduce with: gradlew :solr:core:test --tests 
"org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues"
 -Ptests.jvms=16 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:ReservedCodeCacheSize=120m" -Ptests.seed=98CEE6B610F6FC3A 
-Ptests.badapples=true -Ptests.file.encoding=UTF-8 -Ptests.dups=50

  - 
org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues
 (:solr:core)
    Test output: 
/Users/mdrob/code/solr/solr/core/build/test-results/test_2/outputs/OUTPUT-org.apache.solr.uninverting.TestUninvertingReader.txt
    Reproduce with: gradlew :solr:core:test --tests 
"org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues"
 -Ptests.jvms=16 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:ReservedCodeCacheSize=120m" -Ptests.seed=98CEE6B610F6FC3A 
-Ptests.badapples=true -Ptests.file.encoding=UTF-8 -Ptests.dups=50

  - 
org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues
 (:solr:core)
    Test output: 
/Users/mdrob/code/solr/solr/core/build/test-results/test_14/outputs/OUTPUT-org.apache.solr.uninverting.TestUninvertingReader.txt
    Reproduce with: gradlew :solr:core:test --tests 
"org.apache.solr.uninverting.TestUninvertingReader.testSortedSetIntegerManyValues"
 -Ptests.jvms=16 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 
-XX:ReservedCodeCacheSize=120m" -Ptests.seed=98CEE6B610F6FC3A 
-Ptests.badapples=true -Ptests.file.encoding=UTF-8 -Ptests.dups=50
{noformat}

We can see that here every seed is {{98CEE6B610F6FC3A}}. However, if I go to 
the individual test outputs, I see a bunch of different seeds (none of which 
are actually this seed!)

I was seeing this on my fork 
https://github.com/madrob/solr/commit/314716a681d71d95d27640e06f7aeb422504287c 
in case anybody wants to try reproduce it, or you could introduce your own 
randomly failing test.

cc [~uschindler] [~dweiss]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to