This PR adds a check for the format of ProblemList files and ensures they only
have entries referring to existing tests.
The cleanups in the second commit of this PR were done based on the output of
`CheckProblemLists`:
> make test TEST=build/problemLists/CheckProblemLists.java
...
STDOUT:
Checking
/Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList-Virtual.txt
Checking
/Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList-Xcomp.txt
Checking
/Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList-generational-zgc.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList-zgc.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/jaxp/ProblemList.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-Virtual.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-Xcomp.txt
Checking
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-generational-zgc.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-zgc.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/langtools/ProblemList.txt
Checking /Users/dnsimon/dev/jdk-jdk/open/test/lib-test/ProblemList.txt
Checked 13 problem list files
Test roots:
/Users/dnsimon/dev/jdk-jdk/open/test/jdk
/Users/dnsimon/dev/jdk-jdk/open/test/lib-test
/Users/dnsimon/dev/jdk-jdk/open/test/failure_handler/test
/Users/dnsimon/dev/jdk-jdk/open/test/jaxp
/Users/dnsimon/dev/jdk-jdk/open/test/langtools
/Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg
Following errors found:
/Users/dnsimon/dev/jdk-jdk/open/test/hotspot/jtreg/ProblemList.txt:174:
vmTestbase/gc/lock/jni/jnilock002/TestDescription.java does not exist under any
test root
vmTestbase/gc/lock/jni/jnilock002/TestDescription.java 8192647 generic-all
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-Virtual.txt:77:
TestAndIssue[test=java/util/Properties/StoreReproducibilityTest.java,
issueId=0000000] duplicates
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList-Virtual.txt:76
java/util/Properties/StoreReproducibilityTest.java 0000000 generic-all
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList.txt:516:
java/lang/management/MemoryMXBean/PendingAllGC.sh does not exist under any test
root
java/lang/management/MemoryMXBean/PendingAllGC.sh 8158837
generic-all
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList.txt:667:
javax/swing/JFileChooser/6798062/bug6798062.java does not exist under any test
root
javax/swing/JFileChooser/6798062/bug6798062.java 8146446 windows-all
/Users/dnsimon/dev/jdk-jdk/open/test/jdk/ProblemList.txt:775:
javax/swing/JTabbedPane/4666224/bug4666224.java does not exist under any test
root
javax/swing/JTabbedPane/4666224/bug4666224.java 8144124 macosx-all
STDERR:
java.lang.AssertionError: 5 errors found while checking 13 problem list files
at CheckProblemLists.main(CheckProblemLists.java:96)
at
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at
com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:333)
at java.base/java.lang.Thread.run(Thread.java:1575)
-------------
Commit messages:
- removed problem list entries referring to non-existent tests
- added CheckProblemLists
Changes: https://git.openjdk.org/jdk/pull/18879/files
Webrev: https://webrevs.openjdk.org/?repo=jdk&pr=18879&range=00
Issue: https://bugs.openjdk.org/browse/JDK-8330755
Stats: 217 lines in 4 files changed: 211 ins; 6 del; 0 mod
Patch: https://git.openjdk.org/jdk/pull/18879.diff
Fetch: git fetch https://git.openjdk.org/jdk.git pull/18879/head:pull/18879
PR: https://git.openjdk.org/jdk/pull/18879
