On Fri, 17 Sep 2021 06:59:09 GMT, Aleksey Shipilev <sh...@openjdk.org> wrote:
>> During the review of JDK-8272914 that added hotspot:tier{2,3} groups,
>> @iignatev suggested to create tier4 groups that capture all tests not in
>> tiers{1,2,3}.
>>
>> Caveats:
>> - I excluded `applications` from `hotspot:tier4`, because they require test
>> dependencies (e.g. jcstress).
>> - `jdk:tier4` only runs well with `JTREG_KEYWORDS=!headful` or reduced
>> concurrency with `TEST_JOBS=1`, because headful tests cannot run in parallel
>>
>> Sample run with `JTREG_KEYWORDS=!headful`:
>>
>>
>> ==============================
>> Test summary
>> ==============================
>> TEST TOTAL PASS FAIL ERROR
>>
>>>> jtreg:test/hotspot/jtreg:tier4 3585 3584 0 1
>>>> <<
>>>> jtreg:test/jdk:tier4 2893 2887 5 1
>>>> <<
>> jtreg:test/langtools:tier4 0 0 0 0
>>
>> jtreg:test/jaxp:tier4 0 0 0 0
>>
>> ==============================
>>
>> real 699m39.462s
>> user 6626m8.448s
>> sys 1110m43.704s
>>
>>
>> There are interesting test failures on my machine, which I would address
>> separately.
>
> Aleksey Shipilev has updated the pull request with a new target base due to a
> merge or a rebase. The incremental webrev excludes the unrelated changes
> brought in by the merge/rebase. The pull request contains five additional
> commits since the last revision:
>
> - Merge branch 'master' into JDK-8273314-tier4
> - Merge branch 'master' into JDK-8273314-tier4
> - Drop applications and fix the comment
> - Drop exceptions
> - Add tier4 test groups
It is fine to run headful and headless tests separately.
-------------
Marked as reviewed by serb (Reviewer).
PR: https://git.openjdk.java.net/jdk/pull/5357
