Hi Rory and all, Before I go through creating a bug, I wanted to run this one by you all first. All tests pass on Java 8 and 11. We have known failures on 15, and new ones on 16.
Just like Apache Commons Lang [https://github.com/apache/commons-lang] ran into issues https://bugs.openjdk.java.net/browse/JDK-8248434 and https://bugs.openjdk.java.net/browse/JDK-8248655) on Java 15 now fixed on Java 16, we've found another that fails on Java 15 and 16-ea+29 with locale sq_MK in our unit test org.apache.commons.lang3.time.Java15BugFastDateParserTest which you see in action here: https://github.com/apache/commons-lang/runs/1622593373?check_suite_focus=true How to reproduce (requires git and Apache Maven): git clone https://gitbox.apache.org/repos/asf/commons-lang.git mvn clean test For example, we expect to parse a date into a certain value but we get an unexpected value: Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003 Here it is in the build: Error: Tests run: 18, Failures: 16, Errors: 0, Skipped: 0, Time elapsed: 0.658 s <<< FAILURE! - in org.apache.commons.lang3.time.Java15BugFastDateParserTest Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(TriFunction)[1] Time elapsed: 0.14 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : mb.K./2003/shkurt/0010/0012/0000/00/e paradites/e hënë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(Java15BugFastDateParserTest.java:94) In case the GitHub build falls off, here is the complete list of errors: Error: Tests run: 18, Failures: 16, Errors: 0, Skipped: 0, Time elapsed: 0.658 s <<< FAILURE! - in org.apache.commons.lang3.time.Java15BugFastDateParserTest Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(TriFunction)[1] Time elapsed: 0.14 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : mb.K./2003/shkurt/0010/0012/0000/00/e paradites/e hënë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(Java15BugFastDateParserTest.java:94) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(TriFunction)[2] Time elapsed: 0.04 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : mb.K./2003/shkurt/0010/0012/0000/00/e paradites/e hënë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_AD(Java15BugFastDateParserTest.java:94) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_BC(TriFunction)[1] Time elapsed: 0.057 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : p.K./2003/shkurt/0010/0012/0000/00/e paradites/e shtunë, Java: 16-ea+29 ==> expected: <Sat Feb 10 00:00:00 GMT+00:00 2003> but was: <Mon Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_BC(Java15BugFastDateParserTest.java:101) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_BC(TriFunction)[2] Time elapsed: 0.033 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : p.K./2003/shkurt/0010/0012/0000/00/e paradites/e shtunë, Java: 16-ea+29 ==> expected: <Sat Feb 10 00:00:00 GMT+00:00 2003> but was: <Mon Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Long_BC(Java15BugFastDateParserTest.java:101) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_AD(TriFunction)[1] Time elapsed: 0.011 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/2/10/12/e paradites/0/0/Hën, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_AD(Java15BugFastDateParserTest.java:136) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_AD(TriFunction)[2] Time elapsed: 0.01 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/2/10/12/e paradites/0/0/Hën, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_AD(Java15BugFastDateParserTest.java:136) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_BC(TriFunction)[1] Time elapsed: 0.011 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/2/10/12/e paradites/0/0/Sht, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_BC(Java15BugFastDateParserTest.java:143) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_BC(TriFunction)[2] Time elapsed: 0.011 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/2/10/12/e paradites/0/0/Sht, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_ShortNoEra_BC(Java15BugFastDateParserTest.java:143) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_AD(TriFunction)[1] Time elapsed: 0.012 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/shkurt/0010/0012/0000/00/e paradites/e hënë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_AD(Java15BugFastDateParserTest.java:108) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_AD(TriFunction)[2] Time elapsed: 0.028 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/shkurt/0010/0012/0000/00/e paradites/e hënë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_AD(Java15BugFastDateParserTest.java:108) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_BC(TriFunction)[1] Time elapsed: 0.029 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/shkurt/0010/0012/0000/00/e paradites/e shtunë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_BC(Java15BugFastDateParserTest.java:115) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_BC(TriFunction)[2] Time elapsed: 0.026 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : 2003/shkurt/0010/0012/0000/00/e paradites/e shtunë, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_LongNoEra_BC(Java15BugFastDateParserTest.java:115) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_AD(TriFunction)[1] Time elapsed: 0.033 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : mb.K./2003/2/10/12/e paradites/0/0/Hën, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_AD(Java15BugFastDateParserTest.java:122) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_AD(TriFunction)[2] Time elapsed: 0.019 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : mb.K./2003/2/10/12/e paradites/0/0/Hën, Java: 16-ea+29 ==> expected: <Mon Feb 10 00:00:00 GMT+00:00 2003> but was: <Wed Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_AD(Java15BugFastDateParserTest.java:122) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_BC(TriFunction)[1] Time elapsed: 0.013 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : p.K./2003/2/10/12/e paradites/0/0/Sht, Java: 16-ea+29 ==> expected: <Sat Feb 10 00:00:00 GMT+00:00 2003> but was: <Mon Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_BC(Java15BugFastDateParserTest.java:129) Error: org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_BC(TriFunction)[2] Time elapsed: 0.012 s <<< FAILURE! org.opentest4j.AssertionFailedError: locale : sq_MK, formattedDate : p.K./2003/2/10/12/e paradites/0/0/Sht, Java: 16-ea+29 ==> expected: <Sat Feb 10 00:00:00 GMT+00:00 2003> but was: <Mon Feb 12 12:00:00 GMT+00:00 2003> at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales(Java15BugFastDateParserTest.java:86) at org.apache.commons.lang3.time.Java15BugFastDateParserTest.testLocales_Short_BC(Java15BugFastDateParserTest.java:129) [INFO] Running org.apache.commons.lang3.time.DateUtilsFragmentTest [INFO] Tests run: 57, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 s - in org.apache.commons.lang3.time.DateUtilsFragmentTest [INFO] Running org.apache.commons.lang3.time.FastDateParser_MoreOrLessTest [INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 s - in org.apache.commons.lang3.time.FastDateParser_MoreOrLessTest [INFO] Running org.apache.commons.lang3.time.FastDateParserTest Error: Tests run: 43, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.368 s <<< FAILURE! - in org.apache.commons.lang3.time.FastDateParserTest Error: org.apache.commons.lang3.time.FastDateParserTest.testParses Time elapsed: 0.104 s <<< FAILURE! org.opentest4j.AssertionFailedError: sq_MK Thu Feb 10 05:00:00 GMT+00:00 2000 GGGG/yyyy/MMMM/dddd/hhhh/mmmm/ss/aaaa/EEEE America/New_York ==> expected: <Thu Feb 10 05:00:00 GMT+00:00 2000> but was: <Sat Feb 12 17:00:00 GMT+00:00 2000> at org.apache.commons.lang3.time.FastDateParserTest.validateSdfFormatFdpParseEquality(FastDateParserTest.java:693) at org.apache.commons.lang3.time.FastDateParserTest.testParses(FastDateParserTest.java:526) TY! Gary
