Hi Vitaly,

I wanted to acknowledge your email and we will review your questions and get 
back to you soon.

Thanks,
Sandeep

> On Oct 3, 2016, at 7:35 PM, Vitaly Provodin <vitaly.provo...@jetbrains.com> 
> wrote:
> 
> Hello,
> 
> My question relates to failures of the Regression tests (jdk/test) on 
> OpenJDK8 and how to identify whether a failure is expected or not.
> 
> Running java/awt and javax/swing tests against OpenJDK8 on various platforms 
> I got some failures. Trying to find any explanations for these failures I 
> looked through the JDK Bug System and could not find any bugs explaining 
> them, for example, for the following two tests
> 
> -java/awt/Frame/UnfocusableMaximizedFrameResizablity/UnfocusableMaximizedFrameResizablity.java
> 
>> Failed.
>> Program 
>> `/Users/builduser/buildAgent/work/13ab0d4c51b0de0b/jbsdk/jdk/Contents/Home/bin/java'
>>  timed out (timeout set to 240000ms, elapsed time was 240786ms).
> - javax/swing/JPopupMenu/6800513/bug6800513.java
> 
> 
>> Failed.
>> Execution failed: `main' threw exception: java.lang.Exception: popup class 
>> is: javax.swing.PopupFactory$HeavyWeightPopup, expected: 
>> javax.swing.PopupFactory$LightWeightPopup
> 
> I found out that these tests were excluded from runs against JDK 8 Update 
> Releases Early Access Build (EAB) - see Test Results page at 
> http://download.java.net/openjdk/testresults/8. Please note, I do not know 
> the status of these results, whether they are actual for OpenJDK8 final 
> release or not. Also, I paid attention to that most of the failures I am 
> talking about are  not included into jdk/test/ProblemList.txt as for now.
> 
> Supposing once these tests were excluded from runs, there were some causes 
> for that e.g. some known product or test issues which were not intended to be 
> fixed for this particular release. My question is how can I get to know these 
> causes in order to differentiate expected and unexpected failures - any of 
> these tests, which were excluded from EAB runs because of one issue, may fail 
> because of another.
> 
> I tried to follow the link at Summary column placed on the page 
> http://download.java.net/openjdk/testresults/9 and could not get information 
> about statuses of the tests (similar to OpenJDK8). So another question, how 
> can I get the list of regression tests (if any) which expectedly fail for 
> some particular OpenJDK release?
> 
> Thanks,
> 
> Vitaly 

Reply via email to