[ 
https://issues.apache.org/jira/browse/PHOENIX-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072468#comment-17072468
 ] 

Istvan Toth commented on PHOENIX-5769:
--------------------------------------

Looking at 
https://builds.apache.org/job/PreCommit-PHOENIX-Build/3690/artifact/phoenix-core/target/failsafe-reports/
It is apparent that some output files are not closed until the test is aborted.

{noformat}
org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT.txt   
31-Mar-2020 18:35:53    381 B    view
org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT-output.txt    
31-Mar-2020 21:40:36    13.81 MB
{noformat}

Bafflingly, these tests run successfully, and I could not found any indication 
of problem in the output files either.
I suspect that these tests leak some miniClusters/threads, as most of them 
diverge from the standard cluser setup/teardown procedure.

> Phoenix precommit Flapping HadoopQA Tests in master 
> ----------------------------------------------------
>
>                 Key: PHOENIX-5769
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5769
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Daniel Wong
>            Assignee: Istvan Toth
>            Priority: Major
>         Attachments: PHOENIX-5769.master.v1.patch, 
> PHOENIX-5769.master.v3.patch, consoleFull (1).html, consoleFull (2).html, 
> consoleFull (3).html, consoleFull (4).html, consoleFull (5).html, consoleFull 
> (6).html, consoleFull (7).html, consoleFull (8).html, consoleFull.html
>
>
> I was recently trying to commit changes to Phoenix for multiple issues and 
> were asked to get clean HadoopQA runs.  However, this took a huge effort as I 
> had to resubmit the same patch multiple times in order to get one "clean".  
> Looking at the errors the most common one were 3 "Multiple regions on 
> <hostname,regions>" and 3 for apache infra issues (host shutdown), 1 for 
> org.apache.hadoop.hbase.NotServingRegionException, 1 for 
> SnapshotDoesNotExistException.   See builds 
> [https://builds.apache.org/job/PreCommit-PHOENIX-Build/] here from 3540's to 
> 3560's.  In addition I see multiple builds running simultaneously, limiting 
> tests to running on 1 host should be configurable right?
> In addition I was recommended by [~yanxinyi] that master was less likely to 
> have issues getting a clean run than 4.x.  FYI [~ckulkarni]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to