The second chart is clearly bad and getting worse. Our flake bugs are not getting addressed in a timely manner.
Zooming in on the first chart for the last 3 months you can see a notable change: https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=464&projectKey=BEAM&view=reporting&chart=cumulativeFlowDiagram&swimlane=1174&swimlane=1175&column=2038&column=2039&column=2040&days=90. This will not change the average in the second chart very quickly. It may be just cleanup. That seems likely. Anecdotally, I have done a lot of triage recently of failures and I know of only two severe flakes (that you can count on seeing in a day/week). If so, then more cleanup would be valuable. This is why I ran the second report: I suspected that we had a lot of very old stale flake bugs that noone is looking at. Kenn On Fri, May 7, 2021 at 4:37 PM Ahmet Altay <[email protected]> wrote: > Thank you for sharing the charts. > > I know you are the messenger here, but I disagree with the message that > flakes are getting noticeably better. Number of open issues look quite > large but at least stable. I will guess that some of those are stale and > seemingly we did a clean up in July 2020. We can try that again. Second > chart shows a bad picture IMO. Issues staying open for 500-600 days on > average sounds like really long. > > On Fri, May 7, 2021 at 1:42 PM Kenneth Knowles <[email protected]> wrote: > >> Alright, I think it should be fixed. The underlying saved filter had not >> been shared. >> >> Kenn >> >> On Fri, May 7, 2021 at 8:02 AM Brian Hulette <[email protected]> wrote: >> >>> The first link doesn't work for me, I just see a blank page with some >>> jira header and navbar. Do I need some additional permissions? >>> >>> If I click over to "Kanban Board" on the toggle at the top right I see a >>> card with "Error: The requested board cannot be viewed because it either >>> does not exist or you do not have permission to view it." >>> >>> Brian >>> >>> On Thu, May 6, 2021 at 5:56 PM Kenneth Knowles <[email protected]> wrote: >>> >>>> I spoke too soon? >>>> >>>> >>>> https://issues.apache.org/jira/secure/ConfigureReport.jspa?projectOrFilterId=project-12319527&periodName=daily&daysprevious=300&selectedProjectId=12319527&reportKey=com.atlassian.jira.jira-core-reports-plugin%3Aaverageage-report&atl_token=A5KQ-2QAV-T4JA-FDED_ea6ac783c727523cf6bfed04ba94ce91bb62da91_lin&Next=Next >>>> >>>> On Thu, May 6, 2021 at 5:54 PM Kenneth Knowles <[email protected]> wrote: >>>> >>>>> I made a quick* Jira chart to see how we are doing at flakes: >>>>> >>>>> >>>>> https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=464&projectKey=BEAM&view=reporting&chart=cumulativeFlowDiagram&swimlane=1174&swimlane=1175&column=2038&column=2039&column=2040 >>>>> >>>>> Looking a lot better recently at resolving them! (whether these are >>>>> new fixes or just resolving stale bugs, I love it) >>>>> >>>>> Kenn >>>>> >>>>> *AFAICT you need to make a saved search, then an agile board based on >>>>> the saved search, then you can look at reports >>>>> >>>>
