Danny McCormick created BEAM-13940:
--------------------------------------

             Summary: Add script for generating PR metrics
                 Key: BEAM-13940
                 URL: https://issues.apache.org/jira/browse/BEAM-13940
             Project: Beam
          Issue Type: Sub-task
          Components: beam-community
            Reporter: Danny McCormick


We should measure the following to see how automated PR assignment is going:

 

*Author Experience Metrics*
|*Metric*|*Expectation if the system works*|
|Average time to first review|Should go down |
|Average time to first review for new contributors (first PR experience)|Should 
go down|
|Average time from PR creation to completion|Should be relatively stable|





*Reviewer Experience Metrics*
|*Metric*|*Expectation if the system works*|
|Daily average number of users performing reviews|Should go up |
|Number of times committers are tagged on PRs|Should be stable|
|Average time between a committer being tagged on a PR and PR merge|Should go 
down|



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to