damccorm opened a new issue, #21420:
URL: https://github.com/apache/beam/issues/21420

   We should measure the following to see how automated PR assignment is going:
   
    
   
   *Author Experience Metrics*
   |*Metric*|*Expectation if the system works*|
   |Average time to first review|Should go down |
   |Average time to first review for new contributors (first PR 
experience)|Should go down|
   |Average time from PR creation to completion|Should be relatively stable|
   
   
   
   
   
   *Reviewer Experience Metrics*
   |*Metric*|*Expectation if the system works*|
   |Daily average number of users performing reviews|Should go up |
   |Number of times committers are tagged on PRs|Should be stable|
   |Average time between a committer being tagged on a PR and PR merge|Should 
go down|
   
   Imported from Jira 
[BEAM-13940](https://issues.apache.org/jira/browse/BEAM-13940). Original Jira 
may contain additional context.
   Reported by: damccorm.
   Subtask of issue #21417


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to