+1 great proposal. On Mon, Feb 14, 2022, 2:33 PM Kenneth Knowles <k...@apache.org> wrote:
> Yea, great proposal. I expect we'll discover further refinements through > experience more than deliberation, so I don't have any more comments on the > doc. > > Kenn > > On Mon, Feb 14, 2022 at 9:04 AM Kerry Donny-Clark <kerr...@google.com> > wrote: > >> Thanks Danny, we can try this out and update as well. Everyone, please >> let us know how this is working in practice once we roll it out. >> Kerry >> >> On Mon, Feb 14, 2022 at 11:23 AM Danny McCormick < >> dannymccorm...@google.com> wrote: >> >>> Thank you everyone who has chimed in here or on the doc - there's been a >>> lot of good discussion and I think that will lead to a much better outcome! >>> >>> Since there's been general support for the idea and the flow of new >>> comments tapered off a bit before the weekend, I'm going to go ahead and >>> start to move forward with building out the automation (tracking JIRA here >>> - https://issues.apache.org/jira/browse/BEAM-13925). Please feel free >>> to leave any more thoughts in the doc and I promise I will respond/work to >>> incorporate any thoughts that merit tweaking the design. >>> >>> Thanks, >>> Danny >>> >>> On Fri, Feb 11, 2022 at 12:34 PM Robert Bradshaw <rober...@google.com> >>> wrote: >>> >>>> This looks like a great plan! I remember being disappointed when >>>> CODEOWNERs didn't meet our needs, but this looks like it resolves all >>>> those issues. >>>> >>>> On Fri, Feb 11, 2022 at 9:02 AM Chamikara Jayalath < >>>> chamik...@google.com> wrote: >>>> > >>>> > Thanks. I think this is shaping up to be a great proposal. >>>> > >>>> > - Cham >>>> > >>>> > On Fri, Feb 11, 2022 at 7:12 AM Jarek Potiuk <ja...@potiuk.com> >>>> wrote: >>>> >> >>>> >> Cool. Looking forward to see how it goes for Beam. We will also be >>>> at the point soon that likely we will want to do something more >>>> sophisticated! >>>> >> >>>> >> On Fri, Feb 11, 2022 at 4:08 PM Danny McCormick < >>>> dannymccorm...@google.com> wrote: >>>> >>> >>>> >>> Hey Jared, thanks for chiming in - I've been really appreciative of >>>> the Airflow perspective (here and in the GitHub issues conversation), and >>>> definitely hope we can keep learning from each other! We did consider >>>> CODEOWNERs, but ultimately decided against it because it couldn't hit some >>>> of our goals - specifically: >>>> >>> >>>> >>> 1. Providing multiple passes of assignment (once to a larger set of >>>> reviewers, and then again to a second set of committers). >>>> >>> >>>> >>> 2. Balancing reviews - like you mentioned, there's not a great way >>>> to do round robining, or even assign to a single person from a set of >>>> people. Technically you can actually do this if every codeowner is part of >>>> a team (https://twitter.com/github/status/1194673101117808653?lang=en), >>>> but many Beam reviewers in our new model won't be a part of the Apache org. >>>> (Maybe that feature would be of interest to Airflow though? It looks like >>>> maybe all of your CODEOWNERS are part of the Apache org? I can't 100% >>>> tell). >>>> >>> >>>> >>> 3. Don't break the existing use case where a contributor wants a >>>> review from a specific person. >>>> >>> >>>> >>> Thanks, >>>> >>> Danny >>>> >>> >>>> >>> On Thu, Feb 10, 2022 at 7:52 AM Jarek Potiuk <ja...@potiuk.com> >>>> wrote: >>>> >>>> >>>> >>>> Very interesting one - as an outsider I am interested to see how >>>> this initiative will work out for the beam community. >>>> >>>> >>>> >>>> Just one comment - maybe you do not know but in GitHub there is a >>>> "CODEOWNERS" feature (I notice you are not using it). Quote from >>>> https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-code-owners >>>> >>>> >>>> >>>> | Code owners are automatically requested for review when someone >>>> opens a pull request that modifies code that they own. Code owners are not >>>> automatically requested to review draft pull requests. For more information >>>> about draft pull requests, see "About pull requests." When you mark a draft >>>> pull request as ready for review, code owners are automatically notified. >>>> If you convert a pull request to a draft, people who are already subscribed >>>> to notifications are not automatically unsubscribed. For more information, >>>> see "Changing the stage of a pull request." >>>> >>>> >>>> >>>> This is an extremely poor version of what you try to do in Beam >>>> (just assign everyone who is code owner as reviewer, no round-robin, no >>>> reviewers role etc.), but maybe you want to try it quickly if you want to >>>> test if any kind of "ownership" might help with at least initial vetting of >>>> PRs. >>>> >>>> This feature is enabled by literally committing one - >>>> gitignore-like - file to repo, so it can be introduced extremely quickly. >>>> >>>> >>>> >>>> Airlfow's CODEOWNERS here as an example: >>>> https://github.com/apache/airflow/blob/main/.github/CODEOWNERS >>>> >>>> >>>> >>>> J. >>>> >>>> >>>> >>>> On Thu, Feb 10, 2022 at 7:31 AM Ahmet Altay <al...@google.com> >>>> wrote: >>>> >>>>> >>>> >>>>> Thank you Danny. I think this is a great problem to solve, and >>>> the proposal looks great too :) I added comments as others but overall I >>>> like it. >>>> >>>>> >>>> >>>>> On Wed, Feb 9, 2022 at 3:02 PM Brian Hulette <bhule...@google.com> >>>> wrote: >>>> >>>>>> >>>> >>>>>> Thanks Danny! I left a few suggestions in the doc but I very >>>> much like this idea overall. >>>> >>>>>> >>>> >>>>>> I especially like that "reviewers" is orthogonal to >>>> "committers", giving new contributors a clear way to volunteer to help out >>>> with code reviews. If we do this we should document it in the contribution >>>> guide [1]. >>>> >>>>>> >>>> >>>>>> [1] https://beam.apache.org/contribute/ >>>> >>>>>> >>>> >>>>>> On Wed, Feb 9, 2022 at 2:54 PM Kerry Donny-Clark < >>>> kerr...@google.com> wrote: >>>> >>>>>>> >>>> >>>>>>> Danny, this looks like a great mechanism to ensure we review >>>> PRs quickly and distribute the review work more evenly. >>>> >>>>>>> Thanks for outlining a clear plan. I strongly support this. >>>> >>>>>>> Kerry >>>> >>>>>>> >>>> >>>>>>> On Wed, Feb 9, 2022, 5:16 PM Danny McCormick < >>>> dannymccorm...@google.com> wrote: >>>> >>>>>>>> >>>> >>>>>>>> Hey everyone, I put together a design doc for automating the >>>> assignment of reviewers in Beam pull requests. I'd appreciate any thoughts >>>> you have! >>>> >>>>>>>> >>>> >>>>>>>> Right now, we don't have a well defined automated system for >>>> staying on top of pull request reviews - we rely on contributors being able >>>> to find the correct OWNERS file and committers manually triaging/calling >>>> attention to old pull requests. This doc proposes adding automation driven >>>> by GitHub Actions to automatically round robin new PR reviews to a set of >>>> contributors, thus balancing the load. It also proposes adding a new role >>>> within the beam community of a reviewer who is responsible for an initial >>>> code review on some PRs before they are routed to a committer for final >>>> review. >>>> >>>>>>>> >>>> >>>>>>>> Please share any feedback or support here - >>>> https://docs.google.com/document/d/1FhRPRD6VXkYlLAPhNfZB7y2Yese2FCWBzjx67d3TjBo/edit?usp=sharing >>>> >>>>>>>> >>>> >>>>>>>> Thanks, >>>> >>>>>>>> Danny >>>> >>>