That is actually a fairly good heuristic. To expand on that idea, I think we should exclude PRs that have been explicitly labelled as AI spam. I have done a few reviews where I have written dozens of comments only to realize that the author is just using an Agent to spam commits. And then the PR gets closed without any of the comments being incorporated. We can also account for what I call 'non-blocking' suggestions i.e. it's the author's choice to implement. Does anybody else here have any ideas on how we further build on this idea? Slop reviews are certainly a problem (though not as endemic as Slop PRs). In some ways, they are worse, because you feel gaslit but at the same time, you want feedback because you might be unsure of something.
On Tue, 23 Jun 2026 at 02:30, Ghaeli, Sean <[email protected]> wrote: > A way to prevent slop reviews is to weight an author's review score by the > extent to which it became incorporated in the implementation. A review that > results in no changes is given no weight. > >
