Excerpts from Zane Bitter's message of 2013-12-09 09:52:25 -0800: > On 09/12/13 06:31, Steven Hardy wrote: > > Hi all, > > > > So I've been getting concerned about $subject recently, and based on some > > recent discussions so have some other heat-core folks, so I wanted to start > > a discussion where we can agree and communicate our expectations related to > > nomination for heat-core membership (becuase we do need more core > > reviewers): > > > > The issues I have are: > > - Russell's stats (while very useful) are being used by some projects as > > the principal metric related to -core membership (ref TripleO's monthly > > cull/name&shame, which I am opposed to btw). This is in some cases > > encouraging some stats-seeking in our review process, IMO. > > > > - Review quality can't be measured mechanically - we have some folks who > > contribute fewer, but very high quality reviews, and are also very active > > contributors (so knowledge of the codebase is not stale). I'd like to > > see these people do more reviews, but removing people from core just > > because they drop below some arbitrary threshold makes no sense to me. > > +1 > > Fun fact: due to the quirks of how Gerrit produces the JSON data dump, > it's not actually possible for the reviewstats tools to count +0 > reviews. So, for example, one can juice one's review stats by actively > obstructing someone else's work (voting -1) when a friendly comment > would have sufficed. This is one of many ways in which metrics offer > perverse incentives. > > Statistics can be useful. They can be particularly useful *in the > aggregate*. But as soon as you add a closed feedback loop you're no > longer measuring what you originally thought - mostly you're just > measuring the gain of the feedback loop. >
I think I understand the psychology of stats and incentives, and I know that this _may_ happen. However, can we please be more careful about how this is referenced? Your message above is suggesting the absolute _worst_ behavior from our community. That is not what I expect, and I think anybody who was doing that would be dealt with _swiftly_. _______________________________________________ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev