We typically reroll and revote several times. This ok and rerolling is
expected (you need it for quality). But there is a cost to rerolling:
- if the binaries are too much of moving target people wait to give their
feedback
- it isn't realistic or a good use of time to expect people to honestly
evaluate multiple sets of binaries
- we loose many votes on each reroll and final votes usually have a fraction
of the +1s
- people feel bad about voting -1 and they shouldn't -- it's ok if done in a
timely manner
As an experiment for this vote (we'll see how it goes), I'd like to enforce a
strict 72 hour period. If you plan on voting, get your vote in by Friday 10pm
PDT.
Here's the thinking....
FIRST VOTE
You should feel welcome and encouraged to vote -1 in this time. You aren't
raining on anyone's parade :) In fact, you are contributing to quality. It
looks negative "-1", but it is actually a positive contribution. Please use
the "-1" for clarity.
SECOND VOTE
At the end of this 72 hour period we will roll a second set of binaries that
incorporate all the feedback of the first.
- Everyone who voted in the first vote will be expected to vote again.
- The vote will close when either:
- everyone from the first vote has vote again
- 72 hours
The vote can close early if everyone reaffirms their +1s or that their issue
(-1) was addressed, so please reaffirm your vote.
This can be a very short vote if everyone cooperates. So 5 minutes or 72
hours, it's up to us :)
Subsequent votes, if needed, will follow these rules.
MAKING UP FOR BEING LATE
If you did not vote at all in the first vote and feel the need to vote -1 in a
subsequent vote, your feedback is still welcome but understand that your
feedback is also very late and you have cost everyone who did take the time to
vote at least an hour of their time (more if there have already been a couple
votes). Do not do so lightly.
Here are some great ways you can offset the cost:
- Immediately fix the issue you point out
- Give each individual who voted an hour of service, per vote, on a task of
their choosing.
That would probably cover it nicely :)
POSSIBLE VARIATIONS
We'll see how it goes, but if the basic concept works out, I can see maybe
extending the first vote period to say 4 days (96 hours) instead of 3 (72
hours).
Anyway, we'll try it out and see if it has a positive impact on the flow of
releases.
-David
