I'm concerned that the rating metric is wrong in penta when reviewers leave one of the three categories in a "don't know" state.
for example, if i say "+" for all three categories (relevance,
actuality, acceptance), the score will be 50. (50 + 50 + 50)/3
if i say "+" for relevance and acceptance, but "0", the score shows 37.
This seems slightly wrong -- i'd have expected 33. but meh, not a very
big deal.
A bigger deal is if i say "+" for relevance and acceptance, but leave
actuality as unspecified (because i don't know anything about the
presenter), the score also drops to 37. I'd have expected it to stay at
50: (50 + 50)/2
In particular, i'm proposing that unspecified axes should be removed
from both the numerator and the denominator, rather than just being
treated as a 0 in the numerator.
Any thoughts on this? Am i misunderstanding something?
--dkg
signature.asc
Description: OpenPGP digital signature
_______________________________________________ Debconf-team mailing list [email protected] http://lists.debconf.org/mailman/listinfo/debconf-team
