On 10-07-14 12:42 PM, G. Matthew Rice wrote: > 1. Releasing exam content (ie. questions) under an "open" license. > > I spoke with our psychometrician and others about the idea of creating > a pool of 3,000 to 5,000 questions which were all publicly available. > With this many questions in the pool, memorising all of the answers > would not really work without (acquiring?) an understanding of how the > technology worked.
I had an argument with a colleague on this topic a couple years back (hi, Robert!). Back then, I thought it was a really silly idea, but the more I think about it, the better it sounds. It would open up participation and stop the cheaters. The real trick is to get the pool of question large enough and good enough that it works. In term of quality, as it would be impossible to have a single person or a committee review *all* questions, we would need a poll system. Perhaps people already holding a specific certification could be allowed to vote a question up or down? Like, a question is candidate for publishing when it gets 10 positive votes, with the possibility to vote a question down. Having a discussion attached to it would be good, so the question could be refined through consensus (like contentious Wikipedia articles are). Starting with the first level exam is the obvious first steps. as the pool of potential question contributors and reviewers is much larger at that level. I doubt this would work out for the level 3 exams, where the number of SME is very small. I'm for it. _______________________________________________ lpi-examdev mailing list lpi-examdev@lpi.org http://list.lpi.org/cgi-bin/mailman/listinfo/lpi-examdev
