Actually I didn't want to discuss the tests. I'm just interested in
knowing how to deal with answers im multiple answer questions which
aren't clear in my view. Thanks for clarification!


On Fri, 13 Jun 2008 15:43:04 +0200 Alan McKinnon
<[EMAIL PROTECTED]> wrote:

> On Friday 13 June 2008, Grant Sewell wrote:
> > Cisco used to have the same scheme on their Academy courses. They
> > recently (3 years?) changed their system to accommodate the
> > flexibility.  Essentially their system now recognises that if a
> > question has 3 marks then there should be an opportunity for the
> > examinee to get 0, 1, 2 or 3 marks for it.
> 
> It also encourages guessing and thereby completely screws up the 
> statistical analysis of the answers. 

The support of guessing is a disadvantage of multiple choice tests in
general no matter how many answers you offer. 
The only advantage is the reduced efforts for automated scoring.


> Multi-answers questions test the candidates ability and knowledge on
> a topic that has more than one element. The whole point of the
> question is to identify if the candidate does in fact know all the
> elements. 

I think it depends on the type of answer and it depends on how close
to practical problems the test should operate:

If you ask how to solve a problem it should be enough if you have one
correct solution. If you have more solutions this is nice but
without any practical benefit so you get just one point and none if one
or more wrong answers got marked.
On the other hand if you ask e.g. for some effects of a command every
correctly marked item should count as it proves a slightly increased
level of knowledge and every wrong answer marked should bring one minus
point down to a limit of zero points per question.
The third possibility might be a security question, e.g. you have to
list all points you have to care about if you setup a secure host.
As there is no half secure host only a complete list should get scored.

This is just my personal point of view. Don't care about it. ;)

-- 
Gruß,
 Tobias.
_______________________________________________
lpi-discuss mailing list
[email protected]
http://list.lpi.org/cgi-bin/mailman/listinfo/lpi-discuss

Reply via email to