On 9 Mar 2004, Rick Froman wrote:

> I have used the following quiz of testwiseness to illustrate common
> pitfalls in test writing to my Psych Testing students and colleagues.
> I don't remember where I got it but I would be happy to give a proper
> attribution if anyone knows.
> 
> Testwise Exam
>> 
> 1. The purpose of the cluss in furmpaling is to remove
>             a. cluss-prags                           c. cloughs
>             b. tremalis                                 d. plumots
> 


Hey, I may know something about the attribution of this test. It was 
invented by....Al Gore!  No, just kidding. It was really invented 
by... Kurt Vonnegut!

No, actually, its true author is lost in the mists of time (or supply 
your own cliche), which is what always happens to good stuff posted 
on the web (Black's Law of Internet Attribution).  But I did try to 
find out once. I retrieved a copy of it on the web posted by Barry 
Reich who attributed it to Allen M. Schuller of the University of 
Maryland. I queried Dr. Reich, and he said (back in 2001) that that 
was the attribution on it when he received it from someone else 15 
years earlier. 

Another lead was provided by Charles Harris, an occasional lurker on 
this list. He said (back in 1981) that he received it from Joseph 
Kruskal who got it from Clyde Kruskal, who got it from Jerome 
Berkowitz of the Courant Institute, but that he never checked with 
Prof. Berkowitz whether the chain led further back. Incidently, the 
"Charlie" mentioned in Jean-Marc Perrault's version of this test at 
http://www.stargazing.net/drsmith/test-taking-A.txt is that same 
Charles Harris. 

As for this test itself, I must protest the designation of this as a 
test of "testwiseness".  It's actually a test of how to exploit 
poorly-written tests when the testee doesn't have a clue. It's more 
valuable as an illustration of how not to write test questions, which 
is how Rick Froman says he uses it. 

The same objection applies to Janda's  _Test-Wiseness Scale_ (thanks, 
Monica, for posting it!) even more, because it apparently purports to 
be a true test of test-taking skill.  But as a test of how good you 
are at using your course knowledge to get the right answer, it 
flunks. What a disappointment! I was hoping for questions something 
like this, which would actually test test-taking skill:

The best way of proceeding on a multiple-choice test is to:

a) attempt every question, and don't move on to the next until        
   you've satisfactorily answered the previous one
b) don't spend more than 20 seconds on each question
c) if you find you're having difficulty answering a question, return  
   to it if you have time later
d) answer the questions in reverse order
e) cheat

The correct answer, of course, is e).

Note added in proof: I just tried a search on Berkowitz and Courant, 
and came up with his e-mail address. I think I'll send him a query. 
Stand by. 

Stephen
___________________________________________________
Stephen L. Black, Ph.D.            tel:  (819) 822-9600 ext 2470
Department of Psychology         fax:  (819) 822-9661
Bishop's  University           e-mail: [EMAIL PROTECTED]
Lennoxville, QC  J1M 1Z7
Canada

Dept web page at http://www.ubishops.ca/ccc/div/soc/psy
TIPS discussion list for psychology teachers at
 http://faculty.frostburg.edu/psyc/southerly/tips/index.htm    
_______________________________________________


---
You are currently subscribed to tips as: [EMAIL PROTECTED]
To unsubscribe send a blank email to [EMAIL PROTECTED]

Reply via email to