In response to Harry Avis's question, yes, the intra-rater reliability of scores on the Psychology AP essays is quite high, i.e., within one point on a 9 to 12-point answer. The Chief Reader and Question Leaders on the TIPS list can supply the actual correlations, but they're higher than Harry suggests they would be. Incidentally, these essays are not rewritten/retyped or changed in any way when they're read a second time. I thought when rereading an essay you've already scored that it would be a simple matter of recognizing it and in some way remembering what score it was earned from the previous reading. Ha!
What it boils down to is having a good scoring rubric for the essay and adhering to it. DKH David K. Hogberg, PhD Professor of Psychology, Emeritus Albion College, Albion MI 49224 [EMAIL PROTECTED] 517/629-4834 >>> [EMAIL PROTECTED] 12/10/02 13:36 PM >>> I do not assign papers in intro psych at all for the very reason you mention. Not that I am too lazy to read 175 papers, but because I am convinced that error creeps and invalidates my grading. Having taught my first class in 1967 I could be presumed to have developed some objectivity. I find myself influenced by previous papers I have read, the students name (although I have tried to ignore it) my mood, my feeling of hurriedness and whether or not the dog is barking. I wonder what the results would be if a group of instructors were given a stack of papers (lets say 59) and told to grade them. They then would be given the same stack (perhaps retyped or somehow insignificantly altered) six months later. My guess is that at least 25% of the papers changed at least one letter grade. Assigning points would be even more inaccurate, obviously. Anyone know of such test-retest validity? Harry Avis PhD Sierra College [EMAIL PROTECTED] Anything worth doing is worth doing at all >From: "Annette Taylor, Ph. D." <[EMAIL PROTECTED]> >Reply-To: "Teaching in the Psychological Sciences" ><[EMAIL PROTECTED]> >To: "Teaching in the Psychological Sciences" <[EMAIL PROTECTED]> >Subject: RE: length of papers >Date: Tue, 10 Dec 2002 08:07:26 -0800 > >Quoting Larry Daily <[EMAIL PROTECTED]>: > > > Back to grading those 20 page masterworks. > > > > Larry > > > > >Now just out of curiosity, how many of these do have to read? I find myself >totally and completely 100% burned out after reading 59 6-7 page papers >from >intro psych :-( I understand why many faculty don't assign them..... > >Annette > >Annette Kujawski Taylor, Ph. D. >Department of Psychology >University of San Diego >5998 Alcala Park >San Diego, CA 92110 >[EMAIL PROTECTED] > >--- >You are currently subscribed to tips as: [EMAIL PROTECTED] >To unsubscribe send a blank email to [EMAIL PROTECTED] _________________________________________________________________ The new MSN 8: advanced junk mail protection and 2 months FREE* http://join.msn.com/?page=features/junkmail --- You are currently subscribed to tips as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] --- You are currently subscribed to tips as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED]
