Dear Ti[sters,
FYI, I attach the scoring schemes that I use to grade term papers
(essays) and research projects. By marking in each category, I
think you minimize (but of course do not eliminate) error.
Essay: Side 1 has the categories and grades
Side 2 has details of what I look for in the categories
There are exetensive handouts that accompany these grading
schemes, so students know what is expected.
Project is self-explanatory, except that Format refers to APA (5th).
Stuart
Date sent: Tue, 10 Dec 2002 13:55:23 -0500
From: "David Hogberg" <[EMAIL PROTECTED]>
To: "Teaching in the Psychological Sciences"
<[EMAIL PROTECTED]>
Subject: reliability of scoring RE: length of papers
Send reply to: "Teaching in the Psychological Sciences"
<[EMAIL PROTECTED]>
> In response to Harry Avis's question, yes, the intra-rater reliability
> of scores on the Psychology AP essays is quite high, i.e., within one
> point on a 9 to 12-point answer. The Chief Reader and Question Leaders
> on the TIPS list can supply the actual correlations, but they're higher
> than Harry suggests they would be. Incidentally, these essays are not
> rewritten/retyped or changed in any way when they're read a second time.
> I thought when rereading an essay you've already scored that it would
> be a simple matter of recognizing it and in some way remembering what
> score it was earned from the previous reading. Ha!
>
> What it boils down to is having a good scoring rubric for the essay and
> adhering to it. DKH
>
> David K. Hogberg, PhD
> Professor of Psychology, Emeritus
> Albion College, Albion MI 49224
> [EMAIL PROTECTED] 517/629-4834
> >>> [EMAIL PROTECTED] 12/10/02 13:36 PM >>>
> I do not assign papers in intro psych at all for the very reason you
> mention. Not that I am too lazy to read 175 papers, but because I am
> convinced that error creeps and invalidates my grading. Having taught my
>
> first class in 1967 I could be presumed to have developed some
> objectivity.
> I find myself influenced by previous papers I have read, the students
> name
> (although I have tried to ignore it) my mood, my feeling of hurriedness
> and
> whether or not the dog is barking. I wonder what the results would be if
> a
> group of instructors were given a stack of papers (lets say 59) and told
> to
> grade them. They then would be given the same stack (perhaps retyped or
> somehow insignificantly altered) six months later. My guess is that at
> least
> 25% of the papers changed at least one letter grade. Assigning points
> would
> be even more inaccurate, obviously. Anyone know of such test-retest
> validity?
>
>
>
> Harry Avis PhD
> Sierra College
> [EMAIL PROTECTED]
>
> Anything worth doing is worth doing at all
>
>
>
>
>
> >From: "Annette Taylor, Ph. D." <[EMAIL PROTECTED]>
> >Reply-To: "Teaching in the Psychological Sciences"
> ><[EMAIL PROTECTED]>
> >To: "Teaching in the Psychological Sciences" <[EMAIL PROTECTED]>
> >Subject: RE: length of papers
> >Date: Tue, 10 Dec 2002 08:07:26 -0800
> >
> >Quoting Larry Daily <[EMAIL PROTECTED]>:
> >
> > > Back to grading those 20 page masterworks.
> > >
> > > Larry
> > >
> >
> >
> >Now just out of curiosity, how many of these do have to read? I find
> myself
> >totally and completely 100% burned out after reading 59 6-7 page papers
>
> >from
> >intro psych :-( I understand why many faculty don't assign them.....
> >
> >Annette
> >
> >Annette Kujawski Taylor, Ph. D.
> >Department of Psychology
> >University of San Diego
> >5998 Alcala Park
> >San Diego, CA 92110
> >[EMAIL PROTECTED]
> >
> >---
> >You are currently subscribed to tips as: [EMAIL PROTECTED]
> >To unsubscribe send a blank email to
> [EMAIL PROTECTED]
>
>
> _________________________________________________________________
> The new MSN 8: advanced junk mail protection and 2 months FREE*
> http://join.msn.com/?page=features/junkmail
>
>
> ---
> You are currently subscribed to tips as: [EMAIL PROTECTED]
> To unsubscribe send a blank email to
> [EMAIL PROTECTED]
>
>
> ---
> You are currently subscribed to tips as: [EMAIL PROTECTED]
> To unsubscribe send a blank email to [EMAIL PROTECTED]
___________________________________________________
Stuart J. McKelvie, Ph.D., Phone: (819)822-9600
Department of Psychology, Extension 2402
Bishop's University, Fax: (819)822-9661
3 Route 108 East,
Lennoxville, e-mail: [EMAIL PROTECTED]
Quebec J1M 1Z7,
Canada.
Bishop's University Psychology Department Web Page:
http://www.ubishops.ca/ccc/div/soc/psy
___________________________________________________
---
You are currently subscribed to tips as: [EMAIL PROTECTED]
To unsubscribe send a blank email to [EMAIL PROTECTED]
