In article <[EMAIL PROTECTED]>,
Mats Carlsson <[EMAIL PROTECTED]> wrote:
> Is there a way I can compare
> kappa-values? The backgound is as
> follows:
> Four physicians has coded a 100 surgical
> notes.
> Each physician has coded each surgical
> note using all four different
> classifications...
> The classifications has differing
> numbers of categories (one has 8, one
> 10, one 16 and so on).
It is not really possible to compare kappas that are calculated for
different numbers of rating levels. (For a given rating system, you can
compare kappas for different rater pairs--but I guess that's not your
question). Are the ratings ordered categorical? That could possibly
give you a few more options.
You might check my "Statistical Methods for Agreement Data" web page,
http://ourworld.compuserve.com/homepages/jsuebersax/agreee.htm
It includes discussion of alternative methods that permit comparisons of
agreement when the number of rating levels differs, and also has a page
discussing the kappa coefficient.
John
--
John Uebersax
[EMAIL PROTECTED]
Sent via Deja.com http://www.deja.com/
Before you buy.
===========================================================================
This list is open to everyone. Occasionally, less thoughtful
people send inappropriate messages. Please DO NOT COMPLAIN TO
THE POSTMASTER about these messages because the postmaster has no
way of controlling them, and excessive complaints will result in
termination of the list.
For information about this list, including information about the
problem of inappropriate messages and information about how to
unsubscribe, please see the web page at
http://jse.stat.ncsu.edu/
===========================================================================
