R help - Feb 2012 - Function to compute multi-response, multi-rater kappa?

I'm looking for a function in R that extends kappa to multiple raters when
there is more than one response per subject.  For example, say a group of
doctors have to assign diseases to patients.  Each patient will be assigned
one to many diseases, and the number of doctors assigning diseases to any
one patient will be two to many.

Here's an extremely simple example of the type of data I might have (two
patients, three doctors, five diagnoses, and doctor 'x' assigns multiple
diagnoses per patient):

pat<-c('a','a','a','b','b','b','b')
doc<-c('x','x','y','x','x','y','z')
dx<-c('1','2','2','3','4','4','5')
df<-data.frame(pat=pat,doc=doc,dx=dx)
df

I found a paper that can address this [1], although I can't find it
referenced on cran.  What I have found on cran doesn't address the
multi-response case.  I don't want to reinvent the wheel if this has
already been implemented in R, and I'm still new to the language so I'm
not
a fast coder.  If anyone can help it would be greatly appreciated.

Cheers!

Luk Arbuckle

[1] Kraemer, Helena. “Extension of the Kappa Coefficient.” Biometrics 36,
no. 2 (1980). http://dx.doi.org/10.2307/2529972.

	[[alternative HTML version deleted]]

I'm very sorry for double posting!  My r-help setting Receive your own
posts to the list? is set to Yes, and Mail delivery is Enabled.  Yet I did
not get a copy of my post (this message is a reply from my sent mail).  I
only learned of the double posting when I found it copied in an r-help
archive.  Again, my apologies.

Luk Arbuckle

On Wed, Feb 1, 2012 at 13:47, Luk Arbuckle wrote:
> I'm looking for a function in R that extends kappa to multiple raters
when
> there is more than one response per subject.  For example, say a group of
> doctors have to assign diseases to patients.  Each patient will be assigned
> one to many diseases, and the number of doctors assigning diseases to any
> one patient will be two to many.
>
> Here's an extremely simple example of the type of data I might have
(two
> patients, three doctors, five diagnoses, and doctor 'x' assigns
multiple
> diagnoses per patient):
>
>
pat<-c('a','a','a','b','b','b','b')
>
doc<-c('x','x','y','x','x','y','z')
>
dx<-c('1','2','2','3','4','4','5')
> df<-data.frame(pat=pat,doc=doc,dx=dx)
> df
>
> I found a paper that can address this [1], although I can't find it
> referenced on cran.  What I have found on cran doesn't address the
> multi-response case.  I don't want to reinvent the wheel if this has
> already been implemented in R, and I'm still new to the language so
I'm not
> a fast coder.  If anyone can help it would be greatly appreciated.
>
> Cheers!
>
> Luk Arbuckle
>
> [1] Kraemer, Helena. “Extension of the Kappa Coefficient.” Biometrics 36,
> no. 2 (1980). http://dx.doi.org/10.2307/2529972.
>
	[[alternative HTML version deleted]]