Displaying 20 results from an estimated 1000 matches similar to: "inter-rater agreement index kappa"
2008 Oct 31
1
stratified kappa (measure agreement or interrater reliability)?
Hi All:
Could anyone point me to a package that can calculate stratified kappa? My
design is like this, 4 raters, 30 types of diagnosis scores, 20 patients.
Each rater will rate each patient for each type of diagnosis score. The
rater's value is nominal.
I know I can measure the agreement between raters for each type of diagnosis
score, e.g., calculate out 30 kappa values. My problem is I
2002 Feb 05
2
Measures of agreement
Greetings.
I've been experimenting with some algorithms for document classification
(specifically, a Naive Bayes classifier and a kNN classifier) and I would
now like to calculate some inter-rater reliability scores. I have the data
in a PostgreSQL database, such that for each document, each measure (there
are 9) has three variables: ap_(measure), nb_(measure), and
knn_(measure). ap is me
2012 Feb 01
1
Function to compute multi-response, multi-rater kappa?
I'm looking for a function in R that extends kappa to multiple raters when
there is more than one response per subject. For example, say a group of
doctors have to assign diseases to patients. Each patient will be assigned
one to many diseases, and the number of doctors assigning diseases to any
one patient will be two to many.
Here's an extremely simple example of the type of data I
2009 Jul 13
3
Help With Fleiss Kappa
Hi All,
I am using fleiss kappa for inter rater agreement. Are there any know
issues with Fleiss kappa calculation in R? Even when I supply mock data
with total agreement among the raters I do not get a kappa value of 1.
instead I am getting negative values.
I am using the irr package version 0.70
Any help is much appreciated.
Thanks and Regards
M
[[alternative HTML version deleted]]
2006 Dec 11
1
cohen kappa for two-way table
Greetings,
I am a bit confused by the results returned by the functions:
cohen.kappa {concord}
classAgreement {e1071}
when using a two-way table.
for example, if I have an matrix A, and a similar matrix B (same
dimensions), then:
matrix A and B can be found:
http://casoilresource.lawr.ucdavis.edu/drupal/files/a_40.txt
http://casoilresource.lawr.ucdavis.edu/drupal/files/b_40.txt
A <-
2010 May 25
1
Cohen's Kappa for beginners
Hi,
I've got two vectors with ratings from two coders, like this:
x<-c("red", "yellow", "blue", "red") #coder number 1
y<-c("red", "blue", "blue", "red") #coder number 2
I want to find Cohen's Kappa using the wkappa function in the psych
package. The only example in the docs is using a matrix, which
2006 Feb 09
2
latent class modle for rater agreement
Hello there,
I would like to test the agreement amongst 6 raters for nominal data on
a scale from 1-4, and conduct a latent class analysis in R. How should
the data be formatted and what code should I use?
Thank you very much
Lisa Wang
Princess Margaret Hospital
Biostatistics
tel:416 946 4501
2007 Oct 04
5
combining vectors on unequal length
If I have two vectors
X<-1:10
Y<-1:5
When I combine them using cbind, the shorter one is repeated and both are made of the same length. Is there a methods that does this without duplicating the shorter one. I want to use this to store the data back to a file.
Thanks ../Murli
[[alternative HTML version deleted]]
2012 Feb 01
0
Multi-response, multi-rater kappa?
I'm looking for an extension of kappa to measure agreement among multiple
raters when there can be more than one response per subject. For example,
say a group of doctors assign diseases to patients. Each patient will be
assigned one to many diseases, and the number of doctors assigning diseases
to any one patient will be two to many.
Here's an extremely simple example of the type of
2007 Aug 01
5
t-distribution
If I have a calculated t can I get the probability associated with it
using an R function by giving it the df and t? I know I can do the whole
calculation using t.test() or get the t-distribution using qt(). If
t=1.11 and df =9 can I get the probability?
Thanks../Murli
[[alternative HTML version deleted]]
2005 Feb 10
5
sample
I am trying to sample a subset from a matrix using sample.
The size of the matrix is 20X 1532. It works fine with this,
but when I transpose the matrix and try to sample it, it returns
null.
pick.set<-sample(tissue.exp.t,5,replace=FALSE,prob=NULL)
Is there something that I am missing here ?
Thanks ../Murli
2007 Aug 07
5
small sample techniques
If my sample size is small is there a particular switch option that I need to use with t.test so that it calculates the t ratio correctly?
Here is a dummy example?
รก =0.05
Mean pain reduction for A =27; B =31 and SD are SDA=9 SDB=12
drgA.p<-rnorm(5,27,9);
drgB.p<-rnorm(5,31,12)
t.test(drgA.p,drgB.p) # what do I need to give as additional parameter here?
I can do it manually but
2004 Aug 13
3
Tutorials on R
Hi !!
Is there a good tutorial for the R language ? I really find it hard to
find methods in R.
Thanks and Cheers ../Murli
2009 Jul 14
4
Trig functions strange results
I am trying to calculate coordinate transformations and in the process of debugging my code using debug I found the following
Browse[1]> direction[i]
[1] -1.570796
Browse[1]> cos(direction[i])
[1] 6.123032e-17
Browse[1]> cos(-1.570796)
[1] 3.267949e-07
Browse[1]> direction[i]
[1] -1.570796
Browse[1]> cos(direction[i])
[1] 6.123032e-17
Browse[1]> cos(-1.570796)
[1] 3.267949e-07
2009 Dec 22
1
Cohen's kappa, unequal score ranges
Hi,
I am having problems getting cohen's kappa to work. I have been using the function:
><-ckappa(x,y)
from the psy package.
I am trying to test for inter-observer reliability, I have 2 observers and 26 categories, however, the two observers might not necessarily have the same range of categories (I have unequal score ranges). However, I thought R could cope with this.
Each time I
2006 Sep 06
2
biplot label size
Which is the parameter that is used to decrease the size of ylabs
plotted in biplot? I tried playing with cex and cex.lab I am not getting
it right
pc <- princomp(USArrests)
biplot(pc, xlabs = rep("", nrow(USArrests)),ylabs=(colnames(USArrests)))
Thanks../Murli
[[alternative HTML version deleted]]
2007 Mar 18
1
multcomp
I used the multcomp package sometime back for doing multiple
comparisons. I see that it has been updated and the methods like simint
are no longer supported. When I run the program it prompts to me to use
glht. How do I get the lower and upper conf int and the pValues using
glht? Does anyone have an example?
Thanks ../Murli
[[alternative HTML version deleted]]
2007 Jul 27
2
manipulating arrays
Can I insert an element in an array at a particular position without
destroying the already existing element?
X<-c(1,2,3,4,5)
I want to insert an element between 1 and 2.
Thanks ../Murli
[[alternative HTML version deleted]]
2009 Jul 24
2
computing the radius of an arc
Hi!!
I am interesting in computing the radius of an arc that best approximates a curve. Is there an R function that I can use to draw an arc?
Nothing useful came up when I searched help.search. Does anyone have any suggestion to do this?
Thanks ../Murli
2009 May 29
2
strsplit
I am trying split a string and use one part of it to label graphs. I am using strsplit for that. While I am able to split it, how do I access the separated parts.
> filName<-"chrI_2223"
>part<- strsplit(filName,"\\_")
> part
[[1]]
[1] "chrI" "2223"
> part[1]
[[1]]
[1] "chrI" "2223"
I looked up the help archive but did