similar to: inter-rater agreement index kappa

Hi All: Could anyone point me to a package that can calculate stratified kappa? My design is like this, 4 raters, 30 types of diagnosis scores, 20 patients. Each rater will rate each patient for each type of diagnosis score. The rater's value is nominal. I know I can measure the agreement between raters for each type of diagnosis score, e.g., calculate out 30 kappa values. My problem is I

Greetings. I've been experimenting with some algorithms for document classification (specifically, a Naive Bayes classifier and a kNN classifier) and I would now like to calculate some inter-rater reliability scores. I have the data in a PostgreSQL database, such that for each document, each measure (there are 9) has three variables: ap_(measure), nb_(measure), and knn_(measure). ap is me

I'm looking for a function in R that extends kappa to multiple raters when there is more than one response per subject. For example, say a group of doctors have to assign diseases to patients. Each patient will be assigned one to many diseases, and the number of doctors assigning diseases to any one patient will be two to many. Here's an extremely simple example of the type of data I

Hi All, I am using fleiss kappa for inter rater agreement. Are there any know issues with Fleiss kappa calculation in R? Even when I supply mock data with total agreement among the raters I do not get a kappa value of 1. instead I am getting negative values. I am using the irr package version 0.70 Any help is much appreciated. Thanks and Regards M [[alternative HTML version deleted]]

Greetings, I am a bit confused by the results returned by the functions: cohen.kappa {concord} classAgreement {e1071} when using a two-way table. for example, if I have an matrix A, and a similar matrix B (same dimensions), then: matrix A and B can be found: http://casoilresource.lawr.ucdavis.edu/drupal/files/a_40.txt http://casoilresource.lawr.ucdavis.edu/drupal/files/b_40.txt A <-

Hi, I've got two vectors with ratings from two coders, like this: x<-c("red", "yellow", "blue", "red") #coder number 1 y<-c("red", "blue", "blue", "red") #coder number 2 I want to find Cohen's Kappa using the wkappa function in the psych package. The only example in the docs is using a matrix, which

I'm looking for an extension of kappa to measure agreement among multiple raters when there can be more than one response per subject. For example, say a group of doctors assign diseases to patients. Each patient will be assigned one to many diseases, and the number of doctors assigning diseases to any one patient will be two to many. Here's an extremely simple example of the type of

Hello there, I would like to test the agreement amongst 6 raters for nominal data on a scale from 1-4, and conduct a latent class analysis in R. How should the data be formatted and what code should I use? Thank you very much Lisa Wang Princess Margaret Hospital Biostatistics tel:416 946 4501

Hi, I am having problems getting cohen's kappa to work. I have been using the function: ><-ckappa(x,y) from the psy package. I am trying to test for inter-observer reliability, I have 2 observers and 26 categories, however, the two observers might not necessarily have the same range of categories (I have unequal score ranges). However, I thought R could cope with this. Each time I

Hello, I?m looking for a way to measure the goodness of fit of my model with Cohen?s Kappa (scaling between 0 and 1). The kappa function does not give the results I?m looking for. Heres the code: z<-glm(x~y,binomial) kappa(z, exact = T) Does anyone know more? many thanks Christian -- _______________________________________________ Search for businesses by name, location, or phone number.

Dear R-colleagues, I am quite a newbie to R fighting my stupidity to solve a probably quite simple problem of generating artificial data with defined features. I am conducting a study of inter-observer-agreement in child-bronchoscopy. One of the most important measures is Kappa according to Fleiss, which is very comfortable available in R through the irr-package. Unfortunately medical doctors

If I have two vectors X<-1:10 Y<-1:5 When I combine them using cbind, the shorter one is repeated and both are made of the same length. Is there a methods that does this without duplicating the shorter one. I want to use this to store the data back to a file. Thanks ../Murli [[alternative HTML version deleted]]

Hello, I have 50 raters and 180 cases which are rated as malignant, probably malignant, probably benign, and benign. I want to compare all the raters but I want a weighted kappa to penalize differences between malignant and benign more than differences between malignant and probably malignant. I only found the weighted option in the 2-rater functions (kappa2, wkappa, cohen.kappa). The

Hola a todos, tengo unos datos clasificados, es decir un factor con etiquetas de 1 a 14 y quiero comprobar las coincidencias con un test (también otro factor). Lo que me interesa obtener más que la matriz de confusión o el indice kappa, es otro factor con las coincidencias entre ambos factores (clasificación y test). Es decir 1 si coinciden las etiquetas y 0 si no coinciden, Supongo que para

If I have a calculated t can I get the probability associated with it using an R function by giving it the df and t? I know I can do the whole calculation using t.test() or get the t-distribution using qt(). If t=1.11 and df =9 can I get the probability? Thanks../Murli [[alternative HTML version deleted]]

If my sample size is small is there a particular switch option that I need to use with t.test so that it calculates the t ratio correctly? Here is a dummy example? á =0.05 Mean pain reduction for A =27; B =31 and SD are SDA=9 SDB=12 drgA.p<-rnorm(5,27,9); drgB.p<-rnorm(5,31,12) t.test(drgA.p,drgB.p) # what do I need to give as additional parameter here? I can do it manually but

I am trying to sample a subset from a matrix using sample. The size of the matrix is 20X 1532. It works fine with this, but when I transpose the matrix and try to sample it, it returns null. pick.set<-sample(tissue.exp.t,5,replace=FALSE,prob=NULL) Is there something that I am missing here ? Thanks ../Murli

I am trying to calculate coordinate transformations and in the process of debugging my code using debug I found the following Browse[1]> direction[i] [1] -1.570796 Browse[1]> cos(direction[i]) [1] 6.123032e-17 Browse[1]> cos(-1.570796) [1] 3.267949e-07 Browse[1]> direction[i] [1] -1.570796 Browse[1]> cos(direction[i]) [1] 6.123032e-17 Browse[1]> cos(-1.570796) [1] 3.267949e-07

Hi !! Is there a good tutorial for the R language ? I really find it hard to find methods in R. Thanks and Cheers ../Murli

Hi, I searched a lot on the internet but was unable to find the function for calculating the kappa statistics for intra-observer reliabilty. Can anybody help me in the this regards. Thanks, Shreyasee [[alternative HTML version deleted]]