search for: raters

An embedded and charset-unspecified text was scrubbed... Name: not available URL: <https://stat.ethz.ch/pipermail/r-help/attachments/20091124/38de5e23/attachment-0001.pl>

Hi all, I have an experiment where 5 raters assessed the quality of 24 web sites. (each rater rated each site once). I want to come up with a measure of reliability of the ratings for the web sites ie to what extent does each rater give the same (or similar) rating to each web site. My idea was to fit a random effects model using lme and fro...

Hello, I am trying to perform a two-factor ANOVA analysis using a blocking design with "Vol" as the response variable. My intent is to have "Rater" treated as the treatment variable and the "Pipe" treated as the blocking variable. I am reading and preparing my dataset using the following three lines of code: values <- read.table("filename",

Hello, I have 50 raters and 180 cases which are rated as malignant, probably malignant, probably benign, and benign. I want to compare all the raters but I want a weighted kappa to penalize differences between malignant and benign more than differences between malignant and probably malignant. I only found the weighte...

Hello! I want to calculate the intra- and interrater reliability of my study. The design is very simple, 5 raters rated a diagnostic score 3 times for 19 patients. Are there methods/funtions in R? I only found packages to calculate interrater variability and intraclass correlation coefficients for matrices of n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions. Can anybody help? T...

Hello there, I would like to test the agreement amongst 6 raters for nominal data on a scale from 1-4, and conduct a latent class analysis in R. How should the data be formatted and what code should I use? Thank you very much Lisa Wang Princess Margaret Hospital Biostatistics tel:416 946 4501

Is there a function that calculates the inter-rater agreement index (kappa) in R? Thanks ../Murli [[alternative HTML version deleted]]

Hi All: Could anyone point me to a package that can calculate stratified kappa? My design is like this, 4 raters, 30 types of diagnosis scores, 20 patients. Each rater will rate each patient for each type of diagnosis score. The rater's value is nominal. I know I can measure the agreement between raters for each type of diagnosis score, e.g., calculate out 30 kappa values. My problem is I want to have a...

...0 16 f 1 1 -1 0 1 0 17 g 1 -1 0 1 1 0 18 h 1 0 1 -1 0 1 19 i 1 1 -1 0 1 0 20 j 1 -1 0 1 1 0 ... This is simulated data, but it corresponds to what my real data look like. Note: There are 10 raters (a to j), they repeat the experiment at two ages (1 and 2). Each rater rates all 3 treatment combinations at least once (and in my simulations up to 10 times). So for case 1, this corresponds to a trial between treatments a and b. a was chosen, which corresponds to a success. Similarly, for case 2...

Hi All, I am using fleiss kappa for inter rater agreement. Are there any know issues with Fleiss kappa calculation in R? Even when I supply mock data with total agreement among the raters I do not get a kappa value of 1. instead I am getting negative values. I am using the irr package version 0.70 Any help is much appreciated. Thanks and Regards M [[alternative HTML version deleted]]

Hi All, Is there an easy way to reduce a data.frame to 1 'id' per row while keeping information from the other rows of that same variable, if applicable? e.g.: # data multi[1:15,] id r n wi wi.tau z k alliance a.rater eml treatment outcome o.rater german 1 100 0.2800000 44 41 21.72514 0.2876821 210 <NA> <NA> <NA> <NA>

...esday, May 16, 2006 6:10 AM > To: r-help at stat.math.ethz.ch > Subject: [R] Interrater and intrarater variability > (intraclass correlationcoefficients) > > Hello! > > I want to calculate the intra- and interrater reliability of > my study. The design is very simple, 5 raters rated a > diagnostic score 3 times for 19 patients. > > Are there methods/funtions in R? I only found packages to > calculate interrater variability and intraclass correlation > coefficients for matrices of n*m (n subjects, m raters) - I > have n subjects, m raters and r rep...

I'm looking for a function in R that extends kappa to multiple raters when there is more than one response per subject. For example, say a group of doctors have to assign diseases to patients. Each patient will be assigned one to many diseases, and the number of doctors assigning diseases to any one patient will be two to many. Here's an extremely simple examp...

Hi All. I need a bit of help extracting the residual error variance from the VarCorr structure from lmer. #Here's a 2-way random effects model lmer.1 <- lmer(rating ~ (1|person)+(1|rater), data = dat) #Get the structure vc.fit <- VarCorr(lmer.1) #results in..... $person 1 x 1 Matrix of class "dpoMatrix" (Intercept) (Intercept) 0.7755392 $rater 1 x 1 Matrix

I'm looking for an extension of kappa to measure agreement among multiple raters when there can be more than one response per subject. For example, say a group of doctors assign diseases to patients. Each patient will be assigned one to many diseases, and the number of doctors assigning diseases to any one patient will be two to many. Here's an extremely simple example o...

Hey guys, I configured Samba do be the domain controller for my network and to share folders. the folder sharing works great. The problem is that the domain function does not work at all. I cannot join the domain from any workstation. It just says that the controller cannot be contacted. I ran an Ethereal sniff on the packets and the computer that i want to be PDC is sending ICMP Destination

Dear R users The following function is R code for the main compuations in the article: M. Eliasziw, S Lorraine Young, M Gail Woodbury and Karen Fryday-Field (1994): Statistical Methodology for the Concurrent Assessment of Intrarater and Intrarater Reliability: Using Goniometric Measurements as an Example. Physical Therapy 74 (8); 777-788 The function gives the estimated inter- and intrarater

...intraclass correlation coefficients) To: r-help at stat.math.ethz.ch Message-ID: <20060516100954.6267.qmail at web26504.mail.ukl.yahoo.com> Content-Type: text/plain; charset=us-ascii Hello! I want to calculate the intra- and interrater reliability of my study. The design is very simple, 5 raters rated a diagnostic score 3 times for 19 patients. Are there methods/funtions in R? I only found packages to calculate interrater variability and intraclass correlation coefficients for matrices of n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions. Can anybody help? T...

...9;m looking for a star rating component for RoR, a bit like Votio (http://redalt.com/downloads/ - find the votio heading) or the star rating used on Amazon. I don''t really need the AJAX capabilities, just the ability to bind the results to a hidden drop down, or radio inputs. Multiple raters per page is also an issue. Any recomendations? -- Posted via http://www.ruby-forum.com/.

Dear R-colleagues, I am quite a newbie to R fighting my stupidity to solve a probably quite simple problem of generating artificial data with defined features. I am conducting a study of inter-observer-agreement in child-bronchoscopy. One of the most important measures is Kappa according to Fleiss, which is very comfortable available in R through the irr-package. Unfortunately medical doctors