similar to: ICC question: Interrater and intrarater variability (intraclass correlation coefficients)

Hello! I want to calculate the intra- and interrater reliability of my study. The design is very simple, 5 raters rated a diagnostic score 3 times for 19 patients. Are there methods/funtions in R? I only found packages to calculate interrater variability and intraclass correlation coefficients for matrices of n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions. Can

It sounds as thought you are interested in Hoyt's Anova which is a form of generalizability theory. This is usually estimated using by getting the variance components from ANOVA. > -----Original Message----- > From: r-help-bounces at stat.math.ethz.ch > [mailto:r-help-bounces at stat.math.ethz.ch] On Behalf Of Karl Knoblick > Sent: Tuesday, May 16, 2006 6:10 AM > To: r-help at

Karl, If you use one of the specialized packages to calculate your ICC, make sure that you know what you're getting. (I haven't checked the packages out myself, so I don't know either.) You might want to read David Futrell's article in the May 1995 issue of Quality Progress where he describes six different ways to calculate ICCs from the same data set, all with different

Dear R users The following function is R code for the main compuations in the article: M. Eliasziw, S Lorraine Young, M Gail Woodbury and Karen Fryday-Field (1994): Statistical Methodology for the Concurrent Assessment of Intrarater and Intrarater Reliability: Using Goniometric Measurements as an Example. Physical Therapy 74 (8); 777-788 The function gives the estimated inter- and intrarater

Hi, all There are 62 samples in my data and I tested 3 times for each one, then I want to use ICC(intraclass correlation) from irr package to test the consistency among the tests. *combatexpdata_p[1:62] is the first text results and combatexpdata_p[63:124] * is the second one and *combatexpdata_p[125:186]* is the third. Here is the result:

Hi All: Could anyone point me to a package that can calculate stratified kappa? My design is like this, 4 raters, 30 types of diagnosis scores, 20 patients. Each rater will rate each patient for each type of diagnosis score. The rater's value is nominal. I know I can measure the agreement between raters for each type of diagnosis score, e.g., calculate out 30 kappa values. My problem is I

Hi, I'm trying to run a ICC calculation on a data frame. I get the following error message: Error in data.frame(x.s, subs = rep(paste("S", 1:n.obs, sep = ""), nj)) : arguments imply differing number of rows: 1700, 1750 I've looked at the data in the file and it seems to be okay. Any thoughts would be much appreciated. I'm getting used to R so if possible, I

I have a spectrophotometric dataset with repeated measures of a value at 200 wavelengths for each of 150 individuals. I would like to use the repeated samples to at each wavelength to look at measurement/observer error, compared to difference between individuals error I have looked at doing this with icc{irr} or using an anova approach, but I am unclear how to acheive this given that there

I am helping someone calculate ICC using R. I know R has several packages like irr, psy etc which provide options to calculate ICC (intraclass correlation coefficient). When getting ICC, we need to use the model: two-way mixed model with absolute agreement. I only found that in irr package, it provides the option of choosing one or two way and consistence or absolute agreement model. However,

Dear R users I would like to ask a question regarding to icc (intraclass correlation) or many biologists refer it to as repeatability. It is very useful to get icc for many reasons and it is easy to do so from linear mixed-effects models and many packages like psy, psychometric, aod and irr have functions to calculate icc. icc = between-group variance/(between-group variance + residual

Hi, I'm essentially wanting to calculate intra- and inter-observer variabilities for the first principal component of an optic disc shape measure of a sample of individuals, so from what I can work out I need to work out an intraclass correlation coefficient(s). For the intra-data, I have 2 measurements taken on each individual by the same observer. For the inter-data, 2 observers have taken

Dear R-users, consider a 2-level linear mixed effects model (LME) with random intercept AND random slope for level 1 AND 2. Does anybody know how to calculate Intraclass-coefficient (ICC) for highest (innermost) level 2 ??? In the literature, I did not find an example for these kind of komplex models. For 1-level Random-Intercept models it would be easy: ICC = variance due to the clustering

Hi, Can R calculate an intraclass correlation coefficient for clustered data, when the outcome variable is dichotomous? By now I calculate it by hand, estimating between- and intracluster variance by one-way ANOVA - however I don't feel very comfortable about this, since the distributional assumptions are not really met.... Maybe anyone can help me? Best regards and many many thanks,

Hi All, I am using fleiss kappa for inter rater agreement. Are there any know issues with Fleiss kappa calculation in R? Even when I supply mock data with total agreement among the raters I do not get a kappa value of 1. instead I am getting negative values. I am using the irr package version 0.70 Any help is much appreciated. Thanks and Regards M [[alternative HTML version deleted]]

Dear Profs. Ripley & Gamer, Thanks a lot for your prompt answer and your advice. Indeed, I managed to track the bug by launching R from the c-shell instead of the Mac GUI. In that case, after typing > library(irr) I obtained the following error message: > Erreur dans parse(file, n, text, prompt) : syntax error at > 653: irr.name =3D "R > Erreur : unable to load R code in

Dear R-colleagues, I am quite a newbie to R fighting my stupidity to solve a probably quite simple problem of generating artificial data with defined features. I am conducting a study of inter-observer-agreement in child-bronchoscopy. One of the most important measures is Kappa according to Fleiss, which is very comfortable available in R through the irr-package. Unfortunately medical doctors

Hi all, I have an experiment where 5 raters assessed the quality of 24 web sites. (each rater rated each site once). I want to come up with a measure of reliability of the ratings for the web sites ie to what extent does each rater give the same (or similar) rating to each web site. My idea was to fit a random effects model using lme and from that, calculate the intraclass correlation as a

I'm using the lme function in nmle to estimate the variance components of a fully nested two-level model: Y_ijk = mu + a_i + b_j(i) + e_k(j(i)) lme computes estimates of the variances for a, b, and e, call them v_a, v_b, and v_e, and I can use the intervals function to get confidence intervals. My understanding is that these intervals are probably not that robust plus I need intervals on the

Hello R users: I am fairly new to R and am trying to figure out how to compute an intraclass correlation (ICC) and/or design effect for binary data? More specifically, I am trying to determine the amount of clustering in a data set - that is, whether certain treatment programs tend to work with more or less severe clients. The outcome variable is dichotomous (low severity / high severity)

Win7, R2.11.0 I am working on a report together with several co-authors. The data concern several performance measures on a set of groups. These measures are scored by external judges. We report findings on several datasets, including several of the 6 ICC's discussed by Shrout & Fleiss (1979). We determine these using the icc function from the irr package. We have also used the ICC