Displaying 20 results from an estimated 3000 matches similar to: "How to do ICC"
2009 Mar 26
1
ICC question: Interrater and intrarater variability (intraclass correlation coefficients)
Hello dear R help group.
I encountered this old thread (http://tinyurl.com/dklgsk) containing the a
similar question to the one I have, but left without an answer.
I am and hoping one of you might help.
A simplified situation: I have a factorial design (with 2^3 experiment
combinations), for 167 subjects, each one has answered the same question
twice (out of a bunch of "types" of
2010 Aug 03
2
How to extract ICC value from irr package?
Hi, all
There are 62 samples in my data and I tested 3 times for each one, then I
want to use ICC(intraclass correlation) from irr package to test the
consistency among the tests.
*combatexpdata_p[1:62] is the first text results and combatexpdata_p[63:124]
* is the second one and *combatexpdata_p[125:186]* is the third.
Here is the result:
2006 May 17
1
Response to query re: calculating intraclass correlations
Karl,
If you use one of the specialized packages to calculate your ICC, make sure that you know what you're getting. (I haven't checked the packages out myself, so I don't know either.)
You might want to read David Futrell's article in the May 1995 issue of Quality Progress where he describes six different ways to calculate ICCs from the same data set, all with different
2003 Sep 25
0
mixing nested and crossed factors using lme
Hi all,
I have an experiment where 5 raters assessed the quality of 24 web sites. (each rater rated each site once). I want to come up with a measure of reliability of the ratings for the web sites ie to what extent does each rater give the same (or similar) rating to each web site. My idea was to fit a random effects model using lme and from that, calculate the intraclass correlation as a
2011 Feb 23
0
Using R to calculate ICC by two-way mixed model with absolute agreement
I am helping someone calculate ICC using R. I know R has several packages
like irr, psy etc which provide options to calculate ICC (intraclass
correlation coefficient). When getting ICC, we need to use the model:
two-way mixed model with absolute agreement.
I only found that in irr package, it provides the option of choosing one or
two way and consistence or absolute agreement model. However,
2007 Jun 08
1
icc from GLMM?
Dear R users
I would like to ask a question regarding to icc (intraclass correlation) or many
biologists refer it to as repeatability. It is very useful to get icc for many
reasons and it is easy to do so from linear mixed-effects models and many
packages like psy, psychometric, aod and irr have functions to calculate icc.
icc = between-group variance/(between-group variance + residual
2011 Nov 20
1
ICC - IntraClass Correlation Error
Hi, I'm trying to run a ICC calculation on a data frame. I get the following
error message:
Error in data.frame(x.s, subs = rep(paste("S", 1:n.obs, sep = ""), nj)) :
arguments imply differing number of rows: 1700, 1750
I've looked at the data in the file and it seems to be okay. Any thoughts
would be much appreciated. I'm getting used to R so if possible, I
2006 May 16
2
Interrater and intrarater variability (intraclass correlationcoefficients)
It sounds as thought you are interested in Hoyt's Anova which is a form
of generalizability theory. This is usually estimated using by getting
the variance components from ANOVA.
> -----Original Message-----
> From: r-help-bounces at stat.math.ethz.ch
> [mailto:r-help-bounces at stat.math.ethz.ch] On Behalf Of Karl Knoblick
> Sent: Tuesday, May 16, 2006 6:10 AM
> To: r-help at
2001 Nov 28
1
Help with ICC
Hello, R-folks:
Here is a statement I use to make a data frame:
iccdata <- data.frame(i=rep(1:10,rep(2,10)),j=rep(1:2,10),
x=c(0.35011,0.11989,0.13081,0.09919,0.16000,0.12000,0.00000,0.00000,
0.44023,0.32977,2.67081,2.63919,0.09050,0.03950,0.44019,0.30981,0.59000,
0.57000,4.03000,3.77000))
Then here are the data:
> iccdata
i j x
1 1 1 0.35011
2 1 2 0.11989
3 2 1 0.13081
4
2009 Aug 21
1
intra-class correlation? coherence among multiple ordinal responses
I have a quick statistical question and hoped somebody has a tip for me
without me having to go to the local statistician on Monday.
I assess 4 statements from 90 subjects. Each of the 4 statements receives
one of three responses (say -1, 0, or 1). I can use Cramer's V or Spearman
correlations to assess the correlation between each pair of statements, but
I am looking for a measure of
2006 Oct 24
1
Variance Component/ICC Confidence Intervals via Bootstrap or Jackknife
I'm using the lme function in nmle to estimate the variance components
of a fully nested two-level model:
Y_ijk = mu + a_i + b_j(i) + e_k(j(i))
lme computes estimates of the variances for a, b, and e, call them v_a,
v_b, and v_e, and I can use the intervals function to get confidence
intervals. My understanding is that these intervals are probably not
that robust plus I need intervals on the
2006 Jan 18
1
ICC for Binary data
Hello R users:
I am fairly new to R and am trying to figure out how to compute an intraclass correlation (ICC) and/or design effect for binary data? More specifically, I am trying to determine the amount of clustering in a data set - that is, whether certain treatment programs tend to work with more or less severe clients. The outcome variable is dichotomous (low severity / high severity)
2006 May 16
5
Interrater and intrarater variability (intraclass correlation coefficients)
Hello!
I want to calculate the intra- and interrater reliability of my study. The design is very simple, 5 raters rated a diagnostic score 3 times for 19 patients.
Are there methods/funtions in R? I only found packages to calculate interrater variability and intraclass correlation coefficients for matrices of n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions.
Can
2008 Jan 31
0
How to calculate Intraclass-coefficient in 2-level Linear Mixed-Effects models?
Dear R-users,
consider a 2-level linear mixed effects model (LME) with random intercept
AND random slope for level 1 AND 2. Does anybody know how to calculate
Intraclass-coefficient (ICC) for highest (innermost) level 2 ??? In the
literature, I did not find an example for these kind of komplex models.
For 1-level Random-Intercept models it would be easy:
ICC = variance due to the clustering
2013 Jan 11
0
Weighted Kappa for m Raters
Hello, I have 50 raters and 180 cases which are rated as malignant, probably malignant, probably benign, and benign. I want to compare all the raters but I want a weighted kappa to penalize differences between malignant and benign more than differences between malignant and probably malignant. I only found the weighted option in the 2-rater functions (kappa2, wkappa, cohen.kappa). The
2008 Oct 31
1
stratified kappa (measure agreement or interrater reliability)?
Hi All:
Could anyone point me to a package that can calculate stratified kappa? My
design is like this, 4 raters, 30 types of diagnosis scores, 20 patients.
Each rater will rate each patient for each type of diagnosis score. The
rater's value is nominal.
I know I can measure the agreement between raters for each type of diagnosis
score, e.g., calculate out 30 kappa values. My problem is I
2003 May 28
1
Bradley Terry model and glmmPQL
Dear R-ers,
I am having trouble understanding why I am getting an error using glmmPQL (library MASS).
I am getting the following error:
iteration 1
Error in MEEM(object, conLin, control$niterEM) :
Singularity in backsolve at level 0, block 1
The long story:
I have data from an experiment on pairwise comparisons between 3 treatments (a, b, c). So a typical run of an experiment
2010 Jun 16
1
shrout & fleiss ICC´s with varying numbers of judges
Win7, R2.11.0
I am working on a report together with several co-authors. The data
concern several performance measures on a set of groups. These measures
are scored by external judges. We report findings on several datasets,
including several of the 6 ICC's discussed by Shrout & Fleiss (1979). We
determine these using the icc function from the irr package. We have
also used the ICC
2010 Feb 13
2
Wine, ICC compilation and performance tests.
Hello everyone.
As some of you know, I was able to compile wine with Intel C++
Compiler (ICC), compilation log is located here:
http://wine.x.pl/wine-1.1.38-ICC-compilation.log.tar.gz
Some tests failed, and dxgi failed to compile (this is only related to
DX10 I think), anyway all apps I tested worked fine (Red Faction 1 &
2, 3DMark 2000,2001SE,2003,Foobar2000,Operation Flashpoint), so I did
2006 May 06
0
Bug solved / Re: irr package exits (PR#8839)
Dear Profs. Ripley & Gamer,
Thanks a lot for your prompt answer and your advice. Indeed, I managed
to track the bug by launching R from the c-shell instead of the Mac GUI.
In that case, after typing
> library(irr)
I obtained the following error message:
> Erreur dans parse(file, n, text, prompt) : syntax error at
> 653: irr.name =3D "R
> Erreur : unable to load R code in