R help - May 2006 - Interrater and intrarater variability (intraclass correlation coefficients)

Hello!
 
I want to calculate the intra- and interrater reliability of my study. The
design is very simple, 5 raters rated a diagnostic score 3 times for 19
patients.
 
Are there methods/funtions in R? I only found packages to calculate interrater
variability and intraclass correlation coefficients for matrices of n*m (n
subjects, m raters) - I have n subjects, m raters and r repetitions.
 
Can anybody help?
 

Thanks!
Karl

Hi Karl,

this sounds like a variance components problem - I suspect that you
will find that you can tackle it using the lme() or lmer() functions
of the nlme and lme4 packages respectively.

The key reference for this tool is:

@Book{PB00:mixed,
  author =       {J. C. Pinheiro and D. M. Bates},
  title =        {Mixed-effects models in S and Splus},
  publisher =    {Springer-Verlag},
  year =         2000
}

Cheers,

Andrew



On Tue, May 16, 2006 at 10:09:54AM +0000, Karl Knoblick
wrote:
> Hello!
>  
> I want to calculate the intra- and interrater reliability of my study. The
design is very simple, 5 raters rated a diagnostic score 3 times for 19
patients.
>  
> Are there methods/funtions in R? I only found packages to calculate
interrater variability and intraclass correlation coefficients for matrices of
n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions.
>  
> Can anybody help?
>  
> 
> Thanks!
> Karl
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
http://www.R-project.org/posting-guide.html
-- 
Andrew Robinson  
Department of Mathematics and Statistics            Tel: +61-3-8344-9763
University of Melbourne, VIC 3010 Australia         Fax: +61-3-8344-4599
Email: a.robinson at ms.unimelb.edu.au         http://www.ms.unimelb.edu.au

Dear Andrew and Karl,

See the irr, condord, and psy packages.

Regards,
 John

On Tue, 16 May 2006 20:37:00 +1000
 Andrew Robinson <A.Robinson at ms.unimelb.edu.au>
wrote:
> Hi Karl,
> 
> this sounds like a variance components problem - I suspect that you
> will find that you can tackle it using the lme() or lmer() functions
> of the nlme and lme4 packages respectively.
> 
> The key reference for this tool is:
> 
> @Book{PB00:mixed,
>   author =       {J. C. Pinheiro and D. M. Bates},
>   title =        {Mixed-effects models in S and Splus},
>   publisher =    {Springer-Verlag},
>   year =         2000
> }
> 
> Cheers,
> 
> Andrew
> 
> 
> 
> On Tue, May 16, 2006 at 10:09:54AM +0000, Karl Knoblick wrote:
> > Hello!
> >  
> > I want to calculate the intra- and interrater reliability of my
> study. The design is very simple, 5 raters rated a diagnostic score 3
> times for 19 patients.
> >  
> > Are there methods/funtions in R? I only found packages to calculate
> interrater variability and intraclass correlation coefficients for
> matrices of n*m (n subjects, m raters) - I have n subjects, m raters
> and r repetitions.
> >  
> > Can anybody help?
> >  
> > 
> > Thanks!
> > Karl
> > 
> > ______________________________________________
> > R-help at stat.math.ethz.ch mailing list
> > https://stat.ethz.ch/mailman/listinfo/r-help
> > PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
> 
> -- 
> Andrew Robinson  
> Department of Mathematics and Statistics            Tel:
> +61-3-8344-9763
> University of Melbourne, VIC 3010 Australia         Fax:
> +61-3-8344-4599
> Email: a.robinson at ms.unimelb.edu.au
>         http://www.ms.unimelb.edu.au
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
--------------------------------
John Fox
Department of Sociology
McMaster University
Hamilton, Ontario, Canada
http://socserv.mcmaster.ca/jfox/

I wish to reproduce a locally-weighted fit from (old-fashioned) lowess with 
(new-fangled) loess.

Although ?lowess advises that loess has different defaults, does anyone know 
how to set up loess so it does exactly the same as lowess did?

Fiddling about suggests setting loess(x, span = 0.8, degree=1) is fairly 
close for my data - but clearly not the same.

(I can't help feeling that with something basic like this, I've probably
been unlucky in my archive/help searches so far.)

Stuart



This message has been checked for viruses but the contents of an attachment
may still contain software viruses, which could damage your computer system:
you are advised to perform your own checks. Email communications with the
University of Nottingham may be monitored as permitted by UK legislation.

Thanks! But I could not find a corresponding example in the mentioned book - at
least the calculation of the intra- and interrater variability or the
corresponding intraclass coefficients.
 
Karl

----- Urspr?ngliche Mail ----
Von: Andrew Robinson <A.Robinson at ms.unimelb.edu.au>
An: Karl Knoblick <karlknoblich at yahoo.de>
CC: r-help at stat.math.ethz.ch
Gesendet: Dienstag, den 16. Mai 2006, 12:37:00 Uhr
Betreff: Re: [R] Interrater and intrarater variability (intraclass correlation
coefficients)


Hi Karl,

this sounds like a variance components problem - I suspect that you
will find that you can tackle it using the lme() or lmer() functions
of the nlme and lme4 packages respectively.

The key reference for this tool is:

@Book{PB00:mixed,
  author =       {J. C. Pinheiro and D. M. Bates},
  title =        {Mixed-effects models in S and Splus},
  publisher =    {Springer-Verlag},
  year =         2000
}

Cheers,

Andrew



On Tue, May 16, 2006 at 10:09:54AM +0000, Karl Knoblick
wrote:
> Hello!
>  
> I want to calculate the intra- and interrater reliability of my study. The
design is very simple, 5 raters rated a diagnostic score 3 times for 19
patients.
>  
> Are there methods/funtions in R? I only found packages to calculate
interrater variability and intraclass correlation coefficients for matrices of
n*m (n subjects, m raters) - I have n subjects, m raters and r repetitions.
>  
> Can anybody help?
>  
> 
> Thanks!
> Karl
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
http://www.R-project.org/posting-guide.html
-- 
Andrew Robinson  
Department of Mathematics and Statistics            Tel: +61-3-8344-9763
University of Melbourne, VIC 3010 Australia         Fax: +61-3-8344-4599
Email: a.robinson at ms.unimelb.edu.au         http://www.ms.unimelb.edu.au

Daer John,
 
Thanks! My problem is that in the mentioned packages (irr, condord, and psy)
only a n*m matrix for subjects and raters can be given as data. So I can not
give the repetitions as data and therefore it will be impossible to get results
for the INTRArater reliability.
 
Regards,
Karl

----- Urspr?ngliche Mail ----
Von: John Fox <jfox at mcmaster.ca>
An: Andrew Robinson <A.Robinson at ms.unimelb.edu.au>; Karl Knoblick
<karlknoblich at yahoo.de>
CC: r-help at stat.math.ethz.ch
Gesendet: Dienstag, den 16. Mai 2006, 15:02:15 Uhr
Betreff: Re: [R] Interrater and intrarater variability (intraclass correlation
coefficients)


Dear Andrew and Karl,

See the irr, condord, and psy packages.

Regards,
John

On Tue, 16 May 2006 20:37:00 +1000
Andrew Robinson <A.Robinson at ms.unimelb.edu.au>
wrote:
> Hi Karl,
> 
> this sounds like a variance components problem - I suspect that you
> will find that you can tackle it using the lme() or lmer() functions
> of the nlme and lme4 packages respectively.
> 
> The key reference for this tool is:
> 
> @Book{PB00:mixed,
>   author =       {J. C. Pinheiro and D. M. Bates},
>   title =        {Mixed-effects models in S and Splus},
>   publisher =    {Springer-Verlag},
>   year =         2000
> }
> 
> Cheers,
> 
> Andrew
> 
> 
> 
> On Tue, May 16, 2006 at 10:09:54AM +0000, Karl Knoblick wrote:
> > Hello!
> >  
> > I want to calculate the intra- and interrater reliability of my
> study. The design is very simple, 5 raters rated a diagnostic score 3
> times for 19 patients.
> >  
> > Are there methods/funtions in R? I only found packages to calculate
> interrater variability and intraclass correlation coefficients for
> matrices of n*m (n subjects, m raters) - I have n subjects, m raters
> and r repetitions.
> >  
> > Can anybody help?
> >  
> > 
> > Thanks!
> > Karl
> > 
> > ______________________________________________
> > R-help at stat.math.ethz.ch mailing list
> > https://stat.ethz.ch/mailman/listinfo/r-help
> > PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
> 
> -- 
> Andrew Robinson  
> Department of Mathematics and Statistics            Tel:
> +61-3-8344-9763
> University of Melbourne, VIC 3010 Australia         Fax:
> +61-3-8344-4599
> Email: a.robinson at ms.unimelb.edu.au
>         http://www.ms.unimelb.edu.au
> 
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide!
> http://www.R-project.org/posting-guide.html
--------------------------------
John Fox
Department of Sociology
McMaster University
Hamilton, Ontario, Canada
http://socserv.mcmaster.ca/jfox/