Displaying 20 results from an estimated 2000 matches similar to: "Fleiss Kappa"
2009 Jul 13
3
Help With Fleiss Kappa
Hi All,
I am using fleiss kappa for inter rater agreement. Are there any know
issues with Fleiss kappa calculation in R? Even when I supply mock data
with total agreement among the raters I do not get a kappa value of 1.
instead I am getting negative values.
I am using the irr package version 0.70
Any help is much appreciated.
Thanks and Regards
M
[[alternative HTML version deleted]]
2013 Jan 11
0
Weighted Kappa for m Raters
Hello, I have 50 raters and 180 cases which are rated as malignant, probably malignant, probably benign, and benign. I want to compare all the raters but I want a weighted kappa to penalize differences between malignant and benign more than differences between malignant and probably malignant. I only found the weighted option in the 2-rater functions (kappa2, wkappa, cohen.kappa). The
2008 Oct 31
1
stratified kappa (measure agreement or interrater reliability)?
Hi All:
Could anyone point me to a package that can calculate stratified kappa? My
design is like this, 4 raters, 30 types of diagnosis scores, 20 patients.
Each rater will rate each patient for each type of diagnosis score. The
rater's value is nominal.
I know I can measure the agreement between raters for each type of diagnosis
score, e.g., calculate out 30 kappa values. My problem is I
2008 Aug 22
3
simple generation of artificial data with defined features
Dear R-colleagues,
I am quite a newbie to R fighting my stupidity to solve a probably quite
simple problem of generating artificial data with defined features.
I am conducting a study of inter-observer-agreement in
child-bronchoscopy. One of the most important measures is Kappa
according to Fleiss, which is very comfortable available in R through
the irr-package.
Unfortunately medical doctors
2012 Feb 01
1
Function to compute multi-response, multi-rater kappa?
I'm looking for a function in R that extends kappa to multiple raters when
there is more than one response per subject. For example, say a group of
doctors have to assign diseases to patients. Each patient will be assigned
one to many diseases, and the number of doctors assigning diseases to any
one patient will be two to many.
Here's an extremely simple example of the type of data I
2012 Feb 01
0
Multi-response, multi-rater kappa?
I'm looking for an extension of kappa to measure agreement among multiple
raters when there can be more than one response per subject. For example,
say a group of doctors assign diseases to patients. Each patient will be
assigned one to many diseases, and the number of doctors assigning diseases
to any one patient will be two to many.
Here's an extremely simple example of the type of
2010 Jun 16
1
shrout & fleiss ICC´s with varying numbers of judges
Win7, R2.11.0
I am working on a report together with several co-authors. The data
concern several performance measures on a set of groups. These measures
are scored by external judges. We report findings on several datasets,
including several of the 6 ICC's discussed by Shrout & Fleiss (1979). We
determine these using the icc function from the irr package. We have
also used the ICC
2006 Apr 28
1
Where do I find Cohen´s kappa???
Hello,
I?m looking for a way to measure the goodness of fit of my model with Cohen?s Kappa (scaling between 0 and 1).
The kappa function does not give the results I?m looking for. Heres the code:
z<-glm(x~y,binomial)
kappa(z, exact = T)
Does anyone know more?
many thanks
Christian
--
_______________________________________________
Search for businesses by name, location, or phone number.
2007 Jun 26
3
inter-rater agreement index kappa
Is there a function that calculates the inter-rater agreement index
(kappa) in R?
Thanks ../Murli
[[alternative HTML version deleted]]
2012 Dec 11
0
Comparing Kappa coefficients
I have a simple R script which uses the psych package to calculate cohens
kappa (weighted) from a csv file. The csv file has 2 columns of ordinal data
- one ranked by an experienced observer and the other by a novice who is
undergoing training. What I would like to do is measure kappa for subsets of
this data (say 30-50 ratings) and check whether the observed agreement
between novice and
2010 May 25
1
Cohen's Kappa for beginners
Hi,
I've got two vectors with ratings from two coders, like this:
x<-c("red", "yellow", "blue", "red") #coder number 1
y<-c("red", "blue", "blue", "red") #coder number 2
I want to find Cohen's Kappa using the wkappa function in the psych
package. The only example in the docs is using a matrix, which
2009 Nov 03
1
Calculate Averages for time data
Hello
I have time data which is in hh:mm:ss format and I need to calculate
averages for this data. I tried converting the data as integer so that I
could calculate the average, but it doesn't serve the purpose. I tried using
Chron package also. But I am stuck up as to how to deal with the time data.
Please guide me as to how to deal with Time data in R.
Thank you in advance
Regards
Sunita
2009 Nov 15
1
Presentation of data in Graphical format
Hello
My data contains following columns:
1st column: Posts (GM, Secretary, AM, Office Boy)
2nd Column: Dept (Finance, HR, ...)
3rd column: Tasks (Open the door, Fix an appointment, Fill the register,
etc.....) depending on the post
4th column: Average Time required to do the task
So the sample data would look like
Posts Dept Task Average
2009 Nov 18
1
Need help for graphical representation
Hello
I am unable to find a graph for my data, My data contains following columns:
1st column: Posts (GM, Secretary, AM, Office Boy)
2nd Column: Dept (Finance, HR, ...)
3rd column: Tasks (Open the door, Fix an appointment, Fill the register,
etc.....) depending on the post
4th column: Average Time required to do the task
So the sample data would look like
Posts Dept
2006 Dec 11
1
cohen kappa for two-way table
Greetings,
I am a bit confused by the results returned by the functions:
cohen.kappa {concord}
classAgreement {e1071}
when using a two-way table.
for example, if I have an matrix A, and a similar matrix B (same
dimensions), then:
matrix A and B can be found:
http://casoilresource.lawr.ucdavis.edu/drupal/files/a_40.txt
http://casoilresource.lawr.ucdavis.edu/drupal/files/b_40.txt
A <-
2011 Jun 22
1
caret's Kappa for categorical resampling
Hello,
When evaluating different learning methods for a categorization problem with
the (really useful!) caret package, I'm getting confusing results from the
Kappa computation. The data is about 20,000 rows and a few dozen columns,
and the categories are quite asymmetrical, 4.1% in one category and 95.9% in
the other. When I train a ctree model as:
model <- train(dat.dts,
2009 May 14
2
Importing data into R and combining 2 files
Hello
I have to import 2 txt files into R. 1 file contains the data and the other
contains the header, column headings, datatypes and labels for the data.
I have 2 problems:
1) my data file has mixed type of data e.g. 1 2 3 4 5 3-5 02/04/06 3 4 5 and
so on, the data file is tab separated. when I import it, the data is getting
stored in one single variable say V1. I need to separate it into rows
2007 Mar 22
3
Cohen's Kappa
Hi,
im little bit confused about Cohen's Kappa and i should be look into the
Kappa function code. Is the easy formula really wrong?
kappa=agreement-chance/(1-chance)
many thanks
christian
###############################################################################
true-negativ:7445
false-positive:3410
false-negativ:347
true-positiv:772
classification-aggrement:68,6%
2008 Sep 07
1
cohen's kappa
Dear all,
I have a question on Cohen's kappa:
Assume I have two datasets, one has 500 objects, 10 methods and the other,
1000 different objects, 20 different methods. Could I compare between the
two datasets to conclude the 10 methods are more "concordant" than the 20
ones by looking at some output, for example, cohen.kappa{concord} ?
One more, could anyone explain in brief,
2009 Dec 22
1
Cohen's kappa, unequal score ranges
Hi,
I am having problems getting cohen's kappa to work. I have been using the function:
><-ckappa(x,y)
from the psy package.
I am trying to test for inter-observer reliability, I have 2 observers and 26 categories, however, the two observers might not necessarily have the same range of categories (I have unequal score ranges). However, I thought R could cope with this.
Each time I