Hallie Kamesch
2019-Jan-27 17:08 UTC
[R] troubleshooting data structure to run krippendorff's alpha
Hi - I'm trying to run Krippendorff's alpha for data consisting of 4 subjects rated on 6 events each by three raters. The ratings are interval ratio scale data. I've rearranged my data into a 3 x 24 of ratersXevents. (per this discussion on CrossValidated: ( https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144) ). This is the code I've used: library(irr) dat <- read.csv(file.choose(), header = TRUE) head(dat) kripp.alpha(dat, method=c("ratio")) #### error message: Error in sort.list(y) : 'x' must be atomic for 'sort.list' Have you called 'sort' on a list? kripp.alpha(dat,"ratio") #### error message: Error in sort.list(y) : 'x' must be atomic for 'sort.list' Have you called 'sort' on a list? I read rhelp on sort, but I'm still confused. Please help! Thank you! PS I arranged my data in that matrix based upon this comment and response from the CrossValidated posting forum ( https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144), but my question above was rejected there. [[alternative HTML version deleted]]
Jeff Newmiller
2019-Jan-28 07:25 UTC
[R] troubleshooting data structure to run krippendorff's alpha
I don't understand most of what you wrote, but when you say "matrix" you are mistaken. A matrix is NOT the same thing as a data frame, which is what you get when you call read.csv(). Read RShowDoc("R-intro") Sections 5 and 6... A data frame is a list of column vectors, while a matrix is a vector with a dimension attribute. You can use the as.matrix function to convert a data frame to a matrix. On January 27, 2019 9:08:02 AM PST, Hallie Kamesch <hallie.kamesch at gmail.com> wrote:>Hi - >I'm trying to run Krippendorff's alpha for data consisting of 4 >subjects >rated on 6 events each by three raters. The ratings are interval ratio >scale data. > >I've rearranged my data into a 3 x 24 of ratersXevents. (per this >discussion on CrossValidated: ( >https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144) >). > >This is the code I've used: >library(irr) >dat <- read.csv(file.choose(), header = TRUE) >head(dat) >kripp.alpha(dat, method=c("ratio")) >#### error message: Error in sort.list(y) : 'x' must be atomic for >'sort.list' >Have you called 'sort' on a list? >kripp.alpha(dat,"ratio") >#### error message: Error in sort.list(y) : 'x' must be atomic for >'sort.list' >Have you called 'sort' on a list? > >I read rhelp on sort, but I'm still confused. Please help! >Thank you! > >PS >I arranged my data in that matrix based upon this comment and response >from >the CrossValidated posting forum ( >https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144), >but my question above was rejected there. > > [[alternative HTML version deleted]] > >______________________________________________ >R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see >https://stat.ethz.ch/mailman/listinfo/r-help >PLEASE do read the posting guide >http://www.R-project.org/posting-guide.html >and provide commented, minimal, self-contained, reproducible code.-- Sent from my phone. Please excuse my brevity.
Jim Lemon
2019-Jan-28 09:36 UTC
[R] troubleshooting data structure to run krippendorff's alpha
Hi Halllie, As Jeff noted, a data frame is not a matrix (it is a variety of list), so that looks like your problem. hkdf<-data.frame(sample(3:5,4,TRUE),sample(1:3,4,TRUE),sample(2:4,4,TRUE), sample(3:5,4,TRUE),sample(1:3,4,TRUE),sample(2:4,4,TRUE)) library(irr) kripp.alpha(hkdf) kripp.alpha(as.matrix(hkdf)) Jim On Mon, Jan 28, 2019 at 6:04 PM Hallie Kamesch <hallie.kamesch at gmail.com> wrote:> > Hi - > I'm trying to run Krippendorff's alpha for data consisting of 4 subjects > rated on 6 events each by three raters. The ratings are interval ratio > scale data. > > I've rearranged my data into a 3 x 24 of ratersXevents. (per this > discussion on CrossValidated: ( > https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144) > ). > > This is the code I've used: > library(irr) > dat <- read.csv(file.choose(), header = TRUE) > head(dat) > kripp.alpha(dat, method=c("ratio")) > #### error message: Error in sort.list(y) : 'x' must be atomic for > 'sort.list' > Have you called 'sort' on a list? > kripp.alpha(dat,"ratio") > #### error message: Error in sort.list(y) : 'x' must be atomic for > 'sort.list' > Have you called 'sort' on a list? > > I read rhelp on sort, but I'm still confused. Please help! > Thank you! > > PS > I arranged my data in that matrix based upon this comment and response from > the CrossValidated posting forum ( > https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144), > but my question above was rejected there. > > [[alternative HTML version deleted]] > > ______________________________________________ > R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code.
Hallie Kamesch
2019-Jan-28 19:21 UTC
[R] troubleshooting data structure to run krippendorff's alpha
Hi all, Thank you for your responses. You are correct that it is not a matrix. I used the incorrect term. I meant I put my data in a spreadsheet with three rows and 24 columns. Sent from my iPhone> On Jan 28, 2019, at 3:36 AM, Jim Lemon <drjimlemon at gmail.com> wrote: > > Hi Halllie, > As Jeff noted, a data frame is not a matrix (it is a variety of list), > so that looks like your problem. > > hkdf<-data.frame(sample(3:5,4,TRUE),sample(1:3,4,TRUE),sample(2:4,4,TRUE), > sample(3:5,4,TRUE),sample(1:3,4,TRUE),sample(2:4,4,TRUE)) > library(irr) > kripp.alpha(hkdf) > kripp.alpha(as.matrix(hkdf)) > > Jim > >> On Mon, Jan 28, 2019 at 6:04 PM Hallie Kamesch <hallie.kamesch at gmail.com> wrote: >> >> Hi - >> I'm trying to run Krippendorff's alpha for data consisting of 4 subjects >> rated on 6 events each by three raters. The ratings are interval ratio >> scale data. >> >> I've rearranged my data into a 3 x 24 of ratersXevents. (per this >> discussion on CrossValidated: ( >> https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144) >> ). >> >> This is the code I've used: >> library(irr) >> dat <- read.csv(file.choose(), header = TRUE) >> head(dat) >> kripp.alpha(dat, method=c("ratio")) >> #### error message: Error in sort.list(y) : 'x' must be atomic for >> 'sort.list' >> Have you called 'sort' on a list? >> kripp.alpha(dat,"ratio") >> #### error message: Error in sort.list(y) : 'x' must be atomic for >> 'sort.list' >> Have you called 'sort' on a list? >> >> I read rhelp on sort, but I'm still confused. Please help! >> Thank you! >> >> PS >> I arranged my data in that matrix based upon this comment and response from >> the CrossValidated posting forum ( >> https://stats.stackexchange.com/questions/255164/inter-rater-reliability-for-binomial-repeated-ratings-from-two-or-more-raters/256144#256144), >> but my question above was rejected there. >> >> [[alternative HTML version deleted]] >> >> ______________________________________________ >> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see >> https://stat.ethz.ch/mailman/listinfo/r-help >> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html >> and provide commented, minimal, self-contained, reproducible code.