Hello, I have 50 raters and 180 cases which are rated as malignant, probably malignant, probably benign, and benign. I want to compare all the raters but I want a weighted kappa to penalize differences between malignant and benign more than differences between malignant and probably malignant. I only found the weighted option in the 2-rater functions (kappa2, wkappa, cohen.kappa). The functions I found for multiple raters do not include a weighted option for categorical data (kappam.fleiss, kappam.light, lkappa). Anyone know a function that allows the calculation of weighted kappa for m raters? Thanks in advance! ~Marwa [[alternative HTML version deleted]]