similar to: New package: ROCR (Visualizing classifier performance)

Dear useRs, an update of the ROCR package is available on CRAN. ROCR helps in evaluating the performance of scoring classifiers using ROC graphs, precision/recall plots, lift charts and many other performance metrics. For further information check http://rocr.bioinf.mpi-sb.mpg.de and http://bioinformatics.oxfordjournals.org/cgi/reprint/21/20/3940 NEWS: - added an optional parameter

Dear useRs, an update of the ROCR package is available on CRAN. ROCR helps in evaluating the performance of scoring classifiers using ROC graphs, precision/recall plots, lift charts and many other performance metrics. For further information check http://rocr.bioinf.mpi-sb.mpg.de and http://bioinformatics.oxfordjournals.org/cgi/reprint/21/20/3940 NEWS: - added an optional parameter

Hi all, is there a more convenient way to debug R code than the built in debug() function? (so that one can set breakpoints, step in and out of function calls,...). I read the section on debugging compiled code in the manual "Writing R Extensions" (I only want to debug ordinary code but thought that maybe the advice there could help), but didn't find out how I can start

Dear R-philes, I am having some trouble averaging across multiple runs of a classifier in an ROC Curve. I am using the ROCR package and the plot() method. First, I initialize a list with two elements where each element is a list of predictions and labels: vowel.ROC <- list(predictions=list(), labels=list()) For every run of the classifier, I append the scores and labels to their

Dear R-help and ROCR developers (Tobias Sing and Oliver Sander) - I think my first question is generic and could apply to many methods, which is why I'm directing this initially to R-help as well as Tobias and Oliver. Question 1. The plot function in ROCR will average your cross validation data if asked. I'd like to use that averaged data to find a "best" cutoff but I

Hi, while implementing the rsync protocol in one of our projects I found that the current CVS version still has a MD4 bug. I'm using the FreeBSD libmd implementation and I still had checksum mismatches with protocol version 27 for files whose size was a multiple of 64 - 4 ( - 4 due to checksum_seed). A patch for todays CVS version is attached. Someone should also review the clean_fname()

If we use the ROCR package to find the accuracy of a classifier pred <- prediction(svm.pred, testset[,2]) perf.acc <- performance(pred,"acc") Do we?find the maximum accuracy?as follows?(is there a simplier way?): > max(perf.acc at x.values[[1]]) Then to find the cutoff point that maximizes the accuracy?do we do the following?(is there a simpler way): > cutoff.list <-

All, I'm trying again with a slightly more generic version of my first question. I can extract the plotted values from hist(), boxplot(), and even plot.randomForest(). Observe: # get some data dat <- rnorm(100) # grab histogram data hdat <- hist(dat) hdat #provides details of the hist output #grab boxplot data bdat <- boxplot(dat) bdat #provides details of the boxplot

Hi everybody, I am having a problem building a ROC curve with my data using the ROCR package. I have 10 lists of proteins such as attached (proteinlist.xls). each of the lists was calculated with a different p-value. The goal is to find the optimal p-value for the highest number of true positives as well as lowaest number of false positives. As far as I understood the explanations from the

Hi, I'm involved in a bioinformatics project at my university, and we're doing a comparison paper between some methods of classification of nc-RNA. I've been encharged of ploting the ROC curves' graphs. But I'm new on working with R and I'm having some difficulty with the prediction-class. I don't get where the values of ROCR.simple$predictions, for example, came from

I'm trying to use ROCR to create a simple cutoff vs recall plot (recall at p) on the example ROCR.simple dataset: library(ROCR) data(ROCR.simple) pred <- prediction(ROCR.simple$predictions, ROCR.simple$labels) perf <- performance(pred, "rec") plot(perf) But R crashes on me on the last line. I'm using R 2.14.1, ROCR 1.0-4. ?Any ideas? Thanks in advance. -- Yang Zhang

Hello all, I have two problems with the ROCR package. First Problem: the add=TRUE option does not work for plotting performance objects The following code is taken from the reference manual (example for ROCR.hiv, page2) data(ROCR.hiv) attach(ROCR.hiv) pred.svm <- prediction(hiv.svm$predictions, hiv.svm$labels) perf.svm <- performance(pred.svm, 'tpr', 'fpr') pred.nn <-

Hi, I have an object from the prediction function from the ROCR package and I would like to extract one of the slots from the object, for example the cutoffs slot. However the usual techniques ($, [["name"]]) of subsetting don't work. How can I assess the lists in the slots? Here is an example of what I am working with: library(ROCR) data(ROCR.simple) pred <-

I am trying to use package ROCR to analyze classification accuracy, unfortunately there are some problems right at the beginning. Question 1) When I try to run demo I am getting the following error message > library(ROCR) > demo(ROCR) > if(dev.cur() <= 1) .... [TRUNCATED] Error in get(getOption("device")) : wrong first argument When I issue the command > dev.cur() it

Dear List,   I am new to ROC analysis and the package ROCR. I want to compute the confidence intervals of sensitivity and specificity for a given cutoff value. I have used the following to calculate sensitivity and specificity:   data(ROCR.simple) pred <- prediction(ROCR.simple$predictions, ROCR.simple$labels)   se.sp <- function (cutoff, performance) {     sens <-

I have tried installing the package (ROCR) with this command: Install.packages(ROCR) And with this command on the command line R CMD INSTALL ROCR_1.0-4.tar.gz But both times I get exactly the same error shown below, I don't understand what is wrong, is this an error in the package code? Thank you Philip probinson@bioinform08:/tmp/RtmpO0rFbx/downloaded_packages$ R CMD

Dear R-helper, I am working with ROCR of Tobias Sing et. al. to compare the performances of logistic and nnet models on a binary response. I had the performance plots, but I have problem finding out other performance statistics (eg. MSE/ASE, AUC). Any help on this? Thanks Ilham [[alternative HTML version deleted]]

I meet lots of problem when installing the package ROCR, do you have meet such problems? 1, biocLite("ROCR") 2, biocLite("gplots") 3, biocLite("Rgraphviz") 4, sudo apt-get install graphviz oh, no, unlimited question, what's wrong with R in ROCR or gplots or et al Error : object ‘nobs’ is not exported by 'namespace:gdata' installation of package

When I try to install the ROCR package (which requires gplots) on Ubuntu 9.10 (Xubuntu Karmic Koala) 64-bit on R version 2.9.2 (2009-08-24), it eats up all my RAM (2GB) and swap (4GB) and keeps allocating more memory until Linux's out of memory (OOM) killer kills the perl process. This problem is special to Ubuntu because I can install other packages (such as party) on this Ubuntu system, and

Hi, I don't really understand how ROCR works. Here's another example with a randomforest model: I have the training dataset(bank_training) and testing dataset(bank_testing) and I ran a randomForest as below: bankrf<-randomForest(y~., bank_training, mtry=4, ntree=2, keep.forest=TRUE,importance=TRUE) bankrf.pred<-predict(bankrf, bank_testing)