similar to: ROC optimal threshold

Hello, I am just a beginner of R 1.9.0. I try to construct a predictive score for the development of liver cancer in cirrhotic patients. So dependant variable is binanry (cancer yes or no). Independant variables are biological data. The aim is to find out a cut-off value which differentiate (theoratically) from normal to pathological state for each biological data. How can I step in procedue to

Hi, I'm trying to set up a prediction software, now i testing the performance of my method, so i need to calculate a ROC curve, specially auc, cut-off, sens and spec, i just looking at ROCH package, but it's a mass for me, i'm not a math guy and I'm getting lost Could any of you recommend me an easy-to-use package to do this task? i just have a list of positive/negative samples

Hello I am trying to make a graph of 10 different lines built each from 4 different segments and to add a darker line that will represent the average of all graphs - all in the same plot.Actually each line is a ROC plot The code I'm using for plotting one line is as follows: logit.roc.plot <- function(r, title="ROC curve") { old.par <- par(no.readonly = TRUE);

Hi I need some help with ploting the ROC for K-nearest neighbors. Since KNN is a non-parametric classification methods, the predicted value will be either 0 or 1. It will not be able to test for different cutoff to plot ROC. What is the package or functions I should use to plot ROC for KNN? Thanks. Qian [[alternative HTML version deleted]]

Dear List,   I am new to ROC analysis and the package ROCR. I want to compute the confidence intervals of sensitivity and specificity for a given cutoff value. I have used the following to calculate sensitivity and specificity:   data(ROCR.simple) pred <- prediction(ROCR.simple$predictions, ROCR.simple$labels)   se.sp <- function (cutoff, performance) {     sens <-

Hello list, I am trying to perform ROC analysis and count the AUC in order to validate my results. I use package ROCR. I would like to count the AUC not under the cutoff found by "performance" but to use another cutoff that I calculate. How could I change the following command in order to get what I want? perform=performance(pred,measure="auc",x.measure="cutoff"),

Dear Guru's, Is there a package (R of course) with programs for diagnostics - roc, sens , spec, kappa etc? Best wishes Fredrik L

Hello all, Trying to get this piece of code to work on my data set. It is from http://www.itc.nl/personal/rossiter. logit.roc <- function(model, steps=100) { field.name <- attr(attr(terms(formula(model)), "factors"), "dimnames")[[1]][1] eval(parse(text=paste("tmp <- ", ifelse(class(model$data) == "data.frame", "model$data$",

Hi everybody, I have a data set with a value and a status (positive or negative case) and I want make a ROC Analysis. So, with ROCR Package, I have got the ROC curve (True Positive Fraction [tpf] according 1-True Negative Fraction [1-tnf]). http://r.789695.n4.nabble.com/file/n4469203/01.png But, now I want a new graphic which show the sum of true positive fraction and true negative fraction

Hola! Tengo que hacer una curva ROC com unos datos que obtuve de hacer una macro de excel y aplicar unas reglas, y basicamente tengo que a partir de la variacion del tiempo y la velocidad del barco obtengo diferentes porcentajes de true positives (TP) y false positives (FP) y con eso deberia de construir una curva ROC. Dada mi ignorância en este tema, no se muy bien por donde empezar , estuve

Hi, I understand that dichotimization of the predicted probabilities after logistic regression is philosophically questionable, throwing out information, etc. But I want to do it anyway. I'd like to include as a measure of fit % of observations correctly classified because it's measured in units that non-statisticians can understand more easily than area under the ROC curve, Dxy, etc.

Hello, I am afraid I do not fully understand all intricacies of programming in lattice plots. In the code below I try to plot an ROC curve, following R-news 4(1). When I condition on the variable 'group' I get the error message below, when I plot the curve for all data (i.e., y ~ pred.prob), I get the plot I want. Can someone point out why conditioning gives that message? Thanks, Ruud

Hi everybody, I am having a problem building a ROC curve with my data using the ROCR package. I have 10 lists of proteins such as attached (proteinlist.xls). each of the lists was calculated with a different p-value. The goal is to find the optimal p-value for the highest number of true positives as well as lowaest number of false positives. As far as I understood the explanations from the

Dear all, I am using the "caret" Package for predictors selection with a randomForest model. The following is the train function: rfFit<- train(x=trainRatios, y=trainClass, method="rf", importance = TRUE, do.trace = 100, keep.inbag = TRUE, tuneGrid = grid, trControl=bootControl, scale = TRUE, metric = "ROC") I wanted to use ROC as the metric for variable

Dear all, I would like to calculate the optimal cut off (threshold) of a test using the Epi package. Here I am presenting some data based on the output of two tests. I am interested in identifying the optimal cut off an its 95% CI. Running the ROC() function with the Epi package I obtain a nice picture that returns what I interpret as the optimal cut off with lr.eta=0.431. would be this the

Hello All,  I have used logistic regression glm in R and I am evaluating two models both learned with glm but with different predictors. model1 <- glm (Y ~ x4+ x5+ x6+ x7, data = dat, family = binomial(link=logit))model2 <- glm (Y~ x1 + x2 +x3 , data = dat, family = binomial(link=logit))  and I would like to compare these two models based on the prediction that I get from each model: pred1 =

The name conflicts in Epi and ROC packages (2 'ROC' functions are the problem) cause the following code to work once, but not twice: library(MASS); data(cats); x = cats[,2] y = ifelse(cats[,1]=='F',0,1) library(Epi); ROC(x,y,grid=0)$AUC library(ROC); AUC(rocdemo.sca(y, x, dxrule.sca)) What is the standard way of resolving name conflicts? Ask maintainers to resolve

*Hi, *Does anyone know how can I show an *ROC curve for R-SVM*? I understand in R-SVM we are not optimizing over SVM cost parameter. Any example ROC for R-SVM code or guidance can be really useful. Thanks, Angel. [[alternative HTML version deleted]]

I might be missing something but I thought that AUC was a measure for comparing ROC curves, so there is nothing else needed to "compare" them. The larger AUC is the higher correlation of 2 variables compared. No other measures or calculations are needed. Jarek Tuszynski -----Original Message----- From: r-help-bounces at stat.math.ethz.ch [mailto:r-help-bounces at stat.math.ethz.ch] On

Hi, I understand for 1 d classifiers, you can use ROCR package. Is there a package you can plot ROC curve for 2d classifiers? One of my colleagues asked me about this. I have been quite puzzled, conceptually, how you can do the ROC curve for 2d classifiers. Can someone share his/her knowledge or experience? Thanks in advance. -- Waverley @ Palo Alto