similar to: Are unpaired data suitable for DiagnosisMed's Diagnosis ?

Dear, I wanna to compare AUC generated by two distribution models using the same sample. The AUC for model 1 consists of two columns, column A for 0/1 and column B for probability, eahc with the same row number of 3000. The AUC for model 2 consists of two columns, column A for 0/1 and column B for probability, eahc with the same row number of 10000 rows. I am wondering what value I should put

Dear, I wanna to compare AUC generated by two distribution models using the same sample. I tried improveProb function's example code below. set.seed(1) library(survival) x1 <- rnorm(400) x2 <- x1 + rnorm(400) d.time <- rexp(400) + (x1 - min(x1)) cens <- runif(400,.5,2) death <- d.time <= cens d.time <- pmin(d.time, cens) rcorrp.cens(x1, x2, Surv(d.time, death))

Hi, I am trying to calculate net reclassification improvement (NRI) and Inegrated Discrimination Improvement (IDI) for a survival dataset to compare 2 risk models. It seems that the improveProb() in Hmisc package does this only for binary outcome, while rcorrp.cens() does take survival object, but doesn't output NRI or IDI. Can anyone suggest any other packages that can calculate NRI and IDI

Greetings, I have generated several ROC curves and would like to compare the AUCs. The data are cross sectional and the outcomes are binary. I am testing which of several models provide the best discrimination. Would it be most appropriate to report AUC with 95% CI's? I have been looking in to the "net reclassification improvement" (see below for reference) but thus far I can only

Hello Thanks to Frank Harrell for the great Design package. I noted from Pencina's Article (Statistics in Medicine Vol 27, pp157-172) that the result obtained for the Net Reclassification Index depends upon categorical cut-offs for risk (eg in the paper <6%, 6-20% and >20%). I wondered how the improveprob function arrives at its cut-offs, and whether there was any function to change the

Dear all I am trying to compare the performances of several methods using the AUC0.1 and not the whole AUC. (meaning I wanted to compare to AUC's whose x axis only goes to 0.1 not 1) I came to know about the Mcneil Hanley test from Bernardo Rangel Tura and I referred to the original paper for the calculation of "r" which is an argument of the function cROC. I can only find the

Dear all, I am interested to evaluate reclassification using net reclassification improvement and Integrated Discrimination Index IDI after survival analysis (Cox proportional hazards using stcox). I search a R package or a R code that specifically addresses the categorical NRI for time-to-event data in the presence of censored observation and, if possible, at different follow-up time points. I

Dear list   I have 5 markers that can be used to detect an infection in combination. Could you please advise me how to use functions in ROCR/ other package to produce the ROC curve for a combination of markers?   I have used the following to get ROC statistics for each marker. pred <- prediction(y$marker1, y$infectn) perf <-performance(pred,"tpr","fpr")

Dear list, I am trying to work out how the improveProb() function works and how to interpret the results, and I have a few questions. I would be grateful if anyone could shed some light on these. in the Net Reclassification Improvement section of the output, is the 2P column the two-sided p-value for the differences in classification? So if a limit is set at 0.05, then lower values indicate

Dear Sirs. I am working with the R packages Hmisc and PredictABEL to make NRI estimates from my Cox models with and without a specific biomarker. According to Pencina et al (Statistics in Medicine 2010, DOI: 0.1002/sim.4085 ), a continuous/non-categorical NRI (NRI>0) is to be used when there are no obvious reason to categorize risk, such as the risk of future cardiovascular events in patients

Hello, Is there is any R function computes the AUC for paired data? Many thanks, Samuel [[alternative HTML version deleted]]

Hi, I would like to compare differences in AUC from 2 different models, glm and gam for predicting presence / absence. I know that in theory the model with a higher AUC is better, but what I am interested in is if statistically the increase in AUC from the glm model to the gam model is significant. I also read quite extensive discussions on the list about ROC and AUC but I still didn't find

On Mon, Aug 29, 2011 at 12:38 PM, ret val <retval386 at gmail.com> wrote: > I am looping through all instructions in a Function and depending on > what I found I may or may not insert code. Despite the fact that I'm > only actually inserting *before* instruction I have a infinite loop > when I do something like below. For awhile it was simple enough to > just increment i

Please forgive a stats question. I have to sets of data (unpaired) measured on an ordinal scale. I want to test to see if the two sets are different (i.e. do they have the same location): set1: 1,3,2,2,4,3,3,2,2 set: 4,4,4,3,3,5,4,4 What is the most appropriate non-parametric test to test location? Thanks, John Confidentiality Statement: This email message, including any attachments, is

As describe in the Hmisc package's improveProb function, that function is for binary Y. And it's best to use category-free methods. Frank Petergodsk wrote > Hi > > I'm new to R. > > Is it possible to use the improveProb function to generate categorybased > NRI using a Cox model? > I believe I saw someone mentioning the possibility, but I can't find the

My data is 50,000 instances of about 200 predictor values, and for all 50,000 examples I have the actual class labels (binary). The data is quite unbalanced with about 10% or less of the examples having a positive outcome and the remainder, of course, negative. Nothing suggests the data has any order, and it doesn't appear to have any, so I've pulled the first 30,000 examples to use as

Hallo, I modified a code given by Andrija, a contributor in the list  to achieve two objectives: create 1000 samples from a list of 207 samples with each of the samples cointaining 20 good and 20 bad. THis i have achievedcalcuate AUC each of the 1000 samples, this i get an error. Please see the code below and assist me. > data<-data.frame(id=1:(165+42),main_samp$SCORE,

Dear List, I want to compare the presence and absence of bird species based on the sites in a matrix. The matrix has 5 rows for Island A, B, C, D, and E. It has 100 columns for bird species D001-D100. In each cell of the matrix, the presence-absence of bird species will be recorded as 1 or 0. (For example, if species D001 is found on Island D, the matrix cell of species D001 and Island D

Hi, I am quite new to R and I have two questions regarding ROCR. 1. I have tried to understand how to extract area-under-curve value by looking at the ROCR document and googling. Still I am not sure if I am doing the right thing. Here is my code, is "auc1" the auc value? " pred1 <- prediction(resp1,label1) perf1 <- performance(pred1,"tpr","fpr") plot(

Hello, This is Elaine. I am using R 3.0 to download package vegan but failed. The warning message is package ‘vegan’ successfully unpacked and MD5 sums checked Warning: unable to move temporary installation ‘C:\Users\elaine\Documents\R\win-library\3.0\file16c82da53b1b\vegan’ to ‘C:\Users\elaine\Documents\R\win-library\3.0\vegan’ I cannot find the folder \file16c82da53b1b\ below