R help - Jul 2007 - Package for .632 (and .632+) bootstrap and the cross-validation of ROC Parameters

Hi users,

I need to calculate .632 (and .632+) bootstrap and the cross-validation of
area under curve (AUC) to compare my models. Is there any package for the
same. I know about 'ipred' and using it i can calculate
misclassification
errors. 

Please help. It's urgent. 
-- 
View this message in context:
http://www.nabble.com/Package-for-.632-%28and-.632%2B%29-bootstrap-and-the-cross-validation-of-ROC-Parameters-tf4068544.html#a11561405
Sent from the R help mailing list archive at Nabble.com.

spime wrote:
> 
> Hi users,
> 
> I need to calculate .632 (and .632+) bootstrap and the cross-validation of
> area under curve (AUC) to compare my models. Is there any package for the
> same. I know about 'ipred' and using it i can calculate
misclassification
> errors. 
> 
> Please help. It's urgent. 
See the validate* functions in the Design package.

Note that some simulations (see http://biostat.mc.vanderbilt.edu/rms) 
indicate that the advantages of .632 and .632+ over the ordinary 
bootstrap are highly dependent on the choice of the accuracy measure 
being validated.  The bootstrap variants seem to have advantages mainly 
if an improper, inefficient, discontinuous scoring rule such as the 
percent classified correct is used.

-- 
Frank E Harrell Jr   Professor and Chair           School of Medicine
                      Department of Biostatistics   Vanderbilt University