Waverley
2009-Feb-12 18:18 UTC
[R] how to perform power analysis and sample size estimation/projection using R
Hi, I have a question in regarding to how to perform power analysis and sample size estimation/projection using R? I know power.t.test. It works really well with only one feature analysis. I have a set of features which collectively can discriminate binary classes. I can do power.t.test for each one feature to get a distribution for the sample size estimation to achieve certain power and significance. But how to evaluate such that this set of features is analyzed simultaneously as "one group" for the power analysis and sample size estimation. I also knew samr package has some utility you can do this but it seems does not work well in my situation. Please advise. Thanks a lot in advance for the help. -- Waverley @ Palo Alto
Christos Hatzis
2009-Feb-12 18:33 UTC
[R] how to perform power analysis and sample sizeestimation/projection using R
Ok. So you have a set of features, which when combined in a certain way predict a binary outcome, i.e. a multi-feature binary predictor. You have to decide first what is the hypothesis that you want to test regarding this predictor in the study that you're designing. E.g. that prediction accuracy will be greater than a min value, or the positive predictive value of the test will be greater than the class-prevalence for the population under study etc. Having decided that, you will then need to specify a null level (e.g. accuracy at least A0=70%) and an (expected) observed level at which the study will have the stated power to reject the null hypothesis (e.g. A1=80%). Then you can use the power of a test on proportions to estimate sample size for a given power, significance , etc. Several such tests are given in package 'pwr'. -Christos> -----Original Message----- > From: r-help-bounces at r-project.org > [mailto:r-help-bounces at r-project.org] On Behalf Of Waverley > Sent: Thursday, February 12, 2009 1:19 PM > To: r-help; r-help at r-project.org > Subject: [R] how to perform power analysis and sample > sizeestimation/projection using R > > Hi, > > I have a question in regarding to how to perform power > analysis and sample size estimation/projection using R? > > I know power.t.test. It works really well with only one > feature analysis. > > I have a set of features which collectively can discriminate > binary classes. I can do power.t.test for each one feature > to get a distribution for the sample size estimation to > achieve certain power and significance. But how to evaluate > such that this set of features is analyzed simultaneously as > "one group" for the power analysis and sample size > estimation. I also knew samr package has some utility you > can do this but it seems does not work well in my situation. > > Please advise. > > Thanks a lot in advance for the help. > > -- > Waverley @ Palo Alto > > ______________________________________________ > R-help at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-help > PLEASE do read the posting guide > http://www.R-project.org/posting-guide.html > and provide commented, minimal, self-contained, reproducible code. > >