similar to: variable selection when categorical variables are available

Hi, I am trying to understand the alternative methods that are available for selecting variables in a regression without simply imposing my own bias (having "good judgement"). The methods implimented in leaps and step and stepAIC seem to fall into the general class of stepwise procedures. But these are commonly condemmed for inducing overfitting. In Hastie, Tibshirani and Friedman

Ran a bunch of variables in R and the final result of StepAIC is as below: Why are the first 5 variables kept in the stepwise result?? Are the last 4 variables finally chosen after Stepwise? Thanks Coefficients: Estimate Std. Error t value Pr(>|t|) (Intercept) 1.315e-01 2.687e-01 0.490 0.63611 Core_CPI__ 1.290e-02 7.496e-03 1.721 0.11927 GDP_change -3.482e-03 2.075e-03 -1.678 0.12767

Hi, Is there any package for logistic model selection using BIC and Mallow's Cp statistic? If not, then kindly suggest me some ways to deal with these problems. Thanks. -- View this message in context: http://www.nabble.com/Stepwise-logistic-model-selection-using-Cp-and-BIC-criteria-tf4464430.html#a12729613 Sent from the R help mailing list archive at Nabble.com.

I am using stepAIC for stepwise regression modeling. Is there a way to change the entry and exit alpha levels for the stepwise regression using stepAIC ? Many thanks, Berthold Berthold Stegemann Bakken Research Center Maastricht The Netherlands [[alternative HTML version deleted]]

Hello, I have a question pertaining to the stepwise regression which I am trying to perform. I have a data set in which I have 14 predictor variables accompanying my response variable. I am not sure what the difference is between the function "mle.stepwise" found in the wle package and the functions "step" or "stepAIC"? When would one use

I'm manually doing a form of stepwise regression in a mixed model but with many variables, it is time consuming. I thought I'd try to use an automated approach. stepAIC gave me false convergence when I used it with my model, so I thought it can't be hard to set up a basic program to do it based on the p-values. Thus I tried a couple of (very) crude options: 1) trying to

Dear all, I cannot seem to get the R functions step or stepAIC to perform forward or stepwise regression as I expect. I have enclosed the example data in a dataframe at the end of this mail. Note rubbish is and rnorm(17) variable which I have deliberately added to the data to test the stepwise procedure. I have used wateruse.lm<-lm(waterusage~.,data=wateruse) # Fit full model

Dear all, I have encountered a problem when perform stepwise regression. The dataset have more 9 independent variables, but 7 observation. In R, before performing stepwise, a lm object should be given. fm <- lm(y ~ X1 + X2 + X3 + X11 + X22 + X33 + X12 + X13 + X23) However, summary(fm) will give: Residual standard error: NaN on 0 degrees of freedom Multiple R-Squared: 1, Adjusted

 Hi, Is there any function available to do stepwise selection of variables in Conditional(matched) logistic regression( clogit)? step, stepwise  etc are failing in case of conditional logistic regression. Please help.  Thanks P.T. Subha [[alternative HTML version deleted]]

Hi, S-PLUS includes the function "stepwise" which can use a variety of methods to conduct stepwise multiple linear regression on a set of predictors. Does a similar function exist in R? I'm having difficulty finding one. If there is one it must be under a different name because I get an error message when I try 'help(stepwise)' in R. Thanks for your help, Andy Taylor

Hi, I'm fitting poisson regression models to counts of birds in 1x1 km squares using several environmental variables as predictors. I do this in a stepwise way, using the stepAIC function. However the resulting models appear to be overparametrized, since too much variables were included. I would like to know if there is the possibility of fitting models by steps but using the AICc

Dear list, I wanna select the significant variables relative to bird distribution, using stepwise method. However, the result is always the best-fit model. Please kindly suggest if it is possible to show the selection process. Thank you Elaine [[alternative HTML version deleted]]

Dear all, I have a question regarding the use of stepAIC and polynomial (quadratic to be specific) terms in a binary logistic regression model. I read in McCullagh and Nelder, (1989, p 89) and as far as I remember from my statistics cources, higher-degree polynomial effects should not be included without the main effects. If I understand this correctly, following a stepwise model selection based

Hello all, I am trying to use stepwise procedure to select covariates in Cox model and use bootstrap to repeat stepwise selection, then record how many times variables are chosen by step() in bootstrap replications. When I use step() (or stepAIC) to do model selection, I got errors. Here is the part of my code for (j in 1:mm){ #<--mm=10 for (b in 1:nrow(reg.bs)){ #<--bootstrap 10

Dear all, Does R or S-plus or any of their packages provide any command to form any of the following procedures to find Best Regression Equation - 1. 'All Possible Regressions Procedures' (is there any automated command to perform 2^p regressions and ordering according to criteria R2(adj), mallows Cp, s2- by not setting all the regression models manually), 2. 'Backward

Hello I am not really a statistic person, so it's possible i did something completely wrong... if this is the case: sorry... I try to get the best GLM model (with the lowest AIC) for my dataset. Therefore I run a stepAIC (in the "MASS" package) for my GLM allowing only two-variable-interactions. For the output (summary) I got a model with 7 (of 8) variabels and 5 interactions and

Hi everyone, I am wondering if there exists a stepwise regression function for the Bayesian regression model. I tried googling, but I couldn't find anything. I know "step" function exists for regular stepwise regression, but nothing for Bayes. Thanks -- View this message in context: http://www.nabble.com/Bayesian-regression-stepwise-function--tp26013725p26013725.html Sent from

For example, if coefficient's p-value is less than 0.1 I want the stepwise to automatically drop that variable. Can the stepAIC be customized to do that? SAS seems to be able to customized stepwise function with p-value or cooks'd. thanks! ______________________________________________________________________ The information transmitted, including any attachments, is intended only

I'm attempting to select a model using stepAIC. I want to use a forward selection procedure. I have specified a "scope" option, but must not be understanding how this works. My results indicate that the procedure begins and ends with the "full" model (i.e., all 17 independent variables)...not what I expected. Could someone please point out what I'm not

I am hoping to get some advise on the following: I am looking for an automatic variable selection procedure to reduce the number of potential predictor variables (~ 50) in a multiple regression model. I would be interested to use the forward stepwise regression using the partial F test. I have looked into possible R-functions but could not find this particular approach. There is a function