similar to: apply least angle regression to generalized linear models

Hi, Is there an R implementation of least angle regression for binary response modeling? I know that this question has been asked before, and I am also aware of the "lasso2" package, but that only implements an L1 penalty, i.e. the Lasso approach. Madigan and Ridgeway in their discussion of Efron et al (2004) describe a LARS-type algorithm for generalized linear models. Has

There may be benefits to having a machine learning method that explicitly targets covariate balance. We have experimented with optimizing the weights directly to obtain the best covariate balance, but got some strange solutions for simple cases that made us wary of such methods. Machine learning methods that yield calibrated probability estimates should do well (e.g. those that optimize the

R-packages leaps and subselect implement various methods of selecting best or good subsets of predictor variables for linear regression models, but they do not seem to be applicable to logistic regression models. Does anyone know of software for finding good subsets of predictor variables for linear regression models? Thanks. -Ben p.s., The leaps package references "Subset Selection

Dear R community: My platform: R 1.7.0 + windows2000. I am trying to install the package "lasso2" which I saw in the following web address: http://cran.us.r-project.org/src/contrib/PACKAGES.html#emplik. However, I failed to install it from R menu "Packages| Install package(s) from CRAN" since I could not find this item in the list. Thanks in advance! Rui [[alternative

Dear R community: My platform: R 1.7.0 + windows2000. I am trying to install the package "lasso2" which I saw in the following web address: http://cran.us.r-project.org/src/contrib/PACKAGES.html#emplik. However, I failed to install it from R menu "Packages| Install package(s) from CRAN" since I could not find this item in the list. Thanks in advance! Rui [[alternative

Hi! When I apply the lars (least-angle-regression) method to my data (3655 features, only 355 data points, no I did not mistype), I observe a strange behaviour: 1) The beta values tend to grow into real high values quite fast up to a point where they overflow and get negative. The overflow is not a problem, I don't need the last part of the analysis anyway, but why do they just

HI, Dear Greg, I AM A NEW to GBM package. Can boosting decision tree be implemented in 'gbm' package? Or 'gbm' can only be used for regression? IF can, DO I need to combine the rpart and gbm command? Thanks so much! -- Sincerely, Changbin -- [[alternative HTML version deleted]]

There are some googlable ways to feed a list of filenames to vim, but I stumble on weird results. With my filelist, I try to do cat list | xargs vim ...to edit the files listed in the file "list". Here's what happens: [root at lasso2 tempdir]# ls -l total 8 -rw-r--r-- 1 root root 0 May 17 18:28 a -rw-r--r-- 1 root root 0 May 17 18:28 b -rw-r--r-- 1 root root 3 May 17

I have had problems like this before. Probably there is something important that I don't know about routing. Let me introduce to you "Lasso2", a CentOS 4 www server that has been working perfectly well for years. Now I added a second nw card (eth1), automatically using kudzu. I cannot get this dual nw setup to work. The first nw card (eth0) stopped at once working properly,

Dear all, I am quite puzzled about the bound and absolute.t arguments to the l1ce function in the lasso2 package. (The l1ce function estimates the regression parameter b in a regression model y=Xb+e subject to the constraint that |b|<t for some value t). The doc says: bound numeric, either a single number or a vector: the constraint(s) that is/are put onto the L1 norm of the parameters.

In the package lasso2, there is a Prostate Data. To find coefficients in the prostate cancer example we could impose L1 constraint on the parameters. code is: data(Prostate) p.mean <- apply(Prostate, 5,mean) pros <- sweep(Prostate, 5, p.mean, "-") p.std <- apply(pros, 5, var) pros <- sweep(pros, 5, sqrt(p.std),"/") pros[, "lpsa"] <-

Least Angle Regression software: LARS "Least Angle Regression" ("LAR") is a new model selection algorithm; a useful and less greedy version of traditional forward selection methods. LAR is described in detail in a paper by Brad Efron, Trevor Hastie, Iain Johnstone and Rob Tibshirani, soon to appear in the Annals of Statistics. The paper, as well as R and Splus packages, are

Least Angle Regression software: LARS "Least Angle Regression" ("LAR") is a new model selection algorithm; a useful and less greedy version of traditional forward selection methods. LAR is described in detail in a paper by Brad Efron, Trevor Hastie, Iain Johnstone and Rob Tibshirani, soon to appear in the Annals of Statistics. The paper, as well as R and Splus packages, are

Dear R-help, I am having trouble with the predict function in lasso2. For example: > data(Iowa) > l1c.I <- l1ce(Yield ~ ., Iowa, bound = 10, absolute.t=TRUE) > predict (l1c.I) # this works is fine > predict (l1c.I,Iowa) Error in eval(exper,envir, enclos) : couldn't find function "Yield" And I have similar trouble whenever I use the newdata argument in

Hi all, I want to know some details about the c routine “lasso” in the functions of “gl1ce()” . However, I have following troubles. First, I can not find the routine in the local directories of this function (or package). Second, if I found the routine, could I call it just like this way, say, fit <- .C("lasso", …,PACKAGE = "lasso2") in my own functions. My system is

Hi, Dear Greg, Sorry to bother you again. I have several questions about the 'gbm' package. if the train.fraction is less than 1 (ie. 0.5) , then the* first* 50% will be used to fit the model, the other 50% can be used to estimate the performance. if bag.fraction is 0.5, then gbm use the* random* 50% of the data to fit the model, and the other 50% data is used to estimate the

Hi all I seem to have fallen at the first hurdle with my analysis, I have a set of binary disease outbreak data linked to a large number of landscape metrics variables and environmental variables which I would like to as predictor variables in a Least Angle Logistic Regression using the glars.fit.s function in the glars package (my data exhibits some multicollinearity hence the LARS) but when I

Hi, First, when I try the example Prostate with bound 0.44 (as in the manual), I got a different result: > l1c.P <- l1ce(lpsa ~ ., Prostate, bound=0.44) > l1c.P .... Coefficients: (Intercept) lcavol lweight age lbph svi 1.0435803 0.4740831 0.1953156 0.0000000 0.0000000 0.3758199 lcp gleason pgg45 0.0000000 0.0000000

Dear all, I was recently contacted by a user about an alledged problem/bug in the latest version of lasso2. After some investigation, we found out that it was a user error which boils down to the following: > x <- matrix(rnorm(200), ncol=2) > var <- "fred" > apply(x, 2, var) Error in get(x, envir, mode, inherits) : variable "fred" of mode "function"

Dear R-users, For the purpose of model selection I am looking for a way to exhaustively (and efficiently) search for best subsets of predictor variables for a logistic regression model. I am looking for something like leaps() but that works with glm. Any feedback highly appreciated. -- Harald von Waldow <hvwaldow at chem.ethz.ch> Safety and Environmental Technology Group Institute for