We have uploaded to CRAN a new version of glmpath, a package which fits the L1 regularization path for generalized linear models. The revision includes: - coxpath, a function for fitting the L1-regularization path for the Cox ph model; - bootstrap functions for analyzing sparse solutions; - the ability to mix in L2 regularization along with L1 (elasticnet). We have also completed a report that describes these methods in detail: http://www-stat.stanford.edu/~hastie/Papers/glmpath.pdf The lars package in R fits the entire piecewise-linear L1 regularization path for the lasso. The coefficient paths for L1 regularized glms, however, are not piecewise linear. glmpath uses convex optimization - in particular predictor-corrector methods - to fit the coefficient path at important junctions. These junctions are at the "knots" in |beta| where variables enter/leave the active set; i.e. nonzero/zero values. Users can request greater resolution at a cost of more computation, and compute values on a fine grid between the knots. The code is fast, and can handle largish problems efficiently. it took just over 4 sec system cpu time to fit the logistic regression path for the "spam" data from UCI with 3065 training obs and 57 predictors. For a microarray example with 5000 variables and 100 observations, 11 seconds cpu time. Currently glmpath implements binomial, poisson and gaussian families. The additional coxpath algorithm extends the concepts to survival data via the L1-regularized Cox proportional hazards model. We have added bootstrap functions, which help make sense of automatically chosen models (via AIC). Shake up the data, and a different model might be chosen. The bootstrap is a natural way of measuring the strength (significance) of variables, and more. Mixing in a small amount of L2 regularization brings a lot of stability to the lasso; for example, without it the limiting sequence for a logistic regression model with separable data is undefined. We have added this option to glmpath and coxpath Mee Young Park and Trevor Hastie Update details: ### glmpath 0.90 -> glmpath 0.91 ### <Major changes> 1. Elastic net penalty added 2. Coxpath functions: coxpath, cv.coxpath, plot.coxpath, predict.coxpath 2. Bootstrap functions: bootstrap.path, plot.bootpath <Minor changes> glmpath: actions[[1]] label subtract 1 from every id number in actions bshoot.threshold = 0.1 instead of 0.5 relax.lambda = 1e-8 instead of 1e-9 re-center the intercept in b.corrector/b.predictor fix gaussian AIC/BIC corrector1: fix the first element of AIC/BIC [[alternative HTML version deleted]] _______________________________________________ R-packages mailing list R-packages at stat.math.ethz.ch https://stat.ethz.ch/mailman/listinfo/r-packages