Steve Cumming
2005-Jan-30 02:55 UTC
[R] Testing Poisson GLMs with independent data: what's the Right Thing To Do?
Folks, my question is not R-specific, but I've struck out twice on sci.stat.consult, so I'm turning to the R community. Even if it's a silly question, I expect that someone present will probably tell me so... I have been using multiple Poisson GLMs and similar count-re?gression models to analyse forest songbird abundance data. Many of the spe?cies-level models seem to fit the data pretty well. My next task is to validate/verify/test these models using an independen?t dataset collected for this purpose (no, really!) It seems obvious that I should apply predict.glm() to the new covariates and then somehow compare the observed values to the predicted expectations, but I don't know how exactly. Some specific questions: -what comparisons or performance measures are appropriate? -how should the results be interpreted? -is there some other (better) way to use the new data? -am I overlooking something big? Also, the covariates in the t?raining and validation datasets are not even approximately identically d?istributed (this was on purpose, for reasons I will gladly explain to anyone interested). I expect this must matter, but how? My bibles (e.g. ?Cameron and Trivedi, McCullagh and Nelder) are silent on these points, and? I can find nothing on the Web or the obvious list archives (nothing I recognise, anyway). If any read?er of this group can offer advice, suggestions, or references, I'd s?ure appreciate it. Best regards Steve Cumming Boreal Ecosystems Research Ltd. http://www.berl.ab.ca
Apparently Analagous Threads
- How to produce a graph of glms in R?
- Is there a function in R to evaluate the adjusted AIC or other statistc where overdispersion existed in GLMs?
- strucchange-esque inference for glms ?
- How to explain the meaning of mu in the variance function of GLMs?
- how to get the variance-covariance matrix/information of alpha and beta after fitting a GLMs?